About this episode
The episode discusses the challenges of AI infrastructure and how DDN is addressing these issues for large-scale AI systems.
AI is moving fast, but after my conversation with Alex Bouzari, Co-Founder and CEO at DDN, at Google Cloud Next '26, one thing became clear. The bottleneck is no longer the model. It is the infrastructure behind it. Alex broke it down in a very real way. Today’s AI systems are powerful, but the way data moves through them is still inefficient. You train these large models, but when it comes to actually running them at scale, things slow down. Latency increases, costs go up, and performance becomes unpredictable. That is what is broken. He shared how this shows up in real scenarios. When enterprises deploy AI, especially with large models, they struggle with speed and consistency. It is not that the model cannot perform, it is that the infrastructure cannot keep up with the demand. At Next, DDN focused on solving exactly this. Building what Alex called a new foundation for AI, designed for high-performance workloads where data access and speed matter just as much as the model itself. One concept that stood out was KV cache. It sounds technical, but the idea is simple. Instead of recomputing everything every time a model runs, you reuse key pieces of information. That reduces…
People in this episode
Host: Ravit Jain
Guest: Alex Bouzari
Topics covered
- AI infrastructure
- data efficiency
- high-performance workloads
- operationalizing AI
- latency reduction
Keywords
- AI
- infrastructure
- latency
- DDN
- Google Cloud
- high-performance
- KV cache
- operationalizing AI
Mentioned in this episode
Organizations: DDN, Google Cloud
More episodes of The Ravit Show
- Rubrik Forward 2026 Key Announcements · June 11, 2026 · 25 min
- How AI Is Reshaping Teamwork: Insights from Atlassian’s Teamwork Lab · June 10, 2026 · 13 min
- POSETTE 2026 by Microsoft · June 9, 2026 · 13 min
- Why Data Context Matters: Inside Atlassian’s Teamwork Graph and AI Agents · June 8, 2026 · 10 min
- AI Is Powerful… But Can You Trust It? · June 7, 2026 · 11 min
- Inside SAS Innovate: The Shift to Production-Ready AI · June 6, 2026 · 15 min
Explore listener stats, chart rankings, contacts and more on the The Ravit Show podcast page.