Where AI Inference Hits the Memory Wall
From In The Arena by TechArena by Allyson Klein
April 28, 2026 · 22 min · Season 3 · Episode 75
About this episode
Nilesh Shah discusses the impact of data movement, compression, and memory bandwidth on AI inference performance.
ZeroPoint’s Nilesh Shah explores why data movement, compression, and memory bandwidth now shape AI inference performance, and where heterogeneous systems and quantum may fit next.
People in this episode
Host: Allyson Klein
Guest: Nilesh Shah
Topics covered
- AI inference
- memory bandwidth
- data movement
- compression
- heterogeneous systems
- quantum computing
Keywords
- AI
- inference
- memory
- data movement
- compression
- performance
- quantum
Mentioned in this episode
Organizations: ZeroPoint
More episodes of In The Arena by TechArena
- Predictive Memory: How MEXT Turns Cheap Flash Into DRAM · June 8, 2026 · 22 min
- AI in Biomedical Engineering: Maya Kalyan on Diagnostics · June 4, 2026 · 20 min
- Dell Builds the Bridge Between Classical and Quantum Tech · June 4, 2026 · 12 min
- From Nobel Physics to Modern Quantum with John Martinis & Nilesh Shah · June 4, 2026 · 43 min
- From Xcelerated Compute: Cambium Capital on Practical Quantum · June 3, 2026 · 16 min
- Microblink’s Radu Tudoran on AI-Driven Identity Fraud · May 15, 2026 · 27 min
Explore listener stats, chart rankings, contacts and more on the In The Arena by TechArena podcast page.