Earley AI Podcast Episode 89: Memory, Power, and the Hidden Constraints of AI Infrastructure

About this episode

Seth Earley discusses with Steven Woo the critical role of memory in AI performance and the challenges of data transfer in AI infrastructure.

Guest: Steven Woo, Fellow and Distinguished Inventor at Rambus Host: Seth Earley, CEO at Earley Information Science Published on: May 5, 2026 In this episode, Seth Earley speaks with Steven Woo, Fellow and Distinguished Inventor at Rambus, where he has spent over 30 years at the frontier of memory technology. They explore why memory - not compute - is the binding constraint on AI performance today, how moving data between chips consumes more than half of all power in a high-end AI processor,...

People in this episode

Host: Seth Earley

Guest: Steven Woo

Topics covered

• AI performance
• memory technology
• data transfer
• power consumption
• AI infrastructure

Keywords

• AI
• memory
• power
• infrastructure
• data transfer
• performance
• technology

Mentioned in this episode

Organizations: Rambus

More episodes of Earley AI Podcast

• Earley AI Podcast – Episode 92: Supply Chain Intelligence, Knowledge Graphs, and the Limits of the Easy Button with Ilya Levtov · June 1, 2026 · 41 min
• Earley AI Podcast - Episode 91: Real-Time Voice Intelligence, Fraud Detection, and AI Guardrails with Mike Pappas · May 26, 2026 · 26 min
• Earley AI Podcast – Episode 90: Federated AI, Decision Intelligence, and the Data Architecture Reset · May 26, 2026 · 31 min
• Earley AI Podcast - Episode 88: Digital Twins, Agentic AI, and the Future of Work with David Shim · April 27, 2026 · 49 min
• Earley AI Podcast – Episode 87: AI-Enabled Enterprise Data Migration with Dominik Wittenbeck · April 20, 2026 · 44 min
• Earley AI Podcast – Ep. 86: Open Source, Observability, and AI-Driven Engineering with Tom Wilkie · April 17, 2026 · 49 min