Powering the AI Inference Wave with EPRI's Ben Sooter - Ep. 292

About this episode

Ben Sooter discusses the impact of AI on electricity demand and the role of micro data centers in enhancing grid resilience.

AI is reshaping electricity demand. What does increased demand, and the shape of that demand, mean for the electric grid? Ben Sooter, Director of R&D at EPRI joins the podcast to explain why most of an AI model’s lifetime energy use comes from inference rather than training, and how micro data centers located near underutilized substations can help deliver low‑latency AI services while strengthening grid resilience.

People in this episode

Host: NVIDIA

Guest: Ben Sooter

Topics covered

• AI inference
• electricity demand
• electric grid
• micro data centers
• grid resilience

Keywords

• AI
• inference
• electricity
• grid
• data centers
• resilience
• EPRI

Mentioned in this episode

Organizations: EPRI

More episodes of NVIDIA AI Podcast

• How Mistral Is Building Frontier AI for the Enterprise | NVIDIA AI Podcast Ep. 301 · June 10, 2026 · 22 min
• Everyone Can Build a Robot: Open Source Embodied AI With Seeed Studio | NVIDIA AI Podcast Ep. 300 · May 27, 2026 · 29 min
• Inside AI Tokenomics: How to Profitably Turn Tokens Into Business Value | NVIDIA AI Podcast Ep. 299 · May 21, 2026 · 33 min
• Snap’s Secret to Processing 10 Petabytes a Day: GPU-Accelerated Spark | NVIDIA AI Podcast Ep. 298 · May 13, 2026 · 24 min
• Harrison Chase of LangChain on Deep Agents, LangSmith, and Earning Trust | NVIDIA AI Podcast Ep. 297 · May 6, 2026 · 25 min
• How Dassault Systèmes Is Building AI That Understands Physics - Ep. 296 · April 29, 2026 · 23 min