94% CAGR: What the Inference Boom means for your AI costs | Vamshi Ambati

94% CAGR: What the Inference Boom means for your AI costs | Vamshi Ambati

June 9, 2026 · 52 min · Season 1 · Episode 373

About this episode

The episode discusses the implications of the inference boom on AI costs with expert Vamshi Ambati.

Vamshi Ambati has spent more than two decades in AI, through the symbolic era, statistical era, and the neural wave we're experiencing today. A CMU PhD, founder of LatentStructure and Predera (which was acquired), now an investor at Virama Ventures, he's one of the sharper voices on what's actually happening under the hood of the AI boom. We discuss a simple question: Who wins when models become cheaper and more abundant? And try to answer this by looking at how inference spend v/s comp...

More episodes of The Neon Show

Explore listener stats, chart rankings, contacts and more on the The Neon Show podcast page.