About this episode

The episode discusses the growing importance of inference in AI, focusing on Etched's ASIC system and the competitive landscape of custom chips.

Inference is becoming more important than pre-training in AI chips, including how pre-fill and decode work and why more compute is shifting toward serving models. Today we walk through Etched’s ASIC system for transformer inference, its claims around efficiency and throughput, and the tradeoff between specialization and general-purpose GPUs like NVIDIA’s. We also look at custom chip efforts from companies like OpenAI, Google, and Amazon, and argues that inference demand may keep growing as AI agents and long-running workloads expand. ------ 🌌 LIMITLESS HQ ⬇️ EMAIL US: info@limitless.fm NEWSLETTER: https://limitlessft.substack.com/ FOLLOW ON X: https://x.com/LimitlessFT SPOTIFY: https://open.spotify.com/show/5oV29YUL8AzzwXkxEXlRMQ APPLE: https://podcasts.apple.com/us/podcast/limitless-podcast/id1813210890 RSS FEED: https://limitlessft.substack.com/ ------ TIMESTAMPS 0:00 Inference’s New Frontier 2:14 Training Versus Inference 5:19 Etched’s Bold Bet 7:58 Building the Whole Rack 10:48 TSMC and the Hard Problems 13:29 Why Inference Matters 14:59 The Transformer Risk 17:02 OpenAI’s Jalapeno Chip 18:59 Why Accelerators Keep Winning 22:28 The Market Is Underpricing It 23:10 NVIDIA Is…

People in this episode

Host: Josh

Guest: Ejaaz

Topics covered

• AI inference
• ASIC systems
• GPU comparison
• custom chips
• AI demand
• technology trends

Keywords

• inference
• AI chips
• Etched
• NVIDIA
• OpenAI
• Google
• Amazon
• custom chips
• efficiency
• throughput

Mentioned in this episode

Organizations: Etched, NVIDIA, OpenAI, Google, Amazon

More episodes of Limitless: An AI Podcast

• AI Bubble Update: Kimi K3 Sends China into Chaos · July 21, 2026 · 26 min
• THIS WEEK IN AI: Kimi K3, OpenAI's Alexa, Grok Stealing Code, Thinking Machines · July 17, 2026 · 33 min
• Are Cheaper AI Models Better than Claude and ChatGPT? · July 16, 2026 · 31 min
• The Government Banned GPT-5.6. OpenAI Released it Anyways · July 15, 2026 · 24 min
• Apple v. OpenAI: Trade Secrets and Corporate Espionage · July 14, 2026 · 29 min
• THIS WEEK IN AI: Grok is Back, ChatGPT 5.6, Meta's New Models, China's Threats · July 10, 2026 · 30 min

Explore listener stats, chart rankings, contacts and more on the Limitless: An AI Podcast podcast page.