The CEO Behind the Fastest-Growing AI Inference Company | Tuhin Srivastava
From Gradient Dissent: Conversations on AI by Lukas Biewald
November 18, 2025 · 59 min · Season 1 · Episode 131
About this episode
Tuhin Srivastava discusses the rise of Baseten and the challenges of AI inference.
In this episode of Gradient Dissent, Lukas Biewald talks with Tuhin Srivastava, CEO and founder of Baseten, one of the fastest-growing companies in the AI inference ecosystem. Tuhin shares the real story behind Baseten’s rise and how the market finally aligned with the infrastructure they’d spent years building. They get into the core challenges of modern inference, including why dedicated deployments matter, how runtime and infrastructure bottlenecks stack up, and what makes serving large models fundamentally different from smaller ones. Tuhin also explains how vLLM, TensorRT-LLM, and SGLang differ in practice, what it takes to tune workloads for new chips like the B200, and why reliability becomes harder as systems scale. The conversation dives into company-building, from killing product lines to avoiding premature scaling while navigating a market that shifts every few weeks. Connect with us here: Tuhin Srivastva: https://www.linkedin.com/in/tuhin-srivastava/ Lukas Biewald: https://www.linkedin.com/in/lbiewald/ Weights & Biases: https://www.linkedin.com/company/wandb/
People in this episode
Host: Lukas Biewald
Guest: Tuhin Srivastava
Topics covered
- AI inference
- company-building
- infrastructure challenges
- model serving
- market alignment
- workload tuning
Keywords
- AI
- inference
- Baseten
- Tuhin Srivastava
- model serving
- infrastructure
- workload tuning
- scaling
Mentioned in this episode
Organizations: Baseten, Weights & Biases
Products: vLLM, TensorRT-LLM, SGLang, B200
More episodes of Gradient Dissent: Conversations on AI
- He Raised $70M to Cure Every Disease With AI | Samuel G. Rodriques, Edison Scientific · May 26, 2026 · 1h 15m
- Uber, Nissan, and Mercedes Chose This Self-Driving Startup | Alex Kendall, Wayve · April 15, 2026 · 46 min
- Why Netflix, Uber, and Spotify Never Lag: The Database Nobody Talks About | Aaron Katz · March 31, 2026 · 44 min
- The $64M Bet on an AI That Has to Be Right | Carina Hong, CEO of Axiom · February 5, 2026 · 51 min
- What a $42B Software Co. Really Spends on AI Tools · January 20, 2026 · 1h 8m
- Inside the $41B AI Cloud Challenging Big Tech | CoreWeave SVP · January 6, 2026 · 53 min
Explore listener stats, chart rankings, contacts and more on the Gradient Dissent: Conversations on AI podcast page.