About this episode

Benny Chen discusses the rise of open-weight AI models and their implications for developers and organizations.

Open-weight models are AI systems whose trained parameters are publicly released, which allows developers to run, fine-tune, and deploy them independently rather than accessing them only through a hosted API. While closed-weight models from companies like OpenAI or Anthropic are delivered as managed services, open-weight models give organizations direct control over how the models are deployed and used. Importantly, the performance of these models is steadily improving and they’ve become credible alternatives for production workloads, with advantages in customization and data privacy. ​ Fireworks AI is building a platform focused on serving and customizing open-weight models at scale. The platform includes optimized inference infrastructure, multi-hardware support across NVIDIA and AMD, and reinforcement fine-tuning capabilities. ​ Benny Chen is a Co-Founder of Fireworks AI. In this episode, he joins Gregor Vand to discuss his path from Meta’s ML infrastructure teams to co-founding Fireworks AI, why open-weight models are becoming increasingly competitive, how custom kernels and speculative decoding improve performance, reinforcement fine-tuning, and much more. Gregor Vand is a…

People in this episode

Host: Gregor Vand

Guest: Benny Chen

Topics covered

• open-weight AI models
• AI customization
• data privacy
• infrastructure
• reinforcement fine-tuning
• production workloads

Keywords

• open-weight models
• AI systems
• custom kernels
• speculative decoding
• inference infrastructure
• NVIDIA
• AMD

Mentioned in this episode

Organizations: Fireworks AI, OpenAI, Anthropic, Meta

Places: Singapore

Explore listener stats, chart rankings, contacts and more on the Software Engineering Daily podcast page.