Open-Weight AI Models

About this episode

Benny Chen discusses the rise of open-weight AI models and their implications for developers and organizations.

Open-weight models are AI systems whose trained parameters are publicly released, which allows developers to run, fine-tune, and deploy them independently rather than accessing them only through a hosted API. While closed-weight models from companies like OpenAI or Anthropic are delivered as managed services, open-weight models give organizations direct control over how the models are deployed and used. Importantly, the performance of these models is steadily improving and they’ve become credible alternatives for production workloads, with advantages in customization and data privacy. ​ Fireworks AI is building a platform focused on serving and customizing open-weight models at scale. The platform includes optimized inference infrastructure, multi-hardware support across NVIDIA and AMD, and reinforcement fine-tuning capabilities. ​ Benny Chen is a Co-Founder of Fireworks AI. In this episode, he joins Gregor Vand to discuss his path from Meta’s ML infrastructure teams to co-founding Fireworks AI, why open-weight models are becoming increasingly competitive, how custom kernels and speculative decoding improve performance, reinforcement fine-tuning, and much more. Gregor Vand is a…

People in this episode

Host: Gregor Vand

Guest: Benny Chen

Topics covered

• open-weight AI models
• AI customization
• data privacy
• infrastructure
• reinforcement fine-tuning
• production workloads

Keywords

• open-weight models
• AI systems
• custom kernels
• speculative decoding
• inference infrastructure
• NVIDIA
• AMD

Mentioned in this episode

Organizations: Fireworks AI, OpenAI, Anthropic, Meta

Places: Singapore

More episodes of Software Engineering Daily

• Web Native Game Development · June 4, 2026 · 52 min
• The Hardware Bottleneck AI Can’t Fix · June 2, 2026 · 51 min
• Autonomous Drone Delivery at Scale · May 28, 2026 · 50 min
• The European Startup Scene · May 26, 2026 · 47 min
• React Native at Scale · May 21, 2026 · 47 min
• Formal Methods as Agent Guardrails · May 19, 2026 · 50 min