The good, the bad, and the AI apps
About this episode
Ryan discusses the evaluation of AI applications with Benny Chen, co-founder of Fireworks AI.
Ryan welcomes Benny Chen, co-founder of Fireworks AI, to the show to explore what actually makes an AI application good or not, how to balance qualitative signals with quantitative metrics when evaluating AI, and how open-source eval protocols and community efforts are setting the standard for AI evaluation. Episode notes: Fireworks AI is a cloud platform designed for developers and enterprises to run, customize, and scale open-source generative AI models. Connect with Benny on LinkedIn . Congrats to user techtabu for winning a Stellar Answer badge for answering How can I delete all local Docker images? . See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info .
People in this episode
Host: Ryan
Guest: Benny Chen
Topics covered
- AI applications
- evaluation metrics
- open-source
- community efforts
- technology
Keywords
- AI
- evaluation
- open-source
- generative AI
- technology
Mentioned in this episode
Organizations: Fireworks AI
More episodes of The Stack Overflow Podcast
- The future of development is full-stack
- Developers who move fast still need to do it together
- Your AI is only as responsible as you are
- Building more than just an agent harness
- What's left for infrastructure-as-code after AI moves in?
- Agent orchestration is so two-years ago
Explore listener stats, chart rankings, contacts and more on the The Stack Overflow Podcast podcast page.