Ep 80: CEO of Surge AI Edwin Chen on Why Frontier Labs Are Diverging, RL Environments & Developing Model Taste

Ep 80: CEO of Surge AI Edwin Chen on Why Frontier Labs Are Diverging, RL Environments & Developing Model Taste

From Unsupervised Learning with Jacob Effron by by Redpoint Ventures

December 15, 2025 · 48 min · Episode 80

About this episode

Edwin Chen discusses the challenges and nuances of AI evaluation and the divergent paths of frontier labs in developing AGI.

Edwin Chen is the founder and CEO of Surge AI, the data infrastructure company behind nearly every major frontier model. Surge works with OpenAI, Anthropic, Meta, and Google, providing the high-quality data and evaluation infrastructure that powers their models. Edwin reveals why optimizing for popular benchmarks like LMArena is "basically optimizing for clickbait," how one frontier lab's models regressed for 6-12 months without anyone knowing, and why the industry's approach to measurement is fundamentally broken. Jacob and Edwin discuss what actually makes elite AI evaluators, why "there's never going to be a one size fits all solution" for AI models, and how frontier labs are taking surprisingly divergent paths to AGI.

People in this episode

Host: Jacob Effron

Guest: Edwin Chen

Topics covered

  • AI evaluation
  • data infrastructure
  • frontier models
  • AGI development
  • benchmarking
  • machine learning

Keywords

  • Surge AI
  • frontier labs
  • AI models
  • LMArena
  • data quality
  • evaluation infrastructure
  • machine learning benchmarks

Mentioned in this episode

Organizations: Surge AI, OpenAI, Anthropic, Meta, Google

More episodes of Unsupervised Learning with Jacob Effron

Explore listener stats, chart rankings, contacts and more on the Unsupervised Learning with Jacob Effron podcast page.