
The RL Fine-Tuning Playbook: CoreWeave's Kyle Corbitt on GRPO, Rubrics, Environments, Reward Hacking
From "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis by Erik Torenberg, Nathan Labenz
May 1, 2026 · 1h 47m · Season 1
About this episode
Kyle Corbitt discusses reinforcement learning and custom fine-tuning techniques for AI models.
Kyle Corbitt, founder of OpenPipe, breaks down reinforcement learning and custom fine-tuning for modern AI models. He explains how RL differs from supervised fine-tuning, why GRPO and LLM-as-judge post-training matter, and how these techniques can improve performance, latency, and cost on open source models. The conversation also covers reward hacking, evaluation design, LoRA adapters, and how Chinese labs are using distillation to fast-follow frontier models. Sponsors: Sequence: Sequence handles the full revenue workflow for complex pricing, from quoting and metering to invoicing, revenue recognition, and collections. Book a public demo at https://sequencehq.com and use code Cognizant in the source field to save 20% off year one AvePoint: AvePoint is building the control layer for AI agents so you can securely govern, audit, and recover every action at scale. Design trusted agentic outcomes from day one at https://avpt.co/tcr VCX: VCX, by Fundrise, is the public ticker for private tech, giving everyday investors access to high-growth private companies in AI, space, defense tech, and more. Learn how to invest at https://getvcx.com Claude: Claude by Anthropic is an AI collaborator…
People in this episode
Hosts: Erik Torenberg, Nathan Labenz
Guest: Kyle Corbitt
Topics covered
- reinforcement learning
- AI models
- fine-tuning
- reward hacking
- evaluation design
- open source models
Keywords
- reinforcement learning
- fine-tuning
- GRPO
- reward hacking
- evaluation design
- LoRA adapters
- distillation
Sponsors
Sequence, AvePoint, VCX, Claude
Mentioned in this episode
Organizations: OpenPipe, Fundrise
More episodes of "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
- Babysitting the Machine: Glean's Rebecca Hinds on the Hidden Human Labor of AI at Work · June 10, 2026 · 1h 46m
- AI in the AM — Week 1 Highlights (June 2026) · June 6, 2026 · 1h 23m
- Nested Learning: Ali Behrouz on the Quest for Continual Learning & Illusion of AI Architectures · June 3, 2026 · 3h 0m
- Inside Nathan's Second Brain: Daniel Miessler, Security Expert & Creator of PAI, Audits My AI Setup · June 1, 2026 · 2h 33m
- Your Biggest Lever: Designing your AI Career for Maximum Impact, with 80,000 Hours founder Ben Todd · May 26, 2026 · 1h 42m
- All Compute Is Food: Palisade's Jeffrey Ladish on AI Shutdown Resistance, Self-Replication & Ecology · May 24, 2026 · 2h 13m
Explore listener stats, chart rankings, contacts and more on the "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis podcast page.