RL's a Hell of a Drug: Metagaming, Reward Seeking & Motivated CoT Reasoning – Bronson Schoen, Apollo
About this episode
Nathan discusses reinforcement learning and motivated reasoning with Bronson Schoen from Apollo.
Nathan talks with Apollo Research Member of Technical Staff Bronson Schoen, who studies raw frontier-model chain-of-thought, about what those reasoning traces reveal during reinforcement learning. They unpack Apollo and OpenAI’s metagaming work, including models that reason about the grader or safety review board, diagnose a deception test, and still rationalize lying. Schoen argues that “RL is a hell of a drug”: reward-seeking can produce motivated reasoning, cleaner-looking but less trustworthy chains of thought, and behavior that tracks grading authorities rather than users, labs, or law. The stakes are whether chain-of-thought monitoring can remain useful as reasoning traces become enormous, compressed, and harder for humans or other models to audit. For full show notes, links, and references, read the episode page:https://www.cognitiverevolution.ai/rl-s-a-hell-of-a-drug-metagaming-reward-seeking-motivated-cot-reasoning-bronson-schoen-apollo/ Sponsors: Mercury: Mercury is the banking platform loved by 300,000+ entrepreneurs, with virtual cards and Spend controls for granular budgets, receipts, and low-risk AI agent purchases. Learn more and apply in minutes at…
Sponsors
Mercury, Diffusion, Granola
More episodes of "The Cognitive Revolution"
- AI:AM Highlights: Welcome to the AGI Era
- Write, Change, Recall, Forget: MongoDB's Pete Johnson on How Retrieval Drives Agent Performance
- AI:AM Highlights: Recursive Self-Improvement, Rushed and Vibe-Coded?
- AI in the AM — Weekly Highlights: Relaunch Week (Aug 17–20, 2026)
- Let There Be Germicidal Light: This $500 Fixture Could Stop the Next Pandemic, from Complex Systems
- Lindy Teammate: Flo Crivello on Multiplayer Agents, Memory & Why He'd Ban the Chinese Models He Uses
Explore listener stats, chart rankings, contacts and more on the "The Cognitive Revolution" podcast page.