AI:AM #4: Cameron on Model Consciousness, Duvenaud's Gradual Disempowerment, swyx's AI-Eng Alpha

About this episode

The episode discusses the implications of AI systems gaining decision-making power and the challenges associated with it.

This AI:AM highlights cut brings together Cameron Berg, David Duvenaud, Michiel Bakker, Shawn “swyx” Wang, and Bing Xu to examine what we understand about frontier AI systems and what happens as more decisions move into their hands. Berg grounds model-consciousness debates in experiments on architecture, agency, valence, and welfare, while Duvenaud argues that even well-aligned AI could gradually disempower humans through ordinary economic choices. Bakker frames Europe’s AI challenge as a sovereignty problem, and swyx turns to practitioner stakes around agents, evals, maintainable code, and who owns the system of record. Xu closes the loop at the infrastructure layer, arguing that self-improving compute and GPU-kernel automation may deepen rather than weaken the CUDA moat. For full show notes, links, and references, read the episode page:https://www.cognitiverevolution.ai/ai-am-4-cameron-on-model-consciousness-duvenaud-s-gradual-disempowerment-swyx-s-ai-eng-alpha/ Mercury: Command is Mercury’s new conversational interface, giving you natural-language access to your finances and helping you take actions within your existing permissions and approval policies. Visit…

People in this episode

Hosts: Erik Torenberg, Nathan Labenz

Guests: Cameron Berg, David Duvenaud, Michiel Bakker, Shawn “swyx” Wang, Bing Xu

Topics covered

• model consciousness
• AI systems
• economic choices
• AI sovereignty
• infrastructure
• self-improving compute

Keywords

• AI
• model consciousness
• economic disempowerment
• AI sovereignty
• self-improving compute
• GPU-kernel automation

Sponsors

Mercury, Claude

Mentioned in this episode

Organizations: Anthropic

More episodes of "The Cognitive Revolution"

• AI:AM Highlights: Welcome to the AGI Era · September 5, 2026 · 2h 21m
• Write, Change, Recall, Forget: MongoDB's Pete Johnson on How Retrieval Drives Agent Performance · September 1, 2026 · 1h 37m
• AI:AM Highlights: Recursive Self-Improvement, Rushed and Vibe-Coded? · August 28, 2026 · 2h 12m
• RL's a Hell of a Drug: Metagaming, Reward Seeking & Motivated CoT Reasoning – Bronson Schoen, Apollo · August 26, 2026 · 2h 14m
• AI in the AM — Weekly Highlights: Relaunch Week (Aug 17–20, 2026) · August 22, 2026 · 2h 34m
• Let There Be Germicidal Light: This $500 Fixture Could Stop the Next Pandemic, from Complex Systems · August 16, 2026 · 1h 25m