#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving
About this episode
Geoffrey Irving discusses the urgent need for AI alignment before superintelligence emerges.
When should governments slow the race toward superintelligence? According to Geoffrey Irving , the careful answer is sometime in the past. The useful answer is now. Geoffrey — formerly a safety researcher at OpenAI and Google DeepMind and chief scientist at the UK AI Security Institute — expects full-blown superintelligence in roughly two to three years. *** Want to work with Geoffrey to help align superintelligence? Resolution is hiring! https://80k.info/work-at-resolution *** The leading AI companies all have broadly similar plans for keeping superintelligence under control: Train models to have good character Use increasingly capable AIs to supervise other AIs Monitor them closely for signs of deception or scheming Geoffrey thinks that combination could work. The alarming part is that nobody has a strong argument that it will . He expects a crucial “phase shift” as models move beyond human intelligence: Below that threshold, humans can usually tell whether a model’s work is good and correct its mistakes. Above it, the models themselves will increasingly determine the feedback used to train their successors. In this episode, Geoffrey and new host Tom Reed explore what might go…
Sponsors
Resolution
More episodes of 80,000 Hours Podcast
- Why the intelligence explosion can't happen inside a data centre | Tom Reed
- Inside the first AI-coordinated cyberattack on a real company
- #253 – AI 2027's author returns with a plan to change the ending | Daniel Kokotajlo
- #252 – Owain Evans on accidentally training AI models to be evil
- #250 – Toby Ord on where AGI timelines go wrong
- What the hell happened with AGI timelines in 2026? – Rob Wiblin
Explore listener stats, chart rankings, contacts and more on the 80,000 Hours Podcast podcast page.