"Sequent: scale and automation for higher confidence in alignment" by Geoffrey Irving, Alex HT, Jesse Hoogland, Daniel Murfet, Jacob Pfau, Marco Cozzi, Stan van Wingerden
About this episode
The episode discusses the challenges of aligning artificial superintelligence and introduces the nonprofit research organization Sequent aimed at improving confidence in alignment.
Alignment is not on track Artificial superintelligence (ASI) may be developed in the next few years. It is unclear whether alignment is on track to be ready on the same timeframe. At a minimum, the empirical programs at AI labs are unlikely to deliver a priori confidence, before training ASI, that things will go well. We are starting a large nonprofit research organization, Sequent, that aims to clear a higher bar: We are aiming at higher confidence via a portfolio of theory and empirics...
More episodes of LessWrong (Curated & Popular)
- "PSA: Almost nobody is working on alignment" by Chi Nguyen, peterbarnett
- "Estimating No-CoT Task-Completion Time Horizons of Frontier AI Models" by Anders Cairns Woodruff, Francis Rhys Ward, Dewi Gould, Rauno Arike, Jason R Brown, Jo Jiao, wlanderson, ariana_azarbal, harrymayne, Patrick Leask
- "Even “illegible” Mythos reasoning traces seem pretty legible" by faul_sname
- "The Machines Lack Honour" by Raymond Douglas
Explore listener stats, chart rankings, contacts and more on the LessWrong (Curated & Popular) podcast page.