
Nate Soares discusses the potential dangers of superintelligent AI and the challenges of AI alignment.
Nate Soares joins me to discuss the race to superintelligent AI, why alignment remains unsolved and why he believes building machines smarter than humanity could end in catastrophe. Nate explains why modern AI is not programmed like traditional software, but grown through training processes we do not fully understand. We discuss AI escaping labs, recursive self-improvement, why today’s systems are only safe because they are not yet powerful enough to take over and why the danger may not be that AI hates us, but that it does not care about us at all. We also get into OpenAI, Anthropic, Google DeepMind, xAI - the AI companies racing ahead despite the risks, why “turning it off” may not be possible, the case for an international treaty against superintelligence, and why Nate believes we should not give up before the driver wakes up. - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - TIMESTAMPS: 00:00:00 - AI That Doesn’t Care About Us 00:01:04 - If Anyone Builds This, Everyone Dies 00:04:17 - If He’s Right, We Lose Everything 00:07:28 - Why Nate Isn’t Anti-AI 00:08:32 - From Google and DeepMind to AI Risk 00:11:00 - Why Can’t We Make…
Host: Peter McCormack
Guest: Nate Soares
Organizations: OpenAI, Anthropic, Google DeepMind, xAI
Explore listener stats, chart rankings, contacts and more on the The Peter McCormack Show podcast page.