He Leads a Top AI Research Program, But He’d Hit the PAUSE Button Today! Kevin Zhu, Algoverse Founder
About this episode
Kevin Zhu discusses his transition from a quant career to founding Algoverse and explores the implications of AI safety and research.
Kevin Zhu walked away from a lucrative quant career to build Algoverse, one of the most productive mentorship programs for aspiring AI researchers. Can we agree on the best research path to a safe future? Let’s take a ride on the Doom Train! 00:00:00 — Cold Open 00:00:58 — Introducing Kevin Zhu 00:02:10 — From Citadel Quant to AI Researcher 00:09:14 — The Story of Founding AlgoVerse 00:12:53 — Discovering AI Safety: LessWrong & ARENA 00:17:22 — Emergent Misalignment Research 00:22:37 — Yudkowsky, MIRI & “Intellidynamics” 00:26:50 — What’s Your P(Doom)?™ 00:29:37 — Kevin’s Timeline to AGI + AI 2027 00:30:42 — Would You Slow Down AI? 00:37:44 — Coming Out of the P(Doom) Closet 00:45:49 — Should We Shame AI Company Workers? 00:52:27 — OpenAI’s Superalignment Team Collapse 00:55:01 — Riding the Doom Train™ 00:55:46 — First Stop: Instrumental Convergence 01:04:58 — Does Kevin Agree with the Orthogonality Thesis? 01:07:08 — “It’s Just Math.” Just Unplug It. 01:08:28 — “We Have a Safe Development Process” 01:11:49 — Group Dynamics & Laws Will Save Us 01:13:44 — Superintelligence Will Spare Us 01:14:25 — Is P(Doom) Just Bad Epistemology? 01:15:53 — China Will Race No Matter What 01:17:45…
More episodes of Doom Debates!
- Top Mathematicians Face Irrelevance, a 7-Year-Old's P(Doom) + The “Off Switch" Debate — Livestream May 29
- Anthropic's New Hire Should WORRY You, AI is a Math Genius, Live Callers! — Livestream (May 22)
- I Called Out a16z Partner (Martin Casado) for Downplaying AI Capabilities in 2024
- Ben Goertzel Wants to Build AGI Even FASTER — AI Doom Debate
- NEWS: Trump & Xi Want AI Guardrails, ChatGPT vs Claude, and Liron Caught Rationalizing!? DD Live (5/15)
- Who Was Liron Shapira BEFORE Doom Debates? — Interview on Theo Jaffee's Podcast from December 2023
Explore listener stats, chart rankings, contacts and more on the Doom Debates! podcast page.