Why AI Needs Independent Auditors, with Miles Brundage

About this episode

Alan Rozenshtein discusses AI safety and the need for independent auditors with Miles Brundage.

Alan Rozenshtein, research director at Lawfare, spoke with Miles Brundage, founding executive director of the AI Verification and Evaluation Research Institute (AVERI) and former senior advisor for AGI readiness at OpenAI, about the state of AI safety and accountability and AVERI's vision for independent third-party auditing of frontier AI companies. The conversation covered the weaknesses of current AI regulations, including California's SB 53 and New York's RAISE Act; why Brundage left OpenAI to build an independent nonprofit; AVERI's case for shifting the unit of analysis from individual AI models to the organizations that build them; the "Volkswagen problem" of deception-proofing safety evaluations; a framework of AI Assurance Levels ranging from baseline transparency to treaty-grade verification; the limitations of safety benchmarks and the BenchRisk project's findings; market-based mechanisms for driving audit adoption, including insurance, procurement, and investor pressure; and how AVERI navigates the tension between proximity to industry and independence from it. Mentioned in this episode:   Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and…

People in this episode

Host: Alan Rozenshtein

Guest: Miles Brundage

Topics covered

• AI safety
• accountability
• independent auditing
• AI regulations
• nonprofit organizations
• market mechanisms

Keywords

• AI safety
• independent auditors
• AVERI
• OpenAI
• AI regulations
• benchmarking
• audit adoption

Mentioned in this episode

Organizations: AI Verification and Evaluation Research Institute, OpenAI, California, New York

Books & works: Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companies, Averi 2026 Risk Management for Mitigating Benchmark Failure Modes: BenchRisk, Why I'm Leaving OpenAI and What I'm Doing Next

More episodes of Scaling Laws

• Inside the Fight to Detect and Govern Synthetic Abuse with Melissa Hutchins of Certifi AI · May 29, 2026 · 1h 2m
• HAGS (with AI): How AI Tools Are Shaping Education with Adeel Khan and Ryan Trattner · May 26, 2026 · 50 min
• The Politics of Data Centers with VA Delegate John McAuliff · May 22, 2026 · 48 min
• Let's Do the Science! Talking Algorithms with Cathy O'Neill · May 19, 2026 · 49 min
• Escaping One-Size-Fits-All AI Policy with Sean Perryman · May 15, 2026 · 41 min
• Forecasting AI's Impact on the Economy with Deger Turan, CEO of Metaculus · May 12, 2026 · 52 min