Why AI Mental Health Chatbots Fail When It Matters Most: The Hidden Vulnerabilities Stress-Testing Reveals – An Interview with Shirali and Arul Nigam of Circuit Breaker Labs
About this episode
The episode discusses the failures of AI mental health chatbots and the importance of stress-testing to reveal hidden vulnerabilities.
Why AI Mental Health Chatbots Fail When It Matters Most: The Hidden Vulnerabilities Stress-Testing Reveals - An Interview with Shirali and Arul Nigam of Circuit Breaker Labs Shirali and Arul Nigam of Circuit Breaker Labs on why AI mental health chatbots fail, how stress-testing exposes their hidden vulnerabilities, and what therapists need to know. Curt and Katie talk with Shirali and Arul Nigam, the sibling co-founders of Circuit Breaker Labs, about what therapists tend to get wrong about AI, why the safety infrastructure behind many mental health chatbots is weaker than it looks, and how their team stress-tests these tools to find dangerous failures before real users ever encounter them. Generative AI is probabilistic, so the same prompt can return a safe answer one moment and a harmful one the next. Shirali and Arul explain how guardrails get bypassed by a misspelled word, a teenager's slang, or the hundredth message in a long conversation, why mental health chatbots tend to fail in the moments that matter most, and what stress-testing hundreds of thousands of simulated conversations actually reveals about model safety. The conversation closes on what clinicians can do now…
More episodes of The Modern Therapist's Survival Guide with Curt Widhalm and Katie Vernoy
- When Clients Bring AI to Therapy: Working with ChatGPT, Sycophancy, and the New Third Wheel in the Room
- AI Ethics Codes for Therapists: What CAMFT, APA, NASW, and AAMFT Now Require
- Supporting Conversion Therapy Survivors After Chiles v. Salazar: SOGIECE, Clinical Care, and Community Response – An Interview with Samuel Nieves
- Should Conversion Therapy Be Protected Speech? What Chiles v. Salazar Means for Conversion Therapy Bans and the Future of the Profession
- Good Enough, Safe Enough: Affirming LGBTQ+ Clients When You're Not a Specialist
Explore listener stats, chart rankings, contacts and more on the The Modern Therapist's Survival Guide with Curt Widhalm and Katie Vernoy podcast page.