AI Can't Replace Your Doctor: Why the Headlines Are Lying to You
From The Psychology of Health by Milan Toma
May 23, 2026 · 10 min · Season 2 · Episode 8
About this episode
This episode critiques the misleading claims that AI can diagnose better than doctors, emphasizing the importance of human intuition and multimodal assessment in medicine.
Those viral headlines claiming AI diagnoses better than doctors? They're based on fundamentally flawed research—and believing them could be dangerous to your health. In this episode, I break down the alarming trend of studies from prestigious journals like Science and JAMA Network Open claiming large language models outperform physicians in diagnostic reasoning. The problem? These studies exist entirely outside the realm of actual clinical medicine. Here's what they actually tested: They gave ChatGPT-style AI and physicians the same written notes about patients neither ever met—then compared who could guess the diagnosis better from text alone. That's not medicine. That's a reading comprehension test. Real medicine is irreducibly multimodal. When you sit with your doctor, they're simultaneously processing your facial expressions, your tone of voice, your body language, your lab values, your imaging, and that clinical intuition built from years of experience. They notice when you claim "high pain tolerance" but wince at a light touch. They read between the lines of what you said—and what you didn't say. None of this is accessible to a text-based language model.We also…
People in this episode
Host: Milan Toma
Topics covered
- AI in medicine
- diagnostic reasoning
- healthcare
- medical research
- language models
- clinical intuition
Keywords
- AI
- doctors
- diagnosis
- health
- medical research
- ChatGPT
- clinical medicine
Mentioned in this episode
Organizations: Science, JAMA Network Open
Products: ChatGPT
More episodes of The Psychology of Health
- The Limits of Chatbots in Clinical Decision‑Making · May 7, 2026 · 8 min
- Viral AI-Beats-Doctors Study · May 4, 2026 · 8 min
- Medical Education Must Teach AI Differently · April 14, 2026 · 37 min
- The Overfitting Trap · April 2, 2026 · 23 min
- Understanding the Trust Gap in Medical AI · March 18, 2026 · 9 min
- Algorithmic Shortcuts That Undermine Medical AI · March 13, 2026 · 18 min
Explore listener stats, chart rankings, contacts and more on the The Psychology of Health podcast page.