About this episode
The episode explores the trustworthiness of AI in life or death decisions and the ethical implications of delegating such decisions to machines.
What characteristics make a person trustworthy? Under what circumstances would a person delegate life or death decisions to artificial intelligence (AI)? Does it matter that AI systems reflect trustworthy humans’ decision-making preferences, morals, and ethics? If so, what characteristics are most important? These are some of the fundamental questions DARPA researchers are exploring for the In the Moment (ITM) program, which aims to support the development of algorithms that are trusted to independently make decisions in difficult domains, particularly in significant trauma events such as battlefield triage. DARPA’s research has identified the need for fundamentally different approaches to advance AI technology to a place where we’re willing to trust it and not be foolish to do so. Continuing themes from our mini-series on ELSI – ethical, legal, and societal implications of new technologies and capabilities – we meet with DARPA’s ITM program manager, Dr. Patrick Shafto, and the ITM performers and ELSI advisors, who break down how they’re tackling the fundamental question of alignment in the context of human decision-makers and autonomous decision-making tools. In case you missed…
People in this episode
Guest: Dr. Patrick Shafto
Topics covered
- artificial intelligence
- decision-making
- trust
- ethics
- trauma events
- human alignment
Keywords
- AI
- trustworthy
- decision-making
- ethics
- trauma
- battlefield triage
- ELSI
Mentioned in this episode
Organizations: DARPA, RTX BBN
More episodes of Voices from DARPA
- The Economics Aficionado: Episode 94 · June 12, 2026
- What's in a Name? Episode 93 · May 20, 2026
- From Cold Call to Critical Care: Episode 92 · April 21, 2026 · 31 min
- From Blockbuster to Biotech Breakthroughs - Episode 91 · April 2, 2026 · 20 min
- A DARPA Debrief - Episode 90 · March 5, 2026 · 35 min
- AIxCC: AI Cyber Challenge - Episode 89 · September 22, 2025 · 18 min
Explore listener stats, chart rankings, contacts and more on the Voices from DARPA podcast page.