The Future of Empirical Research in the Age of AI
About this episode
The episode discusses the findings of a paper on the accuracy of AI in replicating political science research.
In this episode, we sit down with Stanford political scientist Andy Hall and PhD candidate Graham Straus to unpack their new paper, “How Accurately Did Claude Code Replicate and Extend a Published Political Science Paper?” — an empirical audit of what happens when an AI agent is asked to replicate and extend a real research project. Last January, Andy asked Claude Code to generate an extension of an existing empirical political science paper in under an hour. The results were surprising: Claude correctly replicated the original estimates exactly and collected new data with very high accuracy. But did Claude make mistakes? Straus independently audited Claude’s work to see how accurate, reliable, and scientifically sound it really was.
More episodes of Not Another Politics Podcast
- Is the Median Justice Running the Supreme Court?
- Why Does America Pay More For Infrastructure?
- What Binary Questions Get Wrong About Voters
- Do Dishonest People Self-Select Into Public Service?
- Are Primary Elections Responsible for Polarization in Congress?
- What Do Politicians Think Motivates Voters?
Explore listener stats, chart rankings, contacts and more on the Not Another Politics Podcast podcast page.