Valid vs. Available: The Data Trap Most Orgs Fall Into
About this episode
The episode discusses the difference between valid and available data and the importance of triangulation in data analysis.
Most organizations are confident they have data. Loads of it. But in this episode of the Kirkpatrick Podcast, Vanessa sits down with psychometrician and data-analytics professor Dr. Anna Lissitz to ask the uncomfortable question: is it the right data — and is it telling you the truth? Anna, who wrote the triangulation chapter in Building a Culture of Evaluation, makes the case that a single metric — measured one way, at one moment, from one perspective — simply cannot tell the whole story. Worse, the data leaders feel most confident about is often the data that just confirms what they already believed. Together they unpack why completion rates and satisfaction scores feel safe but hide poor performance, what separates valid data from merely available data, and how triangulation turns shaky numbers into decisions you can stand behind. In this episode: • Why "we have lots of data" and "we have good data" are not the same thing • The difference between valid data and available data — and why it matters • How triangulation protects you from false confidence and confirmation bias • Why a low survey response rate is itself a finding, not a dead end • Where AI helps with evaluation —…
More episodes of The Kirkpatrick Podcast
- What the World Cup Taught Me About Return on Expectations
- Why the Kirkpatrick Model Isn't an L&D Tool — It's a Business Model with Jawad Ahmed
- AI Can't Read the Room: Myra Roldan on Why Human Judgment Still Wins
- Is it Really Survey Fatigue? Or Is It Survey-Action Fatigue. — Dr. Benjamin Granger
- Scaling Evaluation: From Pockets of Excellence to Enterprise Capability
- Is Your System Killing Your Evaluation Strategy?
Explore listener stats, chart rankings, contacts and more on the The Kirkpatrick Podcast podcast page.