Going All In: Using AI to Build Better Assessments

Going All In: Using AI to Build Better Assessments

From Psych Tech @ Work by Charles Handler

April 27, 2026 · 48 min

About this episode

The episode discusses the use of AI in creating and validating assessments with insights from Taylor Sullivan of Workera.

“By the time you dot the final I’s and cross the final T’s, the assessment is already out of date.” — Taylor Sullivan Episode Overview In this episode I’m joined by rising I/O rockstar Taylor Sullivan , IO psychologist and the architect of Workera’s assessment strategy. With Taylor’s guidance Workera, a verified skills intelligence platform, is doing something most of the industry is still afraid to do: going all in on using AI to build, deliver, and validate AI-based assessments. Taylor and I (and my AI co-host Mayda Tokens) dig into how this actually works, why it’s scientifically defensible, and why the industry needs to stop waiting and start moving. Topics Discussed & Key Insights 1. Traditional Assessment Development Is Already Broken By the time a traditional assessment clears all the I-dotting and T-crossing, it’s often already out of date. AI changes that — enabling dynamic content generation, richer construct understanding, and real-time iteration that keeps pace with how work actually evolves. 2. Codifying Measurement Science Into a Multi-Agent System Workera didn’t just bolt AI onto existing processes. They embedded IO psychology’s core principles — evidence-centered…

People in this episode

Host: Charles Handler

Guest: Taylor Sullivan

Topics covered

  • AI in assessments
  • I/O psychology
  • dynamic content generation
  • validity frameworks
  • evidence-centered design

Keywords

  • AI assessments
  • I/O psychology
  • dynamic content
  • real-time iteration
  • measurement science

Mentioned in this episode

Organizations: Workera

More episodes of Psych Tech @ Work

Explore listener stats, chart rankings, contacts and more on the Psych Tech @ Work podcast page.