AI Evaluation Methods

AI Evaluation Methods

From The FIT4Privacy Podcast | Exploring ISO Standards AI Privacy | Grow Skills Store by Punit Bhatia | Data Privacy, Sourcing & EU AI Act Specialist | ISO Standards

May 28, 2026 · 7 min · Season 7 · Episode 166

About this episode

The episode discusses how to evaluate AI systems for trustworthiness and compliance with insights from AI evaluation expert Stella Liu.

How do you know if an AI system is trustworthy, compliant, ethical, and fit for purpose ? In this episode of the FIT4Privacy Podcast, Punit Bhatia is joined by Stella Liu, an AI evaluation expert and founder of AI Evals & Analytics, to unpack one of the most practical—anud overlooked—challenges in AI today: how to evaluate AI systems before and after deployment. KEY MOMENTS 02:09 —AI Definition 03:02 —AI Evaluations 10:31 — Why AI Testing Is Hard 14:06 — Evals Plus Analytics 18:15 —Synthetic Data 23:47 —Protecting Privacy Ethical 29:05 — AI Evals as a Company 29:52 —How to reach Stella Liu Stella explains why AI behaves differently from traditional software, why testing code alone is no longer enough, and how AI evaluations (AI evals) help organizations assess real‑world behavior, risk, and performance. From evaluation‑driven development to continuous monitoring in production, the conversation explores how teams can move beyond guesswork and hype toward repeatable, measurable AI governance. ⸻ ABOUT THE GUEST Stella Liu is the Co-founder of AI Evals & Analytics (Maven), where she created the AI Evals & Analytics Playbook and teaches top-rated courses on LLM evaluation…

People in this episode

Host: Punit Bhatia

Guest: Stella Liu

Topics covered

  • AI evaluation
  • trustworthy AI
  • AI compliance
  • ethical AI
  • AI governance

Keywords

  • AI evaluation
  • trustworthy AI
  • ethical AI
  • AI governance
  • AI testing

Mentioned in this episode

Organizations: AI Evals & Analytics, ASU, Shopify, Carvana

More episodes of The FIT4Privacy Podcast | Exploring ISO Standards AI Privacy | Grow Skills Store

Explore listener stats, chart rankings, contacts and more on the The FIT4Privacy Podcast | Exploring ISO Standards AI Privacy | Grow Skills Store podcast page.