Exploring Velocity vs. Quality in Experimentation ft. Emma Travis

About this episode

The episode discusses the balance between velocity and quality in experimentation programs with guest Emma Travis.

We back out here with the amazing Emma Travis to dig into 'quality vs. quantity' when it comes to experimentation programs. The conversation Ben Labay keeps trying to force, but a bit more nuance to it. There is a time and place for quality. But there is a time and place for velocity and scaling your program up in terms of number of tests run. How do you know when to do it? And what are triggers to get you .... ahem.... From A to B. Emma "Biscuits and Gravy" Travis joined me on this episode to go DEEP into this topic. Emma was sick and still trooped through this episode - give her all the flowers!!! We got into: - When to focus on velocity vs. when to focus on ‘quality’ of experiment - Tips on auditing your program to know if you’re too focused on quality vs. quantity - Smart ways to focus on research when resources are limited Timestamps: 00:00 Episode Start 3:57 Is Velocity Appropriate In Tracking Metric For Experimentation Maturity? 9:23 Velocity Increase Doesn't Always Mean A Decline In Quality 11:51 Experimentation Velocity Is Like Flying A Plane 19:19 When To Scale Velocity Vs. When To Focus On Quality 24:33 Run A Heuristic Audit Of Your Cro Program (*Bonus Points…

People in this episode

Host: Shiva Manjunath

Guest: Emma Travis

Topics covered

• experimentation
• quality vs. quantity
• velocity
• program auditing
• research strategies

Keywords

• experimentation
• quality
• velocity
• program auditing
• research
• Emma Travis
• business

More episodes of From A to B

• Ethics of Fake Door Testing ft. Jon Crowder · June 3, 2026 · 41 min
• How LLMs Change Your Website Strategy ft. Juliana Jackson · May 13, 2026 · 41 min
• Building Testing Culture Beyond A/B Testing ft. Jenni Bruckman · April 15, 2026 · 38 min
• Testing Tools: Build? Or Buy? ft. Jonas Alves · March 18, 2026 · 40 min
• Where Are The Ethics In Experimentation?! ft. AJ Long · February 11, 2026 · 36 min
• How to Remove Emotion from Data Analysis ft. Gerda Thomas · January 14, 2026 · 42 min