How to Design Better Experiments with Expected Information Gain

About this episode

Adam Foster discusses Expected Information Gain and its role in optimal Bayesian experimental design.

Today's clip is from Episode 156 featuring Adam Foster. In this conversation, Adam explains Expected Information Gain (EIG) -the scoring function at the heart of optimal Bayesian experimental design. The core idea: when designing an experiment, you need a way to compare possible designs and pick the best one. EIG is that score - it tells you how much information you expect to gain about your model parameters from a given design. The higher the EIG, the better the design. Adam builds intuition for EIG from two directions that sound completely different but lead to the same place. First, the Bayesian angle: simulate datasets from your prior predictive distribution, run inference on each, measure how much uncertainty dropped, and average across datasets. Second, a classic puzzle - the 12 prisoners balance scale problem - where the best weighing strategy turns out to be the one that makes all three outcomes (tip left, tip right, balance) equally likely. This maximizes outcome entropy, which is exactly what EIG does: it steers you toward designs where every possible result narrows down your hypotheses as fast as possible. The takeaway: good experimental design isn't about intuition or…

People in this episode

Host: Alexandre Andorra

Guest: Adam Foster

Topics covered

• Bayesian experimental design
• Expected Information Gain
• uncertainty reduction
• data-driven decision making
• optimal design strategies

Keywords

• Expected Information Gain
• Bayesian statistics
• experimental design
• uncertainty
• data analysis

Mentioned in this episode

Books & works: Good Bayesian

More episodes of Learning Bayesian Statistics

• Exact GPs vs Approximations: When to Use Each (and Why It Matters) · June 10, 2026 · 4 min
• #159 Bayesian Occupancy Models, with Matthijs Hollanders · June 8, 2026 · 1h 26m
• Can AI Learn What Experts Know? Automating Prior Elicitation with Generative Models · June 2, 2026 · 5 min
• #158 Bayesian Workflows & Foundation Models, with Stefan Radev · May 21, 2026 · 1h 19m
• The Hidden Geometry of Hierarchical Models · May 13, 2026 · 4 min
• #157 Amortized Inference & BayesFlow in Practice, with Stefan Radev · May 6, 2026 · 1h 19m