← Back to Episodes
Why do experiment rollouts look better than reality?
Results look strong during rollout but don’t generalize.
S: At 78%, the experiment win rate is well above industry average.
C: The mechanism is audience filtering at the exposure stage.
I: The economic cost of selection bias accumulates in the gap between what the test predicted and what the rollout delivered.