Why are my A/B test results significant but the groups look uneven?

Variant B shows an eighteen percent lift in conversion rate.

The distortion lives in the assumption of valid randomization.

The chi-square test is the standard SRM detection method.

SRM correction is not a precise calculation — it produces a range, not a point estimate, because the nature of the bias depends on which user population ended up overrepresented.