How is A/B test sample size calculated?
This tool uses the standard two-proportion formula based on your baseline conversion rate, the minimum detectable effect, your chosen confidence level, and statistical power to estimate the visitors needed per variant.
What is a minimum detectable effect?
The minimum detectable effect is the smallest relative change in conversion rate you want the test to be able to detect reliably. Smaller effects require larger samples.
Why does my test need so many visitors?
Lower baseline rates, smaller effects, higher confidence, and higher power all increase the sample size required to avoid false positives and false negatives.