What does "Normal Distribution" mean?

Definition of Normal Distribution in the context of A/B testing (online controlled experiments).

What is a Normal Distribution?

Alias: gaussian distribution

The normal distribution (a.k.a. Gaussian distribution, Bell Curve) is a very common continuous probability distribution which is characterized by being symmetric about its mean and having a non-zero value over the entire real line. The mean, median and mode coincide.

The normal distribution is useful because of the Central Limit Theorem (CLT) which states that under finite variance that the arithmetic means of a sample of independent observations of a random variable converge in distribution to the normal, that is, they become normally distributed when the number of observations is large. This allows us to perform an A/B test with a non-binomial metric such as average revenue per user or average order value under the assumption that the standard error of the mean is normally distributed even if the underlying distribution of values is highly skewed.

Statistics such as the z score are derived from a standard normal distribution while a t score is drawn from a T-distribution which converges to normal asymptotically (it is practically equivalent to the normal with more then ~30 samples).

Like this glossary entry? For an in-depth and comprehensive reading on A/B testing stats, check out the book "Statistical Methods in Online A/B Testing" by the author of this glossary, Georgi Georgiev.

Articles on Normal Distribution

Normal Distribution Calculator & Definition
www.gigacalculator.com

Related A/B Testing terms

Distribution

About the author

Georgi Z. Georgiev

Georgi has over twenty years of experience in online marketing, web analytics, statistics, and design of business experiments.

Author of the book "Statistical Methods in Online A/B Testing", white papers on statistical analysis of A/B tests, and a speaker, he has been distinguished as a winner in the Data & Analytics category of the 2024 Experimentation Thought Leadership Awards.

Purchase Statistical Methods in Online A/B Testing

Statistical Methods in Online A/B Testing

Take your A/B testing program to the next level with the most comprehensive book on user testing statistics in e-commerce.

Learn more

Glossary index by letter

Select a letter to see all A/B testing terms starting with that letter or visit the Glossary homepage to see all.