What does "Z-test" mean?
Definition of Z-test in the context of A/B testing (online controlled experiments).
What is a Z-test?
A Z-Test is a statistical test which is based on the assumption of normal distribution of the parameter of interest and results in a z Score. Many classic statistical tests operate under this assumption and produce results from the standard normal Z distribution.
A Z-Test can be performed when the population standard deviation (Σ) is known, or when the sample size is large enough so that the Central Limit Theorem can be applied. This is most often the case in A/B testing where the typical key performance indicator is an average (mean) and the sample size is usually in the thousands. The CLT and thus a Z distribution can generally be applied for sample sizes above 30 with minimal loss of accuracy versus the more robust T distribution (see T-test).
Like this glossary entry? For an in-depth and comprehensive reading on A/B testing stats, check out the book "Statistical Methods in Online A/B Testing" by the author of this glossary, Georgi Georgiev.
Related A/B Testing terms
StatisticT-testChi Squared TestNormal DistributionHypothesis TestingNull Hypothesis Statistical TestSee this in action
Statistical Significance Calculator
Statistical Methods in Online A/B Testing
Take your A/B testing program to the next level with the most comprehensive book on user testing statistics in e-commerce.
Learn moreGlossary index by letter
Select a letter to see all A/B testing terms starting with that letter or visit the Glossary homepage to see all.