What does "Identically Distributed" mean?

Definition of Identically Distributed in the context of A/B testing (online controlled experiments).

What is Identically Distributed?

Aliases: ID

Two variables (X,Y) are identically distributed (ID) if they have the same probability distribution. A sufficient condition for this is that CDF(X)=CDF(Y) where CDF stands for Cumulative Distribution Function. A textbook way of describing this would be to write P(x ≤ X) = P(y ≤ Y).

The necessity for variables to be identically distributed plays a significant role in a classical Null Hypothesis Statistical Test where the full definition of the null hypothesis states, among other things that the two variables are identically distributed.

An immediate consequence of the requirement for identical distributions is that data analyzed under the assumption of ID should have constant mean and variance. If the data has a trend this assumptions is violated and a statistical model with the ID assumption in it becomes misspecified.

Related A/B Testing terms

Independent Variable


Glossary Index by Letter

ABCDEFGHIKLMNOPRSTUVZ

Select a letter to see all A/B testing terms starting with that letter or visit the Glossary homepage to see all.