What does "Non-Inferiority Margin" mean?

Definition of Non-Inferiority Margin in the context of A/B testing (online controlled experiments).

What is a Non-Inferiority Margin?

A non-inferiority margin is such a difference m that we would be happy implementing a tested treatment if we are to be able to rule out outcomes below -m (negative and smaller in magnitude than m) with our desired significance threshold.

The non-inferiority margin should not be chosen lightly: it should be informed by as objective criteria as possible and it should be communicated to all stakeholders before the A/B test begins.

Related A/B Testing terms

Non-Inferiority Test

Articles on Non-Inferiority Margin


Glossary Index by Letter

ABCDEFGHIKLMNOPRSTUVZ

Select a letter to see all A/B testing terms starting with that letter or visit the Glossary homepage to see all.