What does "Non-Inferiority Margin" mean?
Definition of Non-Inferiority Margin in the context of A/B testing (online controlled experiments).
What is a Non-Inferiority Margin?
A non-inferiority margin is such a difference m that we would be happy implementing a tested treatment if we are to be able to rule out outcomes below -m (negative and smaller in magnitude than m) with our desired significance threshold.
The non-inferiority margin should not be chosen lightly: it should be informed by as objective criteria as possible and it should be communicated to all stakeholders before the A/B test begins.
Like this glossary entry? For an in-depth and comprehensive reading on A/B testing stats, check out the book "Statistical Methods in Online A/B Testing" by the author of this glossary, Georgi Georgiev.
Articles on Non-Inferiority Margin
The Case for Non-Inferiority A/B Tests
blog.analytics-toolkit.com
Related A/B Testing terms
Non-Inferiority TestSee this in action
A/B Testing Calculator
Statistical Significance Calculator
Sample Size Calculator
Statistical Methods in Online A/B Testing
Take your A/B testing program to the next level with the most comprehensive book on user testing statistics in e-commerce.
Learn moreGlossary index by letter
Select a letter to see all A/B testing terms starting with that letter or visit the Glossary homepage to see all.