A/B testing

Multiple comparisons calculator

Adjust p-values and confidence levels for multiple comparisons. FWER and FDR error control for online controlled experiments.

Try it now

Use all our tools for 14 days! No credit card required.

Adjust statistics for multiple comparisons

  • Useful when one of multiple A/B test metrics can lead to action
  • Family-Wise Error Rate control through the Šidak correction
  • False Discovery Rate via the Benjamini–Hochberg–Yekutieli correction
  • Supports p-values or confidence levels as input
A/B testing tools

Take your A/B testing to the next level

Experience the power and utility of our A/B testing hub and all tools during our 14-day free trial. No credit card required.

Start free trial

See what our clients have to say

A tool with real value if you know how to use it. Might seem intimidating at the beginning, but it tries to provide flexibility, accuracy and optimization in your statistical analysis instead of over-simplification.

Read full testimonial

Arnau Vendrell
Co-Founder, iSocialWeb Marketing

At Cro Metrics, we've run tens of thousands of experiments for leading brands. Analytics Toolkit and the AGILE test calculator represent a step above and beyond every one of the other tools we've used.

Read full testimonial

Ryan Lucht
Director of Strategy, Cro Metrics