A/B testing

Multiple comparisons calculator

Adjust p-values and confidence levels for multiple comparisons. FWER and FDR error control for online controlled experiments.

Try it now

Use all our tools for 30 days! No credit card required.

Adjust statistics for multiple comparisons

  • Useful when one of multiple A/B test metrics can lead to action
  • Family-Wise Error Rate control through the Šidak correction
  • False Discovery Rate via the Benjamini–Hochberg–Yekutieli correction
  • Supports p-values or confidence levels as input
A/B testing tools

Take your A/B testing to the next level

Experience the power and utility of our A/B testing hub and all tools during our 30-day free trial. No credit card required.

Start free trial

See what our clients have to say

We've been using the sequential calculator with about 90% of our clients for many years now. The team have found it hugely beneficial to follow such a rigorous statistical protocol, and they appreciate how the UI simplifies explaining results to clients.

Read full testimonial

Sim Lenz
Director of Experimentation at Conversion.com

At Cro Metrics, we've run tens of thousands of experiments for leading brands. Analytics Toolkit and the AGILE test calculator represent a step above and beyond every one of the other tools we've used.

Read full testimonial

Ryan Lucht
Director of Strategy, Cro Metrics