About This Course

A/B tests (aka Split tests) are the most used decision making tool for all product managers. You don’t need advanced knowledge of statistics in order to correctly set up a test (your analytics team does), but you do need to understand some important best practices. 

Running A/B tests for an indefinite amount of time, not including a counter-metric in the test, and accidentally P-hacking your own results are examples of common mistakes that product managers make when dealing with A/B tests.

This course gets you to avoid these most common mistakes so you can trust your test results. 


Preview Lesson


Course Contents

    1. 1. Split tests

    2. 2. Counter-metrics

    3. 4. Statistical significance

    4. 3. Best practices

    5. 5. Don't run tests "until significance"

    6. 6. P-Hacking

    7. Takeaways and Key Lessons- Experiment Design

    8. Exercises - Experiment Design

    9. Exercise Solutions - Experiment design

    10. Penny for your thoughts

About this course

  • 10 lessons
  • 0.5 hours of video content

Should I Complete The Courses In Order?

That's what we recommend. We feel like you'll get the most value that way and you'll learn them easier because there are occasional references to other courses. However, each course has tons of standalone value as well and you will certainly benefit from taking it on its own.