About This Chapter

A/B tests (aka Split tests) are the most used decision making tool for all product managers. You don’t need advanced knowledge of statistics in order to correctly set up a test (your analytics team does), but you do need to understand some important best practices. 

Running A/B tests for an indefinite amount of time, not including a counter-metric in the test, and accidentally P-hacking your own results are examples of common mistakes that product managers make when dealing with A/B tests.

This chapter of the course gets you to avoid these most common mistakes so you can trust your test results. 

Preview Lesson

Chapter Contents

    1. 1. Split tests

    2. 2. Counter-metrics

    3. 3. Best practices

    4. 4. Statistical significance

    5. 5. Don't run tests "until significance"

    6. 6. P-Hacking

    7. Takeaways and Key Lessons- Experiment Design

    8. Exercises - Experiment Design

    9. Exercise Solutions - Experiment design

About this course

  • 9 lessons
  • 0.5 hours of video content

Should I Complete The Chapters In Order?

That's what we recommend. We feel like you'll get the most value that way and you'll learn them easier because there are occasional references to other chapters. However, each chapter has tons of standalone value as well and you will certainly benefit from taking it on its own.

The first chapter of this course is included for free with any signup so you can try the course before choosing to purchase. You can enroll in just that chapter here.

Course Access + Certification

Get access to all course contents as well as a final project which will unlock your Product Analytics Expert certificate.

Course Access

Get access to all course content, including exercises and exercise solutions.

The only product analytics course you'll need.