How To Conduct A/B Testing In Machine Learning?

‍What is A/B Testing?

A/B test example | Image by Author

‍Why is A/B testing important?

Benefits of A/B testing:

‍What is A/B Testing in Machine Learning?

Performing A/B test

Idea/Definition

Subject

Randomization

In the graphic above, we split the subjects into two groups | Image by Author

Results

‍Hypothesis Testing

A/B test observed results | Image by author
Hypothesis Observation | Image by author

Validity Checks

Action/Decision

‍When to do the A/B Test in ML?

Common A/B Testing Mistakes You Should Avoid

Conclusion

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store