Google Machine Learning Glossary — Flashcards

A statistical way of comparing two (or more) techniques - typically an incumbent against a new rival. A/B testing aims to determine not only which technique performs better but also to understand whether the difference is statistically significant. A/B testing usually considers only two techniques using one measurement - but it can be applied to any finite number of techniques and measures.