Okuzeka
Data Science & Analytics vocabulary · A/B Testing and Experimentation

A/B test

Meaning in data science & analytics, with examples

nounCore term

In data science & analytics, A/B test means: An experiment in which users are randomly split into two groups that see different versions of something, so you can measure which version performs better.

In Turkish: A/B testi, bölünmüş test

How it is used

Said 'A-B test'. You run, launch, set up and analyse an A/B test, and it also works as a verb: 'we A/B tested the new checkout'. Version A is usually the current one (the control) and B the new one. Very common in product, marketing and growth teams.

Example sentences

  1. We ran an A/B test on the sign-up button, and the green version won.

  2. Let's not launch the redesign to everyone yet; let's A/B test it for two weeks first.

Common collocations

  • run an A/B test
  • A/B test results
  • set up an A/B test
  • A/B testing platform
  • control groupThe group in an experiment that does not get the change being tested, so its results show what would have happened without that change.
  • variantOne of the versions shown to users in an experiment, usually the new version that is compared with the control.
  • statistical significanceA sign that a result is unlikely to be explained by random chance alone, usually judged by whether the p-value falls below a threshold chosen in advance, such as 0.05.
  • hypothesisA specific, testable statement about what you expect to happen and why, written down before an experiment or analysis starts.
  • sample sizeThe number of observations, people or units included in a sample or an experiment; larger samples usually give more reliable estimates.

This word in other fields

The same English word can have a different meaning in another field:

More terms: A/B Testing and Experimentation

Practise with graded reading

Reading at the right level is the fastest way to make new words stick. Pick free English books by level: