Okuzeka
Product Management vocabulary · Experiments & A/B Testing

A/B test

Meaning in product management, with examples

nounCore term

In product management, A/B test means: An experiment in which users are randomly split into groups that see different versions of a page or feature, so the team can measure which version performs better.

In Turkish: A/B testi, ayrık test

How it is used

Version A is usually the current one (the control) and version B the change (the variant). Teams run, set up and analyze A/B tests, and wait until the result is statistically significant before deciding. Also called a split test.

Example sentences

  1. We're running an A/B test on the pricing page: one version shows monthly prices, the other yearly prices.

  2. The A/B test needs another week to reach enough users.

Common collocations

  • run an A/B test
  • A/B test results
  • set up an A/B test
  • A/B testing tool
  • hypothesisA clear, testable statement of what the team believes will happen if it makes a change, and how it will know whether it was right.
  • control groupIn an experiment, the group of users who see the current, unchanged version, so their results can be compared with the group that sees the change.
  • variantIn an A/B test, a changed version of a page or feature that is shown to some users and compared with the current version.
  • statistical significanceA sign that a difference between test groups is probably real and not just the result of random chance, judged against an agreed threshold.
  • guardrail metricA metric a team watches during an experiment or launch to make sure the change does not harm something important, such as speed, revenue or complaints.

This word in other fields

The same English word can have a different meaning in another field:

More terms: Experiments & A/B Testing

Practise with graded reading

Reading at the right level is the fastest way to make new words stick. Pick free English books by level: