Statistical significance

How it is used

Used in A/B test reports and research. A result reaches or fails to reach statistical significance; the adjective 'statistically significant' is even more common. Analysts remind stakeholders that significant does not automatically mean large or important.

Example sentences

1. The new layout increased clicks, but the difference didn't reach statistical significance.

2. We'll wait until the test reaches its planned sample size before checking statistical significance.

Common collocations

• reach statistical significance
• statistically significant result
• test for statistical significance
• level of significance

Related terms

• p-valueThe probability of seeing a result at least as extreme as the one observed if there were really no effect, that is, if the null hypothesis were true.
• A/B testAn experiment in which users are randomly split into two groups that see different versions of something, so you can measure which version performs better.
• null hypothesisThe default assumption in a statistical test that there is no effect or no difference, for example that a new design does not change the conversion rate.
• confidence intervalA range of values, calculated from sample data, that is likely to contain the true value; a 95% interval comes from a method that captures the true value 95% of the time.

This word in other fields

The same English word can have a different meaning in another field:

• statistical significance · Data Science & Analytics
• statistical significance · Product Management
• statistical significance · Psychology
• statistical significance · Statistics

More terms: Machine Learning and Data Processing

• artificial intelligence
• machine learning
• model
• dataset
• training data
• label
• train
• supervised learning
• neural network
• deep learning
• loss function
• overfitting