In inferential statistics, a p-value (short for probability value) measures the strength of the evidence against the null hypothesis in a hypothesis test. The null hypothesis is the default assumption that there is no real difference, effect, or relationship between the groups you are testing. The p-value tells you the probability of obtaining test results at least as extreme as the ones you observed, assuming the null hypothesis is true. A lower p-value indicates stronger evidence that you should reject the default assumption and accept your discovery as real.
To make a decision, you compare the p-value to a pre-selected threshold known as the significance level (written as alpha, usually set to 0.05). If the p-value is less than or equal to 0.05, the result is statistically significant, meaning there is less than a 5% chance the observed differences occurred by random luck.
If the p-value is greater than 0.05, the result is not significant, and you fail to reject the null hypothesis. To find the input score for your test, check out our relative position z-scores tool. For compiling sample data averages beforehand, use our descriptive statistics solver. You can calculate general metrics with our measuring dataset variation tool.
Calculating a p-value requires selecting the correct distribution curve. A Z-test uses the standard normal bell curve. A T-test (used for small sample sizes) relies on a curve that adjusts based on "degrees of freedom," which represents the sample size minus 1.
As the degrees of freedom increase, the T-distribution curve converges toward the Z-distribution curve. Our online tool handles Z, T, Chi-Square, and F distributions automatically, providing one-tailed and two-tailed probability outputs.
One-tailed tests are used when your hypothesis predicts a specific direction of change (like checking if a drug is strictly better than a placebo). Two-tailed tests check for any change in either direction (strictly better or strictly worse). Because a two-tailed test covers both directions, its p-value is exactly twice that of a one-tailed test for the same statistic.
Suppose an e-commerce website tests a new checkout design. They calculate a Z-score of 2.10 from their visitor clicks dataset.
By inputting a Z-score of 2.10 into the p-value calculator, the tool finds a two-tailed p-value of approximately 0.0357. Since 0.0357 is less than the standard significance level of 0.05, the result is statistically significant. The website manager rejects the null hypothesis and concludes that the new checkout design did indeed cause the click increase, rather than it being a random fluke. This example illustrates how p-values guide business decisions.