Dissertation Statistics Help

P-value calculator

Statistical software gives you a test statistic; a printed table only gives you a range. This converts t, z, F, or chi-square into the exact probability.

A p-value is the probability of obtaining a result at least as extreme as the one observed, assuming the null hypothesis is true; the smaller it is, the stronger the evidence against that hypothesis. This calculator converts a t, z, F, or chi-square statistic into its exact one- and two-tailed p-value by evaluating the correct sampling distribution, so you are not stuck reading a critical value between two rows of a textbook table.

Two-tailed p value

.0208

t(28) = 2.45 is significant at the .05 level.

Two-tailed p.0208
One-tailed p.0104
Test statistict = 2.450
Degrees of freedom28

How the p-value is computed

A p-value is a tail area under the test statistic's distribution. For a two-tailed t or z test it is twice the area beyond the absolute value of the statistic:

p = 2 × P(T > |t|)

The F and chi-square statistics are one-sided by construction, so their p-value is the single upper-tail area, P(F > f) or P(χ² > x). The calculator obtains each area from the cumulative distribution function of the relevant family, using the regularised incomplete beta function for t and F and the regularised incomplete gamma function for chi-square. These are the same routines statistical packages call, so the values match the p-values in SPSS, R, and Stata output to the displayed precision.

What the p-value means and the 0.05 significance threshold

A p-value measures how surprising your data would be if the null hypothesis were true. A small value says the observed result would rarely occur by chance alone under that assumption, which counts as evidence against the null. It does not give the probability that the null is true, nor the probability that your finding is real; both are frequent misreadings. The p-value speaks only to the data given the hypothesis, never the other way round, and it says nothing on its own about how large or important the effect is.

The 0.05 significance threshold is a convention, not a natural boundary. Calling p below 0.05 significant simply means you have agreed to risk a 5% false-positive rate when the null is in fact true. A result at 0.049 is not meaningfully different from one at 0.051, so treat the cut-off as a guide rather than a verdict. Set the threshold, often written as alpha, before you collect data, and read a borderline value alongside the effect size and the study design. For the fuller picture of what the number can and cannot tell you, see what a p-value is and what it is not.

One-tailed vs two-tailed p-values

A two-tailed p-value tests for a difference in either direction, counting extreme results in both tails of the sampling distribution. A one-tailed p-value looks only one way, asking whether the effect runs in a single pre-specified direction, and for a symmetric distribution it is exactly half the two-tailed value. That halving is tempting, because it makes a result easier to call significant, which is precisely why the choice has to be principled rather than convenient.

Use a two-tailed test as the default. It is the more conservative option and the one reviewers expect unless you have a strong directional hypothesis stated before seeing the data and you genuinely have no interest in an effect in the opposite direction. Switching to one-tailed after the analysis to push a finding under 0.05 is a recognised form of p-hacking. Decide the tails when you choose the test, a decision that belongs with the rest of your design and is worth settling using the decision guide for statistical tests.

How sample size affects the p-value

The same effect produces a smaller p-value in a larger sample. As the number of observations grows, the standard error shrinks, the test statistic gets bigger, and the tail area falls. This is why a trivial difference can become statistically significant once the sample is large enough, and why a real difference can stay non-significant in a study that is simply too small. Significance is therefore as much a statement about your sample size as about the phenomenon itself.

Two practical consequences follow. First, never treat a non-significant result as proof of no effect; it may only reflect low statistical power. Plan the sample in advance so the test can detect an effect worth finding, which is the job of a prospective power analysis. Second, in a very large study, report the effect size and its interval so readers can see whether a significant result is also a meaningful one, rather than letting the small p-value carry the whole conclusion.

Why a p-value is not an effect size

A p-value tells you whether an effect is detectable; an effect size tells you how big it is. They answer different questions, and a small p-value does not imply a large effect. Because significance depends on sample size, a tiny, practically meaningless difference can return p below 0.001 in a big enough study, while a substantial effect can miss significance in a small one. Reporting only the p-value leaves the reader unable to judge whether the finding matters in the real world.

That is why current reporting standards expect an effect size beside every significance test, often with a confidence interval around it. Quote the magnitude in interpretable terms, a standardised Cohen's d, a correlation, or a difference in the original units, and read it against what is typical in your field. Pairing the two stops you from overselling a significant but trivial result or dismissing a meaningful one that fell just short, a balance set out in effect sizes explained.

Reporting exact p-values in APA style

APA style asks for the exact p-value to two or three decimal places rather than a vague p < .05, because the precise figure lets readers judge the strength of evidence for themselves. Drop the leading zero, since a p-value cannot exceed one, and write values such as p = .03 or p = .278. The one exception is a value too small to print meaningfully, which is reported as p < .001 by convention rather than padded with leading zeros.

Place the p-value in the same sentence as the test statistic, its degrees of freedom, and the effect size, so the full result reads as one unit. For example, the test statistic, then the exact p-value, then the standardised effect. Keeping that order consistent across the chapter makes the results easy to scan and hard to fault. The complete set of spacing, italics, and decimal rules lives in our APA style guide for statistics, and the APA results formatter assembles the sentence for you.

Frequently asked questions

What does a p-value of 0.05 mean?

A p-value of 0.05 means there is a 5% probability of obtaining a result at least as extreme as the one observed if the null hypothesis were true. It is the conventional threshold for calling a result statistically significant, but the cut-off is a convention, not a law of nature. A p-value just below or just above 0.05 should be read in the context of the effect size and the study design, not treated as a hard pass or fail.

What is the difference between a one-tailed and a two-tailed p-value?

A two-tailed p-value tests for a difference in either direction and counts extreme results in both tails of the distribution, while a one-tailed p-value tests for a difference in one specified direction only. The one-tailed value is half the two-tailed value for a symmetric distribution. Use a two-tailed test unless you have a strong directional hypothesis stated before seeing the data, because two-tailed is the more conservative and more widely expected default.

How do you find a p-value from a test statistic?

You locate the test statistic on its sampling distribution and read off the tail area beyond it, which is the p-value. The distribution depends on the test: a t statistic uses the t distribution with its degrees of freedom, a z uses the standard normal, an F uses the F distribution with two degrees of freedom, and a chi-square uses the chi-square distribution. This calculator evaluates the exact distribution rather than interpolating from a printed table.

Can a p-value be exactly zero?

No, a p-value can be extremely small but never exactly zero, because there is always some non-zero probability of an extreme result under the null hypothesis. Software often displays very small values as p less than .001 rather than printing many leading zeros, and reporting guidelines such as APA recommend writing p < .001 in that case. A reported p of 0 is a rounding artefact, not a true probability.