Before drawing conclusions from data, we must understand how sample statistics behave across many possible samples. A sampling distribution is the probability distribution of a statistic, such as the sample mean, computed from all possible samples of a given size drawn from a population. Even though any individual sample varies, the sampling distribution reveals the regular pattern of that variation and is central to statistical inference. It describes how the statistic fluctuates from sample to sample and forms the bridge between descriptive sample results and claims about populations.
The Central Limit Theorem (CLT) describes this pattern for the sample mean. Regardless of the shape of the population from which we sample, the sampling distribution of \(\bar{x}\) approaches a normal distribution with mean \(\mu\) and standard error \(\sigma / \sqrt{n}\) as the sample size grows. Typically, \(n \geq 30\) is sufficient, even for heavily skewed populations, though convergence is faster for symmetric populations. The CLT also applies to sample proportions: \(\hat{p} \sim N\!\left(p, \sqrt{p(1 - p) / n}\right)\) when \(np \geq 10\) and \(n(1 - p) \geq 10\), which makes normal approximation methods available for proportions as well.
The standard error \(SE = \sigma / \sqrt{n}\) quantifies how much the sample mean varies across samples and is derived directly from the CLT. As n increases, the standard error decreases: quadrupling the sample size, for example, halves the standard error. Larger samples therefore produce sampling distributions that are more tightly clustered around the population mean and more closely approximate a normal distribution. The CLT is foundational because it justifies using normal-based methods, including z-tests, t-approximations, and confidence intervals, even when the underlying population is not normally distributed. This is why most parametric statistical procedures rely on a large sample size rather than on the assumption of normality itself.