Beyond the core toolkit, several specialized areas round out statistical practice. A time series is a sequence of observations recorded over time; such data exhibit autocorrelation (correlation with a lagged version of themselves) and may or may not be stationary (having constant mean and variance over time). A moving average smooths a series by averaging values within a sliding window, and ARIMA models combine autoregressive and moving-average components with differencing to capture a wide range of temporal patterns. Experimental design emphasizes the difference between observational studies, in which researchers merely record what they see, and experimental studies, in which they actively manipulate variables. Random assignment of subjects to conditions balances unmeasured confounders across groups and is what enables causal inference; placebos and double-blind procedures, in which neither participants nor researchers know who receives which treatment, control for psychological effects. Control groups provide a baseline against which treatment groups are compared, and designs may be within-subjects (every subject experiences all conditions) or between-subjects (different subjects receive different conditions).
Probability itself admits two interpretations. The frequentist view treats probability as the long-run frequency of an event in repeated trials, with confidence intervals interpreted as long-run coverage rates. The Bayesian view treats probability as a degree of belief, updated through evidence; here, a credible interval directly expresses the probability that the parameter lies in a given range, and conjugate priors — priors chosen so that the posterior belongs to the same family — make computation especially clean. Two resampling-based methods complement parametric inference: bootstrapping estimates sampling distributions by drawing samples with replacement from the observed data, while permutation tests build a null distribution by shuffling labels. When synthesizing evidence across many studies, meta-analysis combines effect estimates and their confidence intervals (often displayed in a forest plot) and uses funnel plots to detect publication bias.
A surprising number of pitfalls arise from human judgment rather than mathematics. Regression to the mean describes the tendency for extreme observations to be closer to the mean on subsequent measurements. Simpson's paradox occurs when a trend visible in aggregated data reverses once subgroups are considered. The gambler's fallacy and the hot-hand fallacy both reflect mistaken beliefs that past random outcomes influence future independent trials. The base rate fallacy arises when people ignore background frequencies in favor of case-specific information, and survivorship bias results from focusing only on entities that "survived" a selection process. In research, publication bias and p-hacking (manipulating analyses until results become significant) distort the published literature, while HARKing — Hypothesizing After Results are Known — presents post-hoc findings as if they were planned. Multiple testing inflates the Type I error rate, but corrections such as the Bonferroni adjustment (dividing \(\alpha\) by the number of tests) and false discovery rate methods like Benjamini-Hochberg control this problem. Finally, statistical learning blends statistics with machine learning, distinguishing supervised learning (fitting models from labeled input-output pairs) from unsupervised learning (finding structure such as clusters in unlabeled data). Techniques such as principal component analysis reduce dimensionality by identifying orthogonal directions of maximum variance, while k-means clustering partitions data into k groups by minimizing within-cluster variance, providing a glimpse into the broader world of data-driven discovery that statistics now supports.