Skip to content

Chapter 1 of 8

Descriptive Statistics: Summarizing Data

Statistics begins with the task of summarizing data, and the first step is choosing meaningful measures of central tendency. The mean, calculated as \(\bar{x} = \sum x_i / n\), captures the arithmetic average and is the most widely used summary, but it is sensitive to extreme values. The median, the middle value of sorted data (or the average of the two middle values when the count is even), is more robust to outliers and is therefore preferred when distributions are skewed. The mode identifies the most frequently occurring value, and a dataset may be unimodal, bimodal, or multimodal, or have no mode at all if no value repeats.

Beyond central tendency, we measure how spread out the data is. The range, equal to the maximum minus the minimum, is the simplest measure of dispersion, but it captures only the extremes and ignores how data is distributed between them. The variance \(\sigma^2 = \sum (x_i - \bar{x})^2 / n\) and its square root, the standard deviation \(\sigma\), capture the average deviation from the mean and are the most informative measures of spread. Standard deviation is expressed in the original units of the data, making it easier to interpret than variance, which is in squared units. When estimating population variance from a sample, dividing by \(n - 1\) instead of \(n\), a correction known as Bessel's correction, yields an unbiased estimate.

Quartiles offer a more nuanced view of spread by dividing sorted data into four equal parts: Q1 at the 25th percentile, Q2 at the median, and Q3 at the 75th percentile. The interquartile range, calculated as \(\text{IQR} = Q_3 - Q_1\), describes the spread of the middle 50% of the data and is robust to outliers. This property makes the IQR the basis for a common outlier detection rule: any value falling below \(Q_1 - 1.5 \times \text{IQR}\) or above \(Q_3 + 1.5 \times \text{IQR}\) is flagged as unusual, a method used in box plots. The shape of the distribution also matters: a distribution is skewed when it is asymmetric. In a right-skewed (positive) distribution the tail extends to the right and the mean exceeds the median, while in a left-skewed (negative) distribution the tail extends to the left and the mean is less than the median. Recognizing skewness guides whether the mean or median better represents the typical value.

All chapters
  1. 1Descriptive Statistics: Summarizing Data
  2. 2Foundations of Probability
  3. 3Random Variables and Probability Distributions
  4. 4Sampling Distributions and the Central Limit Theorem
  5. 5Confidence Intervals
  6. 6Hypothesis Testing
  7. 7Correlation, Regression, and Causal Inference
  8. 8Study Design and Sources of Bias

Drill it

Reading is not remembering. These come from the Statistics And Probability deck:

Q

What is the <b>mean</b> of a dataset?

The mean is the arithmetic average, calculated by summing all values and dividing by the number of values. Formula: x̄ = Σxᵢ / n. It is sensitive to outliers an...

Q

What is the <b>median</b> and when is it preferred over the mean?

The median is the middle value when data is sorted in order. For an even number of observations, it is the average of the two middle values. It is preferred ove...

Q

What is the <b>mode</b> of a dataset?

The mode is the value that appears most frequently in a dataset. A dataset can be unimodal (one mode), bimodal (two modes), or multimodal (more than two modes)....

Q

What is <b>standard deviation</b> and what does it measure?

Standard deviation measures the average amount of dispersion or spread in a dataset relative to the mean. A low standard deviation indicates data points are clo...