Skip to content

Chapter 2 of 8

Foundations of Probability

Probability provides the mathematical framework for reasoning about uncertainty. Every probability problem starts with a sample space, the set of all possible outcomes, and events, which are subsets of that space. The complement of an event A, denoted A' or A^c, contains all outcomes not in A, and the complement rule \(P(A') = 1 - P(A)\) is particularly useful when it is easier to compute the probability of "none" rather than "at least one." For combining probabilities, the addition rule governs unions: \(P(A \cup B) = P(A) + P(B) - P(A \cap B)\), where the intersection term is subtracted to avoid double-counting outcomes that belong to both events.

When two events are mutually exclusive (disjoint), they cannot occur simultaneously, so \(P(A \cap B) = 0\) and the addition rule simplifies to \(P(A \cup B) = P(A) + P(B)\). The multiplication rule governs intersections: \(P(A \cap B) = P(A) \times P(B \mid A)\). If A and B are independent, then \(P(B \mid A) = P(B)\) and the rule reduces to \(P(A \cap B) = P(A) \times P(B)\). Note that mutually exclusive events are generally not independent (except when one has probability zero). Conditional probability, \(P(A \mid B) = P(A \cap B) / P(B)\) with \(P(B) > 0\), updates the probability of an event based on new information.

Bayes' theorem, \(P(A \mid B) = P(B \mid A) \times P(A) / P(B)\), links the posterior probability \(P(A \mid B)\) to the prior \(P(A)\), the likelihood \(P(B \mid A)\), and the marginal probability \(P(B)\). When \(P(B)\) is not directly known, the law of total probability expands the denominator, giving \(P(A \mid B) = P(B \mid A) P(A) / [P(B \mid A) P(A) + P(B \mid A') P(A')]\). A useful alternative formulation expresses results through the likelihood ratio \(P(B \mid A) / P(B \mid A')\), where posterior odds equal prior odds multiplied by the likelihood ratio.

Bayes' theorem corrects the base rate fallacy, the tendency to ignore prior probabilities. For example, with disease prevalence \(P(D) = 0.01\), sensitivity \(P(+ \mid D) = 0.95\), and false positive rate \(P(+ \mid D') = 0.05\), the probability of disease after a positive test is \(P(D \mid +) = (0.95 \times 0.01) / (0.95 \times 0.01 + 0.05 \times 0.99) \approx 0.16\). Even an accurate test applied to a low-prevalence population can leave the probability of disease surprisingly low after a positive result. Finally, when counting outcomes, permutations \(P(n, r) = n! / (n - r)!\) count arrangements where order matters, while combinations \(C(n, r) = n! / [r! (n - r)!]\) count selections where order does not: choosing a president and vice president is a permutation, while choosing a committee is a combination.

All chapters
  1. 1Descriptive Statistics: Summarizing Data
  2. 2Foundations of Probability
  3. 3Random Variables and Probability Distributions
  4. 4Sampling Distributions and the Central Limit Theorem
  5. 5Confidence Intervals
  6. 6Hypothesis Testing
  7. 7Correlation, Regression, and Causal Inference
  8. 8Study Design and Sources of Bias

Drill it

Reading is not remembering. These come from the Statistics And Probability deck:

Q

What is the <b>mean</b> of a dataset?

The mean is the arithmetic average, calculated by summing all values and dividing by the number of values. Formula: x̄ = Σxᵢ / n. It is sensitive to outliers an...

Q

What is the <b>median</b> and when is it preferred over the mean?

The median is the middle value when data is sorted in order. For an even number of observations, it is the average of the two middle values. It is preferred ove...

Q

What is the <b>mode</b> of a dataset?

The mode is the value that appears most frequently in a dataset. A dataset can be unimodal (one mode), bimodal (two modes), or multimodal (more than two modes)....

Q

What is <b>standard deviation</b> and what does it measure?

Standard deviation measures the average amount of dispersion or spread in a dataset relative to the mean. A low standard deviation indicates data points are clo...