VISUAL LESSON · 20 PICTURES

Statistics Is Not a Coin Toss: One Sample, Measured Uncertainty

How can one carefully selected sample measure uncertainty about a fixed population?

MODULE 4 / 6LESSON 40 / 46PICTURE 1 / 20
Progress stays on this device · no login
BEFORE THE FIRST PICTURE

How this lesson unfolds.

Begin with What is already fixed before statistics begins? The sequence then connects Complete measurement is usually impossible and builds toward One sample becomes reliable understanding through a chain.

Picture 1 of 20 · tap to inspect in full resolution
01

What is already fixed before statistics begins?

INTUITION

Every eligible voter already has a response at the time of study. The finite population and its outcomes are real and fixed; our knowledge of them is incomplete.

  • Learning goalExplain fixed population in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionComplete measurement is usually impossible
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 2 of 20 · tap to inspect in full resolution
02

Why not ask every person in the population?

INTUITION

A census can be too slow, costly, or inaccessible. Statistics exists because complete observation is often impractical, not because the population itself must be random.

  • Learning goalExplain why sample in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionWe observe one sample once
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 3 of 20 · tap to inspect in full resolution
03

What do we actually get to observe?

INTUITION

From a large fixed population, the survey selects and questions one smaller group. That observed sample is evidence; it is not the whole population and not a sequence of repeated elections.

  • Learning goalExplain one observed sample in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionA useful sample must carry the population inside it
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 4 of 20 · tap to inspect in full resolution
04

Can five people from one corner represent everyone?

INTUITION

No. A sampling design must give relevant regions and groups a credible path into the sample. Representation comes from the design, not merely from having observations.

  • Learning goalExplain representation in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionSampling design controls who can enter
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 5 of 20 · tap to inspect in full resolution
05

How can a probability sample be selected?

INTUITION

Simple random, stratified, systematic, cluster, and multistage designs create different known selection probabilities. Equal probability is one option, not a requirement.

MATHEMATICAL STATEMENT
  1. Equal probability is one option, not a requirement.
  • Learning goalExplain sampling designs in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionObserved answers become data
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 6 of 20 · tap to inspect in full resolution
06

Where does the uncertainty move after observation?

INTUITION

Once five responses are observed, their values are known. Uncertainty is no longer about those five answers; it is about what they imply for the unobserved population.

  • Learning goalExplain observed data in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionOutcomes are fixed; selection is random
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 7 of 20 · tap to inspect in full resolution
07

What changes if we could draw another sample?

INTUITION

For person i, the outcome Y_i is fixed while the inclusion indicator I_i is random under the sampling design. An estimate changes because selected people change, not because the population moves.

  • Learning goalExplain fixed versus random in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionIndependent votes do not imply independent selection
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 8 of 20 · tap to inspect in full resolution
08

Why does sampling without replacement create dependence?

INTUITION

Selecting one unit removes one available slot, so distinct inclusion indicators have negative covariance. The finite population correction comes from dependent selection without replacement, not from dependent voting decisions.

  • Learning goalExplain selection dependence in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionStatistics first describes the observed sample
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 9 of 20 · tap to inspect in full resolution
09

What can five binary responses tell us directly?

INTUITION

For responses 1, 1, 1, 0, 0, the sample total is 3, the sample mean and proportion are 0.60, and the sample standard deviation is about 0.548. These summarize only the observed five.

  • Learning goalExplain sample summaries in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionOne sample can answer different questions
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 10 of 20 · tap to inspect in full resolution
10

Which summary matches the question being asked?

INTUITION

Mean answers average support, standard deviation describes variation, proportion answers how many support, and sample size records how many were observed. Different questions require different statistics.

  • Learning goalExplain summary choice in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionAn estimator reaches beyond the observed sample
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 11 of 20 · tap to inspect in full resolution
11

How does 60% in the sample become a population claim?

INTUITION

The sample proportion p-hat=3/5=0.60 is used as an estimate of the unknown population proportion p. Estimation is a disciplined prediction about unseen units, not a declaration that sample and population are identical.

MATHEMATICAL STATEMENT
  1. The sample proportion p-hat=3/5=0.60 is used as an estimate of the unknown population proportion p.
  • Learning goalExplain estimation in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionOther possible samples could give other answers
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 12 of 20 · tap to inspect in full resolution
12

Could the same design have selected different people?

INTUITION

Yes. With the population fixed, different samples permitted by the design can yield proportions such as 0.20, 0.40, 0.60, or 0.80. These are possible surveys, not repeated elections.

  • Learning goalExplain sampling distribution in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionCompare estimates under the same design
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 13 of 20 · tap to inspect in full resolution
13

How do possible samples reveal estimator behavior?

INTUITION

Apply the same statistic to every possible sample allowed by the design. Comparing the resulting estimates creates the sampling distribution used to study accuracy and uncertainty.

  • Learning goalExplain compare estimates in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionThe spread of estimates is sampling uncertainty
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 14 of 20 · tap to inspect in full resolution
14

Why do valid sample estimates disagree?

INTUITION

Different selected units produce different estimates. Sampling variance measures their spread around the design expectation, while standard error is the typical size of that variation in the estimator's original units.

  • Learning goalExplain variance standard error in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionNot every summary varies by the same amount
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 15 of 20 · tap to inspect in full resolution
15

Which sample summary is most sensitive to selection?

INTUITION

Across four possible samples, the mean ranges from 0.20 to 0.80, the standard deviation moves only from about 0.45 to 0.55, and sample size stays 5. Variability belongs to a specific statistic under a specific design.

  • Learning goalExplain statistic specific variability in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionDifferent estimators have different jobs
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 16 of 20 · tap to inspect in full resolution
16

What population quantity do we want to estimate?

INTUITION

Use a sample mean for a population mean, a sample proportion for a binary proportion, Horvitz-Thompson for totals under unequal selection, and ratio or regression estimators when useful auxiliary information exists.

  • Learning goalExplain estimator jobs in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionTrust depends on assumptions, not complexity
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 17 of 20 · tap to inspect in full resolution
17

Which estimator fits the design and available information?

INTUITION

The sample mean suits equal-probability designs, sample proportion suits binary outcomes, Horvitz-Thompson corrects unequal inclusion probabilities, and regression uses related auxiliary data. The best estimator is the justified one.

MATHEMATICAL STATEMENT
  1. The sample mean suits equal-probability designs, sample proportion suits binary outcomes, Horvitz-Thompson corrects unequal inclusion probabilities, and regression uses related auxiliary data.
  • Learning goalExplain estimator choice in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionReal inference is not repeated coin tossing
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 18 of 20 · tap to inspect in full resolution
18

Do we need to repeat reality to measure uncertainty?

INTUITION

No. A real election or survey may be observed only once. Repetition lives in the set of samples the design could have selected, allowing uncertainty to be studied without rerunning the event.

  • Learning goalExplain not coin toss in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionMany real studies offer no second chance
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 19 of 20 · tap to inspect in full resolution
19

What do elections, trials, and censuses share?

INTUITION

They are tied to a time, population, or treatment context that cannot simply be replayed unchanged. Statisticians therefore quantify uncertainty from one observed sample and a defensible data-generating or sampling design.

  • Learning goalExplain one chance studies in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionOne sample becomes reliable understanding through a chain
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.

Picture 20 of 20 · tap to inspect in full resolution
20

What is the complete path from reality to inference?

INTUITION

Define the fixed population, choose a probability design, observe one sample, compute a matching statistic, estimate the population quantity, compare possible estimates, measure uncertainty, and apply finite-population correction when sampling without replacement is substantial.

  • Learning goalExplain inference chain in design-based finite-population inference.
  • Helpful foundationsfractions · sample and population · basic probability · mean and proportion
  • Common trapInference does not require treating a fixed population as repeated independent coin tosses.
  • Next connectionConfidence intervals and survey design effects
More context

The portrait diagram reads from top to bottom and uses labeled people, cards, equations, tables, or flows to distinguish observed data from design-based uncertainty.