VISUAL LESSON · 20 PICTURES

Estimators from Scratch: Weights, Auxiliary Data, and Error Repair

How can a carefully designed rule estimate a whole population from one incomplete sample?

MODULE 4 / 6LESSON 13 / 46PICTURE 18 / 20
Progress stays on this device · no login
BEFORE THE FIRST PICTURE

How this lesson unfolds.

Begin with How can 4 surveyed forests describe all 10? The sequence then connects Forests entered the sample with unequal chances and builds toward A good estimator makes every correction explainable.

Picture 1 of 20 · tap to inspect in full resolution
01

How can 4 surveyed forests describe all 10?

INTUITION

The observed tiger counts 18, 14, 20, and 19 sum to 71, but 71 is only the sample total. An estimator must connect these four observations to the ten-forest population.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionForests entered the sample with unequal chances
Picture 2 of 20 · tap to inspect in full resolution
02

Were all four observations equally easy to obtain?

INTUITION

No. The inclusion probabilities were designed before the survey: A 0.80, B 0.60, E 0.70, and H 0.50. Accessibility, cost, prior maps, and size can make selection chances unequal.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionInverse probability turns rarity into responsibility
Picture 3 of 20 · tap to inspect in full resolution
03

Why should a rarely selected forest receive more weight?

INTUITION

The design weight is w_i=1/pi_i. A unit selected with probability 0.20 represents 5 population units, while one selected with probability 0.80 represents 1.25. Weight corrects opportunity to be observed, not the tiger count itself.

MATHEMATICAL STATEMENT
  1. The design weight is w_i=1/pi_i.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionEach observation now speaks for what it represents
Picture 4 of 20 · tap to inspect in full resolution
04

What happens when we apply each design weight?

INTUITION

Multiply observed count by inverse inclusion probability. The four contributions are 22.50, 23.33, 28.57, and 38.00, which sum to an estimated population total of 112.40 tigers.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionHorvitz–Thompson compresses the table into one rule
Picture 5 of 20 · tap to inspect in full resolution
05

Can the row-by-row weighting become one estimator?

INTUITION

Yes. The Horvitz–Thompson total is Y_hat_HT=sum over sampled units of y_i/pi_i. It adds each observed value divided by its known inclusion probability and never invents values for unsampled units.

MATHEMATICAL STATEMENT
  1. The Horvitz–Thompson total is Y_hat_HT=sum over sampled units of y_i/pi_i.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionUnbiased does not mean exact in one sample
Picture 6 of 20 · tap to inspect in full resolution
06

Can a sound estimator miss the true total once?

INTUITION

Yes. This sample gives 112.40 while the known total is 144, an error of -31.60. Unbiasedness means the average estimate across repeated design-based samples equals the truth, not that every realization is exact.

MATHEMATICAL STATEMENT
  1. Unbiasedness means the average estimate across repeated design-based samples equals the truth, not that every realization is exact.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionTiger counts were missing, but useful forest data remained
Picture 7 of 20 · tap to inspect in full resolution
07

What else can be known for every forest?

INTUITION

Forest area, canopy, water sources, and prey indices may be available from satellites, GIS, or prior records. These auxiliary variables are known population information related to the unknown target, tiger count.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionThe same weights can estimate an auxiliary total
Picture 8 of 20 · tap to inspect in full resolution
08

What happens when HT estimates forest area?

INTUITION

Applying the same design weights to sampled areas gives X_hat_HT=649.76 square kilometres, while the known total area is X=870. The gap reveals that this sample under-represents a variable related to tiger count.

MATHEMATICAL STATEMENT
  1. Applying the same design weights to sampled areas gives X_hat_HT=649.76 square kilometres, while the known total area is X=870.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionRatio estimation repairs the scale
Picture 9 of 20 · tap to inspect in full resolution
09

How can the known area total rescale the tiger estimate?

INTUITION

The area correction factor is 870/649.76=1.339. Multiplying 112.40 by 1.339 gives 150.50 tigers. Because sampled area was low, ratio estimation enlarges the tiger estimate proportionally.

MATHEMATICAL STATEMENT
  1. The area correction factor is 870/649.76=1.339.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionThe ratio estimator is one multiplicative correction
Picture 10 of 20 · tap to inspect in full resolution
10

What is the general ratio rule?

INTUITION

The ratio total estimator is Y_hat_R=Y_hat_HT times X/X_hat_HT. It keeps the sample fixed and changes the estimate's scale using one auxiliary total known for the population.

MATHEMATICAL STATEMENT
  1. The ratio total estimator is Y_hat_R=Y_hat_HT times X/X_hat_HT.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionArea and tiger count move together, but not perfectly
Picture 11 of 20 · tap to inspect in full resolution
11

Does one fixed proportion fit every sampled forest?

INTUITION

Larger sampled forests generally contain more tigers, but equal area changes do not produce equal tiger changes. The relationship supports auxiliary correction while warning that a fixed ratio is only an approximation.

MATHEMATICAL STATEMENT
  1. Larger sampled forests generally contain more tigers, but equal area changes do not produce equal tiger changes.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionDifference estimation repairs only the known gap
Picture 12 of 20 · tap to inspect in full resolution
12

Can we add what the missing represented area should contribute?

INTUITION

The represented-area gap is 870-649.76=220.24 square kilometres. At a working rate of 0.15 tiger per square kilometre, the correction is 33.04, giving 112.40+33.04=145.44 tigers.

MATHEMATICAL STATEMENTS
  1. The represented-area gap is 870-649.76=220.24 square kilometres.
  2. At a working rate of 0.15 tiger per square kilometre, the correction is 33.04, giving 112.40+33.04=145.44 tigers.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionThe difference estimator is one additive correction
Picture 13 of 20 · tap to inspect in full resolution
13

What is the general difference rule?

INTUITION

The difference total estimator is Y_hat_D=Y_hat_HT+B(X-X_hat_HT). B translates an auxiliary-unit gap into expected target units; unlike ratio estimation, the correction is added rather than multiplied.

MATHEMATICAL STATEMENT
  1. The difference total estimator is Y_hat_D=Y_hat_HT+B(X-X_hat_HT).
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionRegression learns both level and slope
Picture 14 of 20 · tap to inspect in full resolution
14

Can one fitted line summarize the area–tiger relationship?

INTUITION

From the four sampled forests, the fitted line is y_hat_i=2.23+0.151x_i. The intercept supplies a starting level and the slope supplies the estimated increase in tigers per square kilometre.

MATHEMATICAL STATEMENT
  1. From the four sampled forests, the fitted line is y_hat_i=2.23+0.151x_i.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionPrediction supplies structure; weights repair errors
Picture 15 of 20 · tap to inspect in full resolution
15

What if the regression line is useful but imperfect?

INTUITION

Use known area to predict every forest, then compute residuals y_i-y_hat_i in sampled forests. Inverse-probability weighting expands those observed residuals so prediction errors beyond the sample are represented.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionGREG combines population predictions with design repair
Picture 16 of 20 · tap to inspect in full resolution
16

How do predictions and weights become one estimator?

INTUITION

GREG equals the sum of predictions for all population units plus the HT-weighted residuals in the sample. Predictions use auxiliary structure; weighted residuals preserve design-based correction when the model misses.

MATHEMATICAL STATEMENT
  1. GREG equals the sum of predictions for all population units plus the HT-weighted residuals in the sample.
  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionFive estimators differ by the error they correct
Picture 17 of 20 · tap to inspect in full resolution
17

What weakness does each estimator correct?

INTUITION

Every estimator combines observed target data, known population information, and a correction rule. The creative decision is choosing which known information should correct which weakness.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionAdvanced estimators evolve through small, testable changes
Picture 18 of 20 · tap to inspect in full resolution
18

How are stronger estimators invented?

INTUITION

Start with design weights, add a scale correction, add a gap correction, learn a relationship, then combine prediction with weighted error repair. Each change targets one identifiable weakness in the current estimate.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionSimulation tests an estimator before one real survey
Picture 19 of 20 · tap to inspect in full resolution
19

How can we trust a rule when the real population total is unknown?

INTUITION

On historical or simulated populations with known truth, repeatedly draw samples, apply the estimator, and measure bias, variance, and error. Only after this validation do we use the chosen estimator once on the real survey.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionA good estimator makes every correction explainable
Picture 20 of 20 · tap to inspect in full resolution
20

What should remain after the formulas are gone?

INTUITION

Weights restore representation, auxiliary totals expose sample imbalance, models add structure, and residual corrections defend against model error. A production estimator is not just a formula; it is a justified chain from sampling design to uncertainty.

  • Helpful foundationsfractions · weighted averages · basic probability · linear relationships
  • Next connectionSampling variance, confidence intervals, and estimator choice