Normal Distribution: From a Bell Shape to a Probability Model
Why does the Normal density have its particular formula, and what does each part mean?
How this lesson unfolds.
Begin with What turns a curve into a probability density? The sequence then connects Probability is area, not height and builds toward Normal is a model, not a default truth.
What turns a curve into a probability density?
A continuous density must be nonnegative, have total area one, and assign interval probability through area under the curve.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionProbability is area, not height
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How does a density answer an interval question?
For a continuous variable, P(a < X < b) is the integral of f from a to b; a single height f(x) is density, not probability.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionChoose a useful shape before normalizing it
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Can we begin with an unnormalized bell?
The kernel g(x)=exp(-x^2) has the desired bell shape, but its area is not yet one, so it is not yet a probability density.
The kernel g(x)=exp(-x^2) has the desired bell shape, but its area is not yet one, so it is not yet a probability density.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionNormalization spends exactly one probability budget
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What does normalization actually fix?
If a nonnegative kernel has finite area A, dividing every height by A creates f(x)=g(x)/A with total area one.
If a nonnegative kernel has finite area A, dividing every height by A creates f(x)=g(x)/A with total area one.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionNormalization changes scale, not shape
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Does normalization distort the bell?
Multiplying every height by the same positive constant preserves the curve's center, ordering, symmetry, and relative shape while changing its total area.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionSymmetry alone is not enough
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why are x^2 and -x^2 not valid density shapes?
Both are symmetric, but x^2 grows in the tails and -x^2 becomes negative; neither can be normalized into a density on the whole real line.
Both are symmetric, but x^2 grows in the tails and -x^2 becomes negative; neither can be normalized into a density on the whole real line.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionA useful bell combines three structural ideas
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Which transformation repairs the failed parabolas?
Squaring gives left-right symmetry, a negative sign makes distance a penalty, and exponentiation keeps the result positive while making tails fade.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionSquaring removes the sign of a deviation
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How does the formula make left and right match?
Points mu-d and mu+d have equal squared deviations, so a density based on (x-mu)^2 gives them equal height.
Points mu-d and mu+d have equal squared deviations, so a density based on (x-mu)^2 gives them equal height.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionEqual distance means equal density
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What does symmetry look like on the bell?
Mirrored inputs at the same distance from mu receive the same density; the square creates symmetry, while the exponential creates the bell's decay.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe exponential turns distance into rarity
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why does density fall smoothly away from the center?
A larger squared standardized distance makes the exponent more negative, so exp(-z^2/2) remains positive but rapidly approaches zero.
A larger squared standardized distance makes the exponent more negative, so exp(-z^2/2) remains positive but rapidly approaches zero.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionA distance table makes tail decay visible
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How quickly does Gaussian weight shrink?
At z=0,1,2,3 the unnormalized weights exp(-z^2/2) are approximately 1, 0.607, 0.135, and 0.011.
At z=0,1,2,3 the unnormalized weights exp(-z^2/2) are approximately 1, 0.607, 0.135, and 0.011.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe quadratic coefficient controls width
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What makes one bell narrow and another wide?
In exp(-c(x-mu)^2), a larger positive c penalizes distance faster and produces a narrower bell; a smaller c produces a wider bell.
In exp(-c(x-mu)^2), a larger positive c penalizes distance faster and produces a narrower bell; a smaller c produces a wider bell.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionStandard deviation sets the Normal width
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Where does sigma appear in the exponent?
The Normal chooses c=1/(2 sigma^2); increasing sigma decreases c, stretches the bell, and lowers its peak so total area stays one.
The Normal chooses c=1/(2 sigma^2); increasing sigma decreases c, stretches the bell, and lowers its peak so total area stays one.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionA bell-shaped density need not be Normal
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Is every symmetric bell a Normal curve?
No. Many positive integrable functions normalize into symmetric bells, but only the exponential-quadratic family is Normal.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionTail behavior distinguishes distribution families
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How can two symmetric bells behave differently?
A Normal tail decays exponentially in squared distance, while a Cauchy tail decays polynomially; that difference changes moments and extreme-event behavior.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionBase e keeps the calculus clean
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why does the Normal formula use e?
Differentiating exp(u(x)) returns u'(x)exp(u(x)), keeping the same exponential family without an extra logarithmic factor.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionChanging the base changes the coefficient
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Would another exponential base create a new family?
For a>1, a^(-c x^2)=exp(-(c ln a)x^2); changing the base only rescales the positive quadratic coefficient.
For a>1, a^(-c x^2)=exp(-(c ln a)x^2); changing the base only rescales the positive quadratic coefficient.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionWidth can absorb the choice of base
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How is the same curve reparameterized?
The product c ln(a) is the effective decay rate, so a new base can be offset by a new c or sigma without changing the exponential-quadratic family.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe Normal density has four coordinated parts
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What does every symbol in the formula do?
Mu locates the center, sigma controls spread, the square enforces symmetry, and the leading factor 1/(sigma sqrt(2 pi)) makes total area one.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionChanging mu and sigma moves and stretches the bell
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How do the two parameters change the graph?
Changing mu shifts the bell without changing shape; changing sigma adjusts width and peak height while preserving total area one.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe Gaussian area is found by squaring it
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why does the integral of exp(-x^2) involve sqrt(pi)?
Calling the unknown integral I and squaring it converts two identical one-dimensional integrals into a double integral over the plane.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionPolar coordinates reveal pi
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How does circular symmetry evaluate the double integral?
With x^2+y^2=r^2 and dxdy=r dr dtheta, the angular integral contributes 2 pi and the radial integral contributes 1/2, so I^2=pi.
With x^2+y^2=r^2 and dxdy=r dr dtheta, the angular integral contributes 2 pi and the radial integral contributes 1/2, so I^2=pi.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionMultiplication creates a surface with circular contours
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What geometric object appears after squaring the integral?
The product exp(-x^2)exp(-y^2)=exp(-(x^2+y^2)) is a height over the xy-plane; equal-height level sets are circles.
The product exp(-x^2)exp(-y^2)=exp(-(x^2+y^2)) is a height over the xy-plane; equal-height level sets are circles.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThin rings explain the polar area factor
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why does a factor r appear in polar coordinates?
A thin ring of radius r and thickness dr has area approximately 2 pi r dr; integrating equal-height rings sums the surface volume.
A thin ring of radius r and thickness dr has area approximately 2 pi r dr; integrating equal-height rings sums the surface volume.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe standard Normal constant follows from the Gaussian integral
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How does sqrt(pi) become sqrt(2 pi)?
Substituting x=z/sqrt(2) shows integral exp(-z^2/2) dz=sqrt(2 pi), so its reciprocal normalizes the standard Normal density.
Substituting x=z/sqrt(2) shows integral exp(-z^2/2) dz=sqrt(2 pi), so its reciprocal normalizes the standard Normal density.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe CDF and PDF describe the same probability differently
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
How are cumulative probability and density connected?
Where differentiable, F'(x)=f(x); conversely F(x)=integral from negative infinity to x of f(t)dt, so differentiation localizes accumulated probability.
Where differentiable, F'(x)=f(x); conversely F(x)=integral from negative infinity to x of f(t)dt, so differentiation localizes accumulated probability.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionStandardization removes units and location
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What does a z-score measure?
For any variable with finite positive standard deviation, Z=(X-mu)/sigma measures signed distance from the mean in standard-deviation units.
For any variable with finite positive standard deviation, Z=(X-mu)/sigma measures signed distance from the mean in standard-deviation units.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionA Normal stays Normal after standardization
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What distribution does a standardized Normal have?
If X is Normal(mu,sigma^2), then subtracting mu and dividing by sigma produces Z Normal(0,1), enabling one reference curve and table.
If X is Normal(mu,sigma^2), then subtracting mu and dividing by sigma produces Z Normal(0,1), enabling one reference curve and table.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionIndependent Normal variables add to another Normal
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What makes the Normal family stable under addition?
For independent Normal X and Y, the sum is Normal; means add and variances add, preserving the family exactly.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionMany small effects can create a bell
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why does the Normal appear so often?
A standardized sum of many independent identically distributed finite-variance effects approaches a standard Normal under the classical central limit theorem.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe central limit theorem has conditions
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Does every sum become Normal?
No. The classical theorem assumes independent identically distributed effects with finite nonzero variance; other CLTs use different technical conditions.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionTail behavior decides whether the CLT applies
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What can heavy tails change?
Some heavy-tailed distributions have undefined variance and fall outside the classical finite-variance CLT; their sums can have different limiting behavior.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionThe Cauchy distribution shows the warning clearly
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
Why is a Cauchy bell not a Normal bell?
The Cauchy density is symmetric and bell-shaped but has much heavier tails and no finite mean or variance, so ordinary z-score and finite-variance CLT reasoning fail.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionFixed mean and variance single out the Normal by entropy
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
What does maximum entropy say about the Normal?
Among continuous densities with a fixed finite mean and variance, the Normal has the largest differential entropy and adds the least extra distributional structure.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionNormal is a model, not a default truth
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.
When should we actually use a Normal model?
Use it when the mechanism, diagnostics, and purpose support symmetric light-tailed variation; check skew, outliers, bounds, mixtures, and dependence rather than assuming a bell.
- Helpful foundationsbasic probability · functions and graphs · areas under curves · mean and variance
- Next connectionContinue to Normal probabilities, quantiles, sampling, and statistical inference.
More context
The portrait diagram presents the equation first, then a labeled visual comparison and a plain-language takeaway.