Common Continuous Distributions
Continuous distributions model measurements that vary on intervals: times, lengths, errors, proportions, variances, and transformed statistics. They replace probability at a point with probability over intervals. For example, the probability that a lifetime is exactly years is usually zero, but the probability that it lies between and years can be positive.
Lane et al.'s statistics text treats the normal distribution in depth and later introduces distributions such as and chi-square for inference. This probability page gives a theory-focused reference to the main continuous families, while cross-linking to statistics where the inferential use is the main topic.
Figure: Exponential density functions for several rate parameters. Image: Wikimedia Commons, Skbkekas, CC BY 3.0.
Definitions
A continuous random variable has density if
The Uniform distribution on has constant density
The Exponential distribution with rate has density
The Normal distribution with mean and variance has density
The Gamma distribution with shape and rate has density
The Beta distribution with parameters has density on :
The Chi-square distribution with degrees of freedom is a Gamma distribution:
when using the rate parameterization.
If and are independent, then the Student distribution is
If and are independent, then the distribution is
Key results
| Distribution | Support | Mean | Variance | Common role |
|---|---|---|---|---|
| Uniform | equally likely interval values | |||
| Exponential | waiting times with constant hazard | |||
| Normal | errors, sums, approximations | |||
| Gamma | waiting time to repeated events | |||
| Beta | random proportions | |||
| Chi-square | sums of squared normals | |||
| if | if | standardized mean with estimated variance | ||
| if | depends on degrees | variance ratios |
Memorylessness of exponential. If , then
The exponential is the continuous analogue of the geometric distribution.
Normal standardization. If , then
Thus normal probabilities can be reduced to the standard normal CDF .
Gamma sums. If independent exponential waiting times share rate , then their sum has a Gamma distribution. Specifically, the waiting time until the -th event in a Poisson process has Gamma distribution when is a positive integer.
Several continuous families are connected by transformations. If , then , and sums of independent squared standard normals produce chi-square distributions with more degrees of freedom. Ratios involving a standard normal and an independent chi-square variable produce distributions. Ratios of scaled independent chi-square variables produce distributions. These relationships explain why the same families appear repeatedly in sampling theory.
Location and scale also matter. If has a standard distribution, then shifts the center by and stretches the spread by . Normal distributions are closed under this transformation, but many positive distributions are better described by shape and rate or shape and scale. Always record the parameterization. For Gamma and Exponential distributions, "rate" and "scale" are reciprocals, and confusing them changes the mean.
For reliability and survival problems, the survival function is often clearer than the CDF. The exponential survival function makes the constant-hazard assumption visible.
Continuous families are often chosen for shape constraints. Beta distributions can be U-shaped, uniform, left-skewed, right-skewed, or concentrated near the center depending on and . Gamma distributions can be highly right-skewed for small shape and more symmetric for large shape. Normal distributions are symmetric and light-tailed. These shape facts should be checked against context before fitting a model or using a table.
Quantiles are often more stable to communicate than densities. For example, saying that of a normal distribution lies within about two standard deviations of the mean is more interpretable than quoting density heights. For skewed distributions, report asymmetric intervals rather than forcing a mean-plus-minus-standard-deviation summary.
Visual
| Modeling clue | Candidate distribution | Why |
|---|---|---|
| all values in an interval are equally likely | Uniform | constant density |
| time until next event at constant rate | Exponential | memoryless waiting time |
| sum of many small independent effects | Normal | central limit behavior |
| time until several events | Gamma | sum of exponentials |
| unknown probability or proportion | Beta | support is to |
| sum of squared standard normals | Chi-square | quadratic normal variation |
Worked example 1: exponential reliability
Problem. A component lifetime is exponential with mean hours. Find the rate , the probability it lasts at least hours, and the probability it lasts another hours given that it has already lasted hours.
Method.
- For an exponential distribution, . Since the mean is ,
- The survival function is
- Probability of lasting at least hours:
- Conditional probability of lasting another hours after :
- Substitute survival probabilities:
Checked answer. , , and the conditional probability is about . The last result illustrates memorylessness.
Worked example 2: normal probability by standardization
Problem. Exam scores are approximately normal with mean and standard deviation . What proportion of scores lies between and ?
Method.
-
Let .
-
Standardize the lower endpoint:
- Standardize the upper endpoint:
- Convert to standard normal probability:
- Use the standard normal CDF:
- With and ,
Checked answer. About of scores lie between and under the normal model.
Code
from scipy.stats import expon, norm, gamma, beta, chi2, t, f
# Exponential reliability.
mean_life = 200
rate = 1 / mean_life
survive_300 = expon.sf(300, scale=1 / rate)
survive_another_100 = expon.sf(100, scale=1 / rate)
print(rate, survive_300, survive_another_100)
# Normal interval probability.
mu, sigma = 70, 8
prob = norm.cdf(84, loc=mu, scale=sigma) - norm.cdf(62, loc=mu, scale=sigma)
print(prob)
# A small reference table.
print("Gamma mean:", gamma.mean(a=3, scale=1 / 2)) # rate 2 means scale 1/2
print("Beta mean:", beta.mean(a=2, b=5))
print("Chi-square 95th percentile:", chi2.ppf(0.95, df=10))
print("t 97.5th percentile:", t.ppf(0.975, df=12))
print("F 95th percentile:", f.ppf(0.95, dfn=5, dfd=20))
Common pitfalls
- Confusing rate and scale. SciPy often uses
scale = 1 / rate, while many textbooks write exponential and gamma distributions with rate . - Treating density height as probability. For continuous variables, probabilities are areas.
- Assuming all bell-shaped data are normal. Tail behavior and skew matter.
- Applying , chi-square, or formulas without their normal-sample assumptions when doing inference.
- Forgetting support. A normal model can assign small probability to impossible negative values; sometimes this is acceptable, sometimes not.
- Using the exponential memoryless property for non-exponential lifetimes. Aging components often do not have constant hazard.