Cumulative distribution function

Level UniversityDifficulty ★★★★★Concept⌖ Open in the map

What is it?

F(x)=P(X≤x)=∫−∞xp(t) dtF(x) = P(X \le x) = \int_{-\infty}^x p(t)\,\dd t. By the fundamental theorem, F′=pF' = p. Its inverse (the quantile function) turns uniform random numbers into samples of any distribution.

Formulas

F(x)=∫−∞xp(t) dt,F′(x)=p(x)F(x) = \int_{-\infty}^{x} p(t)\,\dd t, \qquad F'(x) = p(x)
U∼𝒰(0,1)  ⟹  F−1(U)∼FU \sim \mathcal U(0,1) \implies F^{-1}(U) \sim F
inverse transform sampling

Where it shows up in computing

  • Monte Carlo methods★★★★★fundamentalScientific computing and algorithms

    Inverse transform sampling: e.g. −ln⁡(1−U)/λ-\ln(1 - U)/\lambda is exponential with rate λ\lambda.

  • Queueing theory and performance★★★★★frequentOptimization and systems

    Latency percentiles (p99) are quantiles of the response-time distribution.

Where is it used?

Computing topics reachable from here, through the chain of ideas that leads to them:

This page has the essentials. A fuller treatment (intuition, formal definition, worked example) is on the way.

↑ ↓ to navigate · ↵ · Esc