What is it?
The workhorses: uniform (random number generators), exponential (waiting times, memoryless), normal (sums of many small effects, by the central limit theorem), and their multivariate versions.
Formulas
- central limit theorem
Where it shows up in computing
Poisson arrivals have exponential inter-arrival times — the basis of M/M/1 models of servers.
Gaussian noise assumptions make the Kalman filter optimal and closed-form.
Where it shows up in AI
Diffusion models add Gaussian noise; VAEs use Gaussian latent variables.
Where is it used?
Computing topics reachable from here, through the chain of ideas that leads to them:
This page has the essentials. A fuller treatment (intuition, formal definition, worked example) is on the way.