What is it?
Approximate the area under a curve by thin rectangles, . As the sum converges to the integral — slowly for the left/right rule (), faster for the midpoint ().
Formulas
Interactive visualization
Where it shows up in computing
Monte Carlo integration is a Riemann-like sum with random sample points instead of a grid.
Where is it used?
Computing topics reachable from here, through the chain of ideas that leads to them:
ℒ AI and machine learning
- Definite integral→Convolution→Convolutional networks (CNNs)★★★★★
- Definite integral→Continuous random variables→Probability density function→Bayesian inference★★★★★
- Definite integral→Continuous random variables→Probability density function→Generative models★★★★★
- Definite integral→Continuous random variables→Probability density function→Expectation→Loss function★★★★★
- Definite integral→Continuous random variables→Probability density function→Maximum likelihood estimation→Logistic regression★★★★★
- Definite integral→Continuous random variables→Probability density function→Expectation→Stochastic gradient descent (SGD)★★★★★
- +1
⚙ Robotics and control
- Definite integral→Improper integrals→Laplace transform→Control theory★★★★★
- Definite integral→Continuous random variables→Probability density function→Continuous distributions→Kalman filter★★★★★
- Definite integral→Improper integrals→Laplace transform→Control theory→Trajectory optimization and MPC★★★★★
- Definite integral→Improper integrals→Laplace transform→PID control★★★★★
⚛ Physics and simulation
- Definite integral→Multiple integrals and change of variables→Surface integrals and flux→Divergence theorem (Gauss)→Electromagnetism (Maxwell's equations)★★★★★
- Definite integral→Multiple integrals and change of variables→Surface integrals and flux→Divergence theorem (Gauss)→Fluid dynamics and CFD★★★★★
- Definite integral→Physics engines★★★★★
- Numerical integration (quadrature)→Finite element method★★★★★
- Definite integral→Line integrals→Classical mechanics★★★★★
- Definite integral→Physics engines→N-body gravitational simulation★★★★★
∿ Signals, media and vision
- Definite integral→Convolution→Signal processing★★★★★
- Definite integral→Convolution→Image processing and computer vision★★★★★
- Definite integral→Convolution→Digital filters★★★★★
- Definite integral→Improper integrals→Fourier transform→Sampling theorem (Nyquist–Shannon)★★★★★
- Definite integral→Improper integrals→Fourier transform→Fast Fourier transform (FFT)★★★★★
- Definite integral→Convolution→Signal processing→Media compression (JPEG, MP3, video)★★★★★
- +1
What depends on it
Exercises
1Graphical
In the demo, compare the left and midpoint sums for on with . Why is the midpoint so much better?
Solution
On each strip the midpoint rectangle over- and under-estimates by nearly equal amounts on the two halves, so the first-order errors cancel and only a curvature term per strip survives: total instead of .
This page has the essentials. A fuller treatment (intuition, formal definition, worked example) is on the way.