What is it?
An infinite list — a function . Every iterative algorithm produces one: the successive guesses of Newton's method, the losses of a training run, the cost of an algorithm on inputs of size .
Formulas
- explicit and recursive (the second converges to )
Where it shows up in computing
Iterative solvers produce a sequence of approximations that should converge to the answer.
The running time is a sequence, often defined by a recurrence such as .
Where is it used?
Computing topics reachable from here, through the chain of ideas that leads to them:
λ Scientific computing and algorithms
- Convergence of sequences→Order of convergence→Scientific computing★★★★★
- Convergence of sequences→Numerical series→Geometric series→Algorithm analysis and complexity★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Monte Carlo methods★★★★★
- Convergence of sequences→Newton's method→Floating point (IEEE 754)★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Fundamental theorem of calculus→Symbolic computation (CAS)★★★★★
ℒ AI and machine learning
- Convergence of sequences→Newton's method→Second-order (Hessian-based) optimization★★★★★
- Convergence of sequences→Numerical series→Geometric series→Reinforcement learning★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Convolution→Convolutional networks (CNNs)★★★★★
- Convergence of sequences→Gradient descent★★★★★
- Convergence of sequences→Gradient descent→Learning rate★★★★★
- Convergence of sequences→Gradient descent→Backpropagation★★★★★
- +12
⚛ Physics and simulation
- Dynamical systems→Weather and climate modelling★★★★★
- Convergence of sequences→Numerical series→Fourier series→Heat equation and diffusion★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Physics engines★★★★★
- Convergence of sequences→Riemann sums→Numerical integration (quadrature)→Finite element method★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Line integrals→Classical mechanics★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Physics engines→N-body gravitational simulation★★★★★
- +2
∿ Signals, media and vision
- Convergence of sequences→Numerical series→Fourier series→Signal processing★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Convolution→Image processing and computer vision★★★★★
- Convergence of sequences→Numerical series→Fourier series→Fourier transform→Sampling theorem (Nyquist–Shannon)★★★★★
- Convergence of sequences→Numerical series→Fourier series→Fourier transform→Fast Fourier transform (FFT)★★★★★
- Convergence of sequences→Riemann sums→Definite integral→Convolution→Digital filters★★★★★
- Convergence of sequences→Numerical series→Fourier series→Signal processing→Media compression (JPEG, MP3, video)★★★★★
- +1
What depends on it
This page has the essentials. A fuller treatment (intuition, formal definition, worked example) is on the way.