Dynamical systems and chaos
The long-term behaviour of systems that evolve: equilibria, stability, attractors, bifurcations and chaos — and the limits they impose on prediction.
7 topics
Topics
Dynamical systems
A state and a rule that moves it forward: continuous () or discrete (). The questions change from "find the formula" to "what happens in the long run?" — and every iterative algorithm, from gradient descent to a recurrent network, is a discrete dynamical system.
Phase space
The space of all possible states (for a pendulum: angle and angular velocity). Each initial state traces a trajectory; drawing them all — the phase portrait — shows the whole behaviour at a glance.
Equilibria and stability
An equilibrium is stable if nearby states stay nearby (and asymptotically stable if they return). Linearize: if every eigenvalue of the Jacobian has negative real part, it is asymptotically stable.
Attractors
Sets that nearby trajectories approach and stay in: a point, a closed orbit (limit cycle) or a fractal "strange attractor" like Lorenz's butterfly. The set of initial states that end up there is its basin.
Bifurcations
Qualitative changes in behaviour as a parameter crosses a critical value: an equilibrium loses stability, a cycle is born, periods double on the road to chaos. Tipping points in climate and ecology are bifurcations.
Chaos and sensitivity to initial conditions
Deterministic systems whose nearby trajectories separate exponentially, with . Prediction is possible only up to a horizon of about : better measurements buy time only logarithmically.
Fractals
Sets with detail at every scale and non-integer dimension. The Mandelbrot set — the for which stays bounded from — is the most famous; strange attractors are fractal too.