Foundations
Numbers, functions and the families of functions that the rest of calculus works with — and how a computer represents them.
16 topics
Topics
Real numbers
The number line : the rationals plus the limits of all their convergent sequences. Its defining property is completeness — every non-empty set bounded above has a least upper bound — and calculus depends on it.
Complex numbers
Numbers with . Geometrically they are points of the plane, and multiplying by is a rotation — which is why they are the natural language of oscillations, waves and signals.
Intervals
Connected pieces of the real line: , , … Closed and bounded intervals are where the big theorems of calculus (Bolzano, Weierstrass) hold.
Absolute value
is the distance from to , and the distance between two numbers. "Close to" in every definition of calculus means a small absolute value.
Inequalities
Calculus is mostly the art of bounding: proving that an error is smaller than , that a term is negligible, that an algorithm takes at most so many steps. The tools are the triangle inequality, AM–GM, Cauchy–Schwarz and Jensen.
Functions
A rule that assigns to each input of a set exactly one output in a set . Calculus studies how outputs change when inputs change; computing is, quite literally, evaluating functions.
Domain and range
Where a function is defined and which values it actually takes. Getting them wrong is the mathematical version of a runtime error: or have no real value.
Composition
Applying one function after another: . Deep networks, compilers and data pipelines are long compositions, and the chain rule tells how to differentiate them.
Inverse functions
undoes : . It exists when is one-to-one; its graph is the mirror image of 's across the line .
Polynomial functions
. Computed with additions and multiplications only, they are what a processor evaluates best — and other functions are approximated by them (Taylor, interpolation).
Rational functions
Quotients of polynomials . They blow up at the zeros of (poles) and are the exact form of the transfer functions of linear filters and control systems.
Exponential functions
, and above all : the only function (up to a factor) that is its own derivative. It models anything whose rate of change is proportional to its size — populations, interest, radioactive decay, and exponential algorithms.
Logarithmic functions
The inverse of the exponential: is the power you raise to in order to get . Logarithms turn products into sums, which is why they appear in algorithm costs, information theory and every loss function based on likelihood.
Trigonometric functions
and are the coordinates of a point turning around the unit circle. They describe every rotation and every oscillation, and therefore graphics, robotics, sound and signals.
Hyperbolic functions
, , . They play for the hyperbola the role and play for the circle; is a classic activation function.
Transformations of functions
: shifting, stretching and reflecting a graph. A delay in a signal, a zoom in an image or a change of units are all such transformations.
Where this area leads in computing
λ Scientific computing and algorithms ★★★★★
- Floating point (IEEE 754)★★★★★←Real numbers, Domain and range, Logarithmic functions
- Algorithm analysis and complexity★★★★★←Inequalities, Polynomial functions, Exponential functions, Logarithmic functions
- Monte Carlo methods★★★★★←Inverse functions
- Symbolic computation (CAS)★★★★★←Real numbers, Functions
- Scientific computing★★★★★←Intervals