Transforms
Fourier, Laplace and Z: changing the point of view from time to frequency, where convolutions become products and differential equations become algebra. The mathematics of audio, images, compression and telecommunications.
6 topics
Topics
Fourier series
Any reasonable periodic function is a sum of sines and cosines of multiples of a base frequency: . The coefficients — the spectrum — say how much of each harmonic it contains.
Fourier transform
The continuous version for non-periodic signals: gives the amount of each frequency . It turns convolution into multiplication and differentiation into multiplication by — which is why filtering, compression and solving linear PDEs are easier in frequency space.
Convolution
: a sliding weighted average of one function by another. Blur, echo, smoothing, the output of any linear time-invariant system — and, discretized, the operation that gives convolutional neural networks their name.
Laplace transform
: like Fourier but with complex , it handles growth, decay and initial conditions. Linear ODEs become algebraic equations in , and a system becomes its transfer function .
Z-transform
The discrete-time Laplace transform: , a power series in . Difference equations (digital filters, discrete controllers) become rational functions of ; stability means poles inside the unit circle. It is the bridge from calculus to digital signal processing.
Wavelets
Localized oscillations at several scales: unlike sines, they say when a frequency occurs. Multiresolution analysis underlies JPEG 2000, denoising and some feature extractors.
Where this area leads in computing
⚙ Robotics and control ★★★★★
∿ Signals, media and vision ★★★★★
- Signal processing★★★★★←Fourier series, Fourier transform, Convolution
- Sampling theorem (Nyquist–Shannon)★★★★★←Fourier transform
- Fast Fourier transform (FFT)★★★★★←Fourier transform
- Digital filters★★★★★←Convolution, Z-transform
- Image processing and computer vision★★★★★←Fourier transform, Convolution, Wavelets
- Telecommunications (modulation, OFDM)★★★★★←Fourier transform
- Media compression (JPEG, MP3, video)★★★★★←Fourier series, Wavelets