What is it?
The continuous version for non-periodic signals: gives the amount of each frequency . It turns convolution into multiplication and differentiation into multiplication by — which is why filtering, compression and solving linear PDEs are easier in frequency space.
Why does it exist?
Linear, time-invariant systems — filters, lenses, rooms, transmission lines, the heat equation — do not mix frequencies: a sinusoid goes in, the same sinusoid comes out, scaled and shifted. In the frequency domain such a system is just a multiplication, so the Fourier transform diagonalizes it.
Intuition
Wind the signal around a circle at frequency (multiply by ) and compute the centre of mass. If the signal has a component at , the winding piles it up on one side and the centre moves away from zero; otherwise everything averages out. is that centre of mass. A narrow signal needs many frequencies (wide spectrum); a pure tone has a single spike — the time–frequency uncertainty principle.
Formal definition
Key properties: (convolution theorem), , (Plancherel). The discrete Fourier transform of samples, , is computed in by the FFT.
Formulas
- convolution theorem
- discrete Fourier transform (DFT)
- the Gaussian is its own transform
Example
A 3-second recording of A440 plus a little noise: its DFT shows a sharp peak at 440 Hz (and 880, 1320… if the
instrument has harmonics). A guitar tuner is literally this computation followed by argmax.
Why does it matter?
Audio codecs, image compression, Wi-Fi and 4G/5G (OFDM), MRI reconstruction, radar, spectroscopy, fast polynomial and integer multiplication, large convolutions — all run on Fourier transforms computed by the FFT, one of the most important algorithms ever written.
Where it shows up in computing
Spectral analysis, filtering and modulation are defined in the frequency domain.
The FFT computes the DFT in instead of .
Sampling replicates the spectrum; Nyquist's condition keeps the copies from overlapping.
OFDM (Wi-Fi, 4G/5G, DSL) sends data on many orthogonal subcarriers using inverse FFT and FFT.
Position and momentum wave functions are Fourier pairs; the uncertainty principle is a Fourier inequality.
Frequency-domain filtering, deblurring and image registration (phase correlation).
Where it shows up in AI
Large convolutions can be computed by FFT; Fourier neural operators learn directly in frequency space.
Where is it used?
Computing topics reachable from here, through the chain of ideas that leads to them:
What depends on it
Exercises
Convolving two signals of length directly costs operations. Estimate the cost via FFT.
Solution
Three FFTs of size ~ plus a pointwise product: about vs — roughly 8000 times faster.
A signal is a short click (a narrow pulse). What does its spectrum look like? And a long pure tone?
Solution
A narrow pulse has a very wide, flat spectrum (all frequencies); a long pure tone has a narrow peak. Time width × frequency width is bounded below.