What is it?
is the limit of the partial sums . Terms going to zero is necessary but not sufficient: the harmonic series diverges, while .
Why does it exist?
Zeno's paradox (infinitely many steps, finite distance), the decimal expansion of , the total cost of an infinite process: we need to know when adding infinitely many numbers gives a finite answer, and how fast the partial sums get there.
Intuition
The harmonic series is the classic warning. Its terms shrink to zero, but group them: , , … infinitely many halves. It grows like — so slowly that the sum of the first terms is only about 100, yet it never stops.
Formal definition
converges to if . Necessary condition: . Cauchy criterion: converges iff for .
Formulas
- harmonic numbers
- p-series
Why does it matter?
Algorithm analysis is full of series: the expected number of comparisons of quicksort is because of ; the coupon collector needs draws; amortized costs are geometric sums. In numerics, series give the values of functions — and summing them in floating point needs care.
Where it shows up in computing
Costs of loops and recursions are sums; harmonic numbers give quicksort's average.
Summing many terms accurately requires compensated (Kahan) or pairwise summation.
Where is it used?
Computing topics reachable from here, through the chain of ideas that leads to them:
∿ Signals, media and vision
- Fourier series→Signal processing★★★★★
- Fourier series→Fourier transform→Sampling theorem (Nyquist–Shannon)★★★★★
- Fourier series→Fourier transform→Fast Fourier transform (FFT)★★★★★
- Power series→Z-transform→Digital filters★★★★★
- Fourier series→Signal processing→Media compression (JPEG, MP3, video)★★★★★
- Fourier series→Fourier transform→Telecommunications (modulation, OFDM)★★★★★
- +1
What depends on it
Exercises
Does converge?
Solution
No: for , and diverges (comparison with the harmonic series).
Quicksort makes about comparisons on average. Estimate it for .
Solution
, so about comparisons ().