Differential and linear approximation

Level UniversityDifficulty ★★★★★Concept⌖ Open in the map

What is it?

Near aa, f(a+h)≈f(a)+f′(a) hf(a + h) \approx f(a) + f'(a)\,h. The differential df=f′(x) dx\dd f = f'(x)\,\dd x is that best linear approximation; it tells how an error in the input propagates to the output.

Formulas

f(a+h)=f(a)+f′(a) h+o(h)f(a + h) = f(a) + f'(a)\,h + o(h)
∣Δf∣∣f∣≈∣xf′(x)f(x)∣∣Δx∣∣x∣\frac{|\Delta f|}{|f|} \approx \left|\frac{x f'(x)}{f(x)}\right|\frac{|\Delta x|}{|x|}
relative error amplification (condition number)

Where it shows up in computing

  • Scientific computing★★★★★frequentScientific computing and algorithms

    First-order error propagation estimates how measurement and rounding errors affect results.

  • Control theory★★★★★frequentRobotics and control

    Nonlinear plants are linearized around an operating point and controlled with linear theory.

Where is it used?

Computing topics reachable from here, through the chain of ideas that leads to them:

What depends on it

Exercises

1Applied

Estimate 4.1\sqrt{4.1} with the differential of x\sqrt x at x=4x = 4.

Solution

4.1≈2+124⋅0.1=2.025\sqrt{4.1} \approx 2 + \frac{1}{2\sqrt4}\cdot 0.1 = 2.025 (true value 2.02485…2.02485…).

This page has the essentials. A fuller treatment (intuition, formal definition, worked example) is on the way.

↑ ↓ to navigate · ↵ · Esc