What is it?
Where a function is defined and which values it actually takes. Getting them wrong is the mathematical version of a runtime error: or have no real value.
Formulas
Where it shows up in computing
Outside the domain IEEE 754 returns NaN (
sqrt(-1)) or ±∞ (log(0)) instead of failing.
Where it shows up in AI
The range of the sigmoid, , is why its output can be read as a probability.
Where is it used?
Computing topics reachable from here, through the chain of ideas that leads to them:
λ Scientific computing and algorithms
- Inverse functions→Logarithmic functions→Algorithm analysis and complexity★★★★★
- Inverse functions→Logarithmic functions→Derivatives of elementary functions→Antiderivatives and indefinite integrals→Symbolic computation (CAS)★★★★★
- Inverse functions→Monte Carlo methods★★★★★
- Inverse functions→Logarithmic functions→Floating point (IEEE 754)★★★★★
- Inverse functions→Logarithmic functions→Floating point (IEEE 754)→Scientific computing★★★★★
ℒ AI and machine learning
- Inverse functions→Logarithmic functions→Loss function★★★★★
- Inverse functions→Logarithmic functions→Loss function→Gradient descent★★★★★
- Inverse functions→Logarithmic functions→Maximum likelihood estimation→Logistic regression★★★★★
- Inverse functions→Logarithmic functions→Derivatives of elementary functions→Activation functions★★★★★
- Inverse functions→Logarithmic functions→Loss function→Regularization★★★★★
- Inverse functions→Logarithmic functions→Loss function→Support vector machines★★★★★
- +10
What depends on it
This page has the essentials. A fuller treatment (intuition, formal definition, worked example) is on the way.