Let U⊆RkU\subseteq\mathbb{R}^k be and let f:U→Rmf:U\to\mathbb{R}^m. The function ff is (Fréchet) differentiable at a∈Ua\in U if there exists a A:Rk→RmA:\mathbb{R}^k\to\mathbb{R}^m such that

lim⁡h→0∥f(a+h)−f(a)−Ah∥2∥h∥2=0.\lim_{h\to 0}\frac{\|f(a+h)-f(a)-A h\|_2}{\|h\|_2}=0.

The map AA is uniquely determined when it exists and is called the (total) derivative of ff at aa, denoted Df(a)Df(a).

This definition captures the best linear approximation of ff near aa. In coordinates, Df(a)Df(a) is represented by the Jf(a)J_f(a) when ff has continuous .

Examples
  • If f(x)=Ax+bf(x)=Ax+b is affine (with AA an m×km\times k matrix), then Df(a)=ADf(a)=A for all aa.
  • If f:R2→Rf:\mathbb{R}^2\to\mathbb{R}, f(x,y)=x2+y2f(x,y)=x^2+y^2, then Df(a)Df(a) is the h↦2⟨a,h⟩h\mapsto 2\langle a,h\rangle (equivalently, gradient dot hh).
  • Existence of all at aa does not necessarily imply existence of Df(a)Df(a) (Fréchet differentiability).