Since differentiation is a linear operation, it is easy to show that
dtd(A+B)=dtdA+dtdBanddtd(cA)=cdtdA
The derivative of a matrix product is given as
dtd(AB)=dtdAB+AdtdB=A˙B+AB˙(10.2)
We can prove Eq. (10.2) as follows. Let A be an m×n matrix and B an n×p matrix. Then, if
C = AB
from Eq. (B.33), we have
cik=j=1∑naijbjk
and
c˙ik=dikj=1∑na˙ijbjk+eikj=1∑naijb˙jk
or
c˙ik=dik+eik
(10.3)
Equation (10.3) along with the multiplication rule clearly indicates that dik is the ikth element of matrix AB˙ and eik is the ikth element of matrix AB˙ . Equation (10.2) then follows.
For an (n×n) square matrix A, any vector x (x = 0) that satisfies the equation
Ax=λx(10.4)
is an eigenvector (or characteristic vector), and λ is the corresponding eigenvalue (or characteristic value) of A. Equation (10.4) can be expressed as
(A−λI)x=0or(λI−A)x=0
The solution for this set of homogeneous equations exists if and only if
Equation (10.5) is known as the characteristic equation of matrix A and can be expressed as
Q(λ)=∣λI−A∣=λn+an−1λn−1+⋯+a1λ+a0λ0=0
(10.6)
Q(λ) is called the characteristic polynomial of matrix A. The n zeros of the characteristic polynomial are the eigenvalues of A and, corresponding to each eigenvalue, there is an eigenvector that satisfies Eq. (10.4).
The Cayley–Hamilton theorem states that every n×n matrix A satisfies its own characteristic equation. In other words, Eq. (10.6) is valid if λ is replaced by A:
Q(A)=An+an−1An−1+⋯+a1A+a0A0=0
(10.7)
FUNCTIONS OF A MATRIX
We now demonstrate the use of the Cayley–Hamilton theorem [Eq. (10.7)] to evaluate functions of an n×n square matrix A.
Consider a function f(λ) in the form of an infinite power series:
f(λ)=α0+α1λ+α2λ22+⋯=i=0∑∞αiλi
(10.8)
Since λ, being an eigenvalue (characteristic root) of A, satisfies the characteristic equation [Eq. (10.6)], we can write
λn=−an−1λn−1−an−2λn−2−⋯−a1λ−a0
(10.9)
If we multiply both sides by λ, the left-hand side is λ*n+1, and the right-hand side contains the terms λn, λn−1, … , λ. Using Eq. (10.9), we substitute λn* in terms of λ*n−1, λn−2,…, λ so that the highest power on the right-hand side is reduced to n − 1. Continuing in this way, we see that λn+k* can be expressed in terms of λ*n−1, λn−2,…,λ for any k. Hence, the infinite series on the right-hand side of Eq. (10.8) can always be expressed in terms of λn−1, λn*−2,…,λ and a constant as
f(λ)=β0+β1λ+β2λ2+⋯+βn−1λn−1
(10.10)
If we assume that there are n distinct eigenvalues λ1, λ2, … , λn, then Eq. (10.10) holds for these n values of λ. The substitution of these values in Eq. (10.10) yields n simultaneous equations
Since A also satisfies Eq. (10.9), we may advance a similar argument to show that if f(A) is a function of a square matrix A expressed as an infinite power series in A, then
f(A)=α0I+α1A+α2A2+⋯=i=0∑∞αiAi
and, as argued earlier, the right-hand side can be expressed by using terms of power less than or equal to n−1,
f(A)=β0I+β1A+β2A2+⋯+βn−1An−1=i=0∑n−1βiAi
(10.12)
in which the coefficients βis are found from Eq. (10.11). If some of the eigenvalues are repeated (multiple roots), the results are somewhat modified.
We shall demonstrate the utility of this result with the following two examples.