Videos for Section 7.2


An operator (or matrix) is called Hermitian if it equals its adjoint (or conjugate-transpose, aka Hermitian conjugate). Hermitian operators $H: V \to V$ have some wonderful properties:

  1. All of the eigenvalues of $H$ are real.
  2. Eigenvectors with different eigenvalues are orthogonal.
  3. If $V$ is finite-dimensional, then $H$ is diagonalizable. (There is an analogous statement for infinite-dimensional spaces, called the spectral theorem, but we're not ready for it yet.)
  4. If $V$ is finite dimensional, then there is an orthogonal basis of $V$ consisting of eigenvectors of $H$.
In the first video, we go through a few examples, prove the first two properties, and show how to construct the orthogonal basis (assuming that $H$ is diagonalizable).

In the second video, we provide 3 proofs that $H$ is diagonalizable. The first two proofs are repeated below the video. The third proof, by induction on the dimension of $V$, is found in the book. In the video we also show that any diagonalizable operator with real eigenvalues and an orthogonal basis of eigenvectors must be Hermitian.

First proof, using power vectors: If $H$ isn't diagonalizable, then we can still find a basis of $V$ consisting of power vectors. This means that there must be a power vector ${\bf x}$ of $H$ of degree 2 that isn't an eigenvector. In other words, $$ (H - \lambda I)^2 {\bf x} = 0 \hbox{ but } (H - \lambda I) {\bf x} \ne 0.$$ Note that $(H - \lambda I)^\dagger = H^\dagger - \bar \lambda I = H - \lambda I$, since $H$ is Hermitian and all eigenvalues are real. We then compute \begin{eqnarray*} 0 & = & \langle {\bf x} | 0 \rangle \cr & = & \langle {\bf x} | (H - \lambda I)(H-\lambda I) {\bf x} \rangle \cr & = & \langle (H - \lambda I)^\dagger {\bf x} | (H-\lambda I) {\bf x} \rangle \cr & = & \langle (H - \lambda I) {\bf x} | (H-\lambda I) {\bf x} \rangle \cr & = & |(H - \lambda I){\bf x}|^2 \ne 0 \end{eqnarray*} which is a contradiction.

Second proof, using perturbations: Suppose $H$ is Hermitian and non-diagonalizable. We can perturb $H$ into a matrix $H_\epsilon$ that is still Hermitian, but whose characteristic polynomial has distinct roots. $H_\epsilon$ is then diagonalizable. Since $H_\epsilon$ is Hermitian, the eigenvectors of $H_\epsilon$ are orthogonal. As $\epsilon \to 0$, the eigenvalues and eigenvectors of $H_\epsilon$ approach eigenvalues and eigenvectors of $H$. Since the eigenvectors of $H_\epsilon$ are orthogonal, they must all approach different limits. (Strictly speaking we need to invoke compactness and subsequences to show that these limits exist) So $H$ has as many eigenvectors as $H_\epsilon$, and so is diagonalizable.

This argument depends crucially on the fact that the eigenvectors of a Hermitian operator (with different eigenvalues) are orthogonal. If you try to apply this argument to a non-Hermitian matrix such as $A = \begin{pmatrix} 0 & 1 \cr 0 & 0 \end{pmatrix}$, it doesn't work. The perturbed matrix $A_\epsilon = \begin{pmatrix} 0 & 1 \cr \epsilon^2 & 0 \end{pmatrix}$ has eigenvectors $\begin{pmatrix} 1 \cr \pm \epsilon \end{pmatrix}$ that are almost parallel, and as $\epsilon \to 0$ both eigenvectors have the same limit.