Essential Vocabulary

Here is a link to a list of these terms on Quizlet

Fundamental subspaces of a matrix

is the orthogonal complement of , and is the orthogonal complement of .

Gram-Schmidt process

An iterative process which constructs an orthogonal basis for a subspace. The idea is to build the orthogonal set one vector at a time, by taking a vector not in the span of the vectors in the current iteration of the set, and subtracting its orthogonal projection onto each of those vectors.

Orthogonal Basis

A set of orthogonal vectors that spans a subspace. (Any orthogonal set of vectors must be linearly independent.)

Orthogonal complement of a subspace

If is a subspace, we define the orthogonal complement as the set of all vectors orthogonal to every vector in , i.e.,

Orthogonal Decomposition Theorem

Let be a subspace of and let . Then there exist unique vectors and such that .

Orthogonal matrices

An matrix is called an orthogonal matrix if its columns form an orthonormal set. This will happen if and only if its rows form an orthonormal set. Note also that is an orthogonal matrix if and only if it is an invertible matrix such that .

Orthogonal projection onto a subspace

Let be a subspace of with orthogonal basis . If is in , the vector is called the orthogonal projection of onto .

Orthogonal set of vectors

Let be a set of nonzero vectors in . Then this set is called an orthogonal set if for all . Moreover, if for (i.e. each vector in the set is a unit vector), we say the set of vectors is an orthonormal set.

Orthogonally diagonalizable matrix

An matrix is said to be orthogonally diagonalizable if an orthogonal matrix can be found such that is diagonal.

Orthonormal basis

A set of orthonormal vectors that spans a subspace. (Any orthogonal set of vectors must be linearly independent by Theorem orthbasis.)

Orthonormal set of vectors

Let be a set of nonzero vectors in . Then this set is called an orthogonal set if for all . Moreover, if for (i.e. each vector in the set is a unit vector), we say the set of vectors is an orthonormal set.

Properties of orthogonal matrices

If is an orthogonal matrix, then...

(a)
is orthogonal,
(b)
,
(c)
if is an eigenvalue of , then ,
(d)
the product of with any other orthogonal matrix will be an orthogonal matrix (i.e. orthogonal matrices are closed under matrix multiplication),

and

(e)
is a length-preserving and angle-preserving linear transformation.

QR factorization

Let be an matrix with independent columns. A QR-factorization of expresses it as where is with orthonormal columns and is an invertible and upper triangular matrix with positive diagonal entries.

Rank-Nullity Theorem for matrices (th:matrixranknullity)

Let be an matrix. Then This implies that the dimension of a subspace of plus the dimension of its orthogonal complement equals .

Spectral Theorem

If is a real matrix, then is symmetric if an only if is orthogonally diagonalizable.

2024-09-06 02:11:15