The operations used to perform row reduction are called row operations.
- Type I
- Switching two rows;
- Type II
- Multiplying a row by a non-zero scalar ;
- Type III
- Adding a multiple of one row to another distinct row.
It is quite easy to see the first two types of row operations won’t change the solution set, and it can also be shown that the third doesn’t either.
The following theorem tells us about when this happens.
Now to proceed in an efficient manner, it will be convenient to represent a system in terms of its essential information. This is accomplished by means of the augmented coefficient matrix or ACM corresponding to a given system. Starting with the system appearing in (eqn:sys), its associated augmented coefficient matrix is given by This is a matrix with rows and columns. Executing a number of row operations and then computing the ACM gives the same result as first forming the ACM and performing the same set of row operations on that matrix. Because the ACM contains all of the information relevant for solving the system, and is less cumbersome to work with, we will always form the ACM first, and perform row operations on that matrix.
The simplified form in which we would like to get our matrix is referred to as reduced row echelon form. This is a term which applies to matrices in general, not just augmented coefficient matrices.
- Every row of zeros lies below every non-zero row;
- the left-most non-zero entry of a non-zero row is 1 (called a leading 1);
- if both row and row are non-zero, the leading 1 in row appears to the right of the leading row in row .
It is in reduced row-echelon form if in addition to being in row echelon form it satisfies the property that
- In every column that contains a leading 1, that leading 1 is the only non-zero entry.
The matrix is not in row echelon form, while is in row echelon but not reduced row echelon form, and is in reduced row echelon form (the reader should check this, and understand why for each example). The main fact we will need to know is
The reduced row echelon form of a matrix is unique; for that reason we will refer to the reduced row echelon form of a matrix , and write it as . When is the ACM of a system of equations, tells us essentially everything we would like to know about the original system. The way it does this is summarized by the next result.
- is inconsistent precisely when contains a row of the form
- has a unique solution precisely when each column of except the right-most column contains a leading 1;
- has infinitely many solutions when it is i) consistent, and ii) at least one of the first n columns of does not contain a leading 1.
In the last case, the solution set is parametrized by the variables appearing in the original system which are indexed by the columns of to the left of the bar which do not contain a leading 1.
It is important to note that when is the ACM of a system, is the ACM of another system equivalent to the original one, which is the reduced row echelon form of the original system. In this reduced row echelon form, it is possible for an equation to consist of all zeros. If it does, we do not delete it from the system, because we want to maintain the original dimensions.
In this case, every column to the left of the bar dividing the coefficient matrix from the augmented part contains a leading 1. Hence there is a unique solution.