Skip to main content

Section 1.2 Row Reduction and Echelon Forms

Worksheet Worksheet

Definition 1.13. Echelon Form and Row Row Reduced Echelon Form.

A rectangular matrix is in echelon form (REF) if:
  1. All zero rows (if any) are at the bottom.
  2. The first nonzero entry (or leading entry) of a row is to the right of any leading entry in the row above it.
  3. All entries below a leading entry are zero.
A matrix in echelon form is in row reduced echelon form (RREF) if additionally:
  1. All leading entries equal \(1\text{.}\)
  2. Each leading entry is the only nonzero entry in its column.

Example 1.14.

Let \(\blacksquare\) denote a nonzero number, and \(\ast\) denote any number.
\(\begin{bmatrix} 0 \amp \blacksquare \amp \ast \amp \ast \amp \ast \amp \ast \amp \ast \amp \ast \\ 0 \amp 0 \amp 0 \amp \blacksquare \amp \ast \amp \ast \amp \ast \amp \ast \\ 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp \blacksquare \amp \ast \amp \ast \\ 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp \blacksquare \amp \ast \\ 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \end{bmatrix}\) is in REF and \(\begin{bmatrix} 0 \amp 1 \amp \ast \amp 0 \amp \ast \amp 0 \amp 0 \amp \ast \\ 0 \amp 0 \amp 0 \amp 1 \amp \ast \amp 0 \amp 0 \amp \ast \\ 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 1 \amp 0 \amp \ast \\ 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 1 \amp \ast \\ 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \amp 0 \end{bmatrix}\) is in RREF.

Exercise Group.

Determine whether each matrix is in RREF, REF, or neither.

Definition 1.15. Pivot Position and Pivot Column.

A pivot position in a matrix \(A\) is a location in \(A\) that corresponds to a leading \(1\) in the RREF of \(A\text{.}\) A pivot column is a column of \(A\) that contains a pivot position.

Example 1.16.

Express the matrix in row reduced echelon form and identify the pivot columns.
\begin{equation*} \left[ \begin{array}{rrrr} 0 \amp -3 \amp -6 \amp 4 \\ -1 \amp -2 \amp -1 \amp 3 \\ -2 \amp -3 \amp 0 \amp 3 \end{array} \right] \end{equation*}
Solution.
\(\begin{eqnarray*} \begin{bmatrix} 0 \amp -3 \amp -6 \amp 4 \\ -1 \amp -2 \amp -1 \amp 3 \\ -2 \amp -3 \amp 0 \amp 3 \end{bmatrix} \amp \overset{\text{Swap $R_1$ and $R_2$}}{\Huge \sim} \amp \begin{bmatrix} -1 \amp -2 \amp -1 \amp 3 \\ 0 \amp -3 \amp -6 \amp 4 \\ -2 \amp -3 \amp 0 \amp 3 \end{bmatrix} \\ \amp \overset{-R_1 \rightarrow R_1}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 2 \amp 1 \amp -3 \\ 0 \amp -3 \amp -6 \amp 4 \\ -2 \amp -3 \amp 0 \amp 3 \end{bmatrix} \\ \amp \overset{R_3 + 2R_1 \rightarrow R_3}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 2 \amp 1 \amp -3 \\ 0 \amp -3 \amp -6 \amp 4 \\ 0 \amp 1 \amp 2 \amp -3 \end{bmatrix} \\ \amp \overset{\text{Swap $R_2$ and $R_3$}}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 2 \amp 1 \amp -3 \\ 0 \amp 1 \amp 2 \amp -3 \\ 0 \amp -3 \amp -6 \amp 4 \end{bmatrix} \\ \amp \underset{R_3 + 3R_2 \rightarrow R_3}{\overset{R_1 - 2R_2 \rightarrow R_1}{\Huge \sim}} \amp \begin{bmatrix} 1 \amp 0 \amp -3 \amp 3 \\ 0 \amp 1 \amp 2 \amp -3 \\ 0 \amp 0 \amp 0 \amp -5 \end{bmatrix} \\ \amp \overset{-\frac{1}{5}R_3 \rightarrow R_3}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 0 \amp -3 \amp 3 \\ 0 \amp 1 \amp 2 \amp -3 \\ 0 \amp 0 \amp 0 \amp 1 \end{bmatrix} \\ \amp \underset{R_2 + 3R_3 \rightarrow R_2}{\overset{R_1 - 3R_3 \rightarrow R_1}{\Huge \sim}} \amp \begin{bmatrix} 1 \amp 0 \amp -3 \amp 0 \\ 0 \amp 1 \amp 2 \amp 0 \\ 0 \amp 0 \amp 0 \amp 1 \end{bmatrix} \end{eqnarray*}\)
Therefore, we can see that the pivot columns are columns 1, 2, and 4.

Row Reduction Algorithm (Steps to RREF).

The algorithm below produces a matrix in RREF.
  • Step 1a: Swap the first row with a lower one so the leftmost nonzero entry is in the first row.
  • Step 1b: Scale the first row so that its leading entry equals \(1\text{.}\)
  • Step 1c: Use row replacement so all entries above and below this \(1\) are \(0\text{.}\)
  • Step 2a: Swap the second row with a lower one so the leftmost nonzero entry below the first row is in the second row.
  • Step 2b: Scale the second row so that its leading entry equals \(1\text{.}\)
  • Step 2c: Use row replacement so all entries above and below this \(1\) are \(0\text{.}\)
  • Continue: Repeat these steps for each subsequent row until the matrix is in RREF.

Example 1.17.

Use the algorithm above to convert the following matrix into RREF.
\begin{equation*} \left[ \begin{array}{rrrr} 0 \amp 2 \amp 7 \amp 6 \\ 3 \amp 6 \amp 0 \amp -3 \\ 2 \amp 8 \amp 12 \amp 6 \end{array} \right] \end{equation*}
Solution.
\(\begin{eqnarray*} \begin{bmatrix} 0 \amp 2 \amp 7 \amp 6 \\ 3 \amp 6 \amp 0 \amp -3 \\ 2 \amp 8 \amp 12 \amp 6 \end{bmatrix} \amp \overset{\text{Swap $R_1$ and $R_2$}}{\Huge \sim} \amp \begin{bmatrix} 3 \amp 6 \amp 0 \amp -3 \\ 0 \amp 2 \amp 7 \amp 6 \\ 2 \amp 8 \amp 12 \amp 6 \end{bmatrix} \\ \amp \underset{\frac{1}{2}R_3 \rightarrow R_3}{\overset{\frac{1}{3}R_1 \rightarrow R_1}{\Huge \sim}} \amp \begin{bmatrix} 1 \amp 2 \amp 0 \amp -1 \\ 0 \amp 2 \amp 7 \amp 6 \\ 1 \amp 4 \amp 6 \amp 3 \end{bmatrix} \\ \amp \overset{R_3 - R_1 \rightarrow R_3}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 2 \amp 0 \amp -1 \\ 0 \amp 2 \amp 7 \amp 6 \\ 0 \amp 2 \amp 6 \amp 4 \end{bmatrix} \\ \amp \overset{\text{Swap $R_2$ and $R_3$}}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 2 \amp 0 \amp -1 \\ 0 \amp 2 \amp 6 \amp 4 \\ 0 \amp 2 \amp 7 \amp 6 \end{bmatrix} \\ \amp \overset{\frac{1}{2}R_2 \rightarrow R_2}{\Huge \sim} \amp \begin{bmatrix} 1 \amp 2 \amp 0 \amp -1 \\ 0 \amp 1 \amp 3 \amp 2 \\ 0 \amp 2 \amp 7 \amp 6 \end{bmatrix} \\ \amp \underset{R_3 - 2R_2 \rightarrow R_3}{\overset{R_1 - 2R_2 \rightarrow R_1}{\Huge \sim}} \amp \begin{bmatrix} 1 \amp 0 \amp -6 \amp -5 \\ 0 \amp 1 \amp 3 \amp 2 \\ 0 \amp 0 \amp 1 \amp 2 \end{bmatrix} \\ \amp \underset{R_2 - 3R_3 \rightarrow R_2}{\overset{R_1 + 6R_3 \rightarrow R_1}{\Huge \sim}} \amp \begin{bmatrix} 1 \amp 0 \amp 0 \amp 7 \\ 0 \amp 1 \amp 0 \amp -4 \\ 0 \amp 0 \amp 1 \amp 2 \end{bmatrix}\end{eqnarray*}\)

Definition 1.18. Pivot Variables and Free Variables.

Variables in a system that correspond to pivot column in the augmented matrix are called pivot variables. The other variables in the system are called free variables. This is because, if the system is consistent, then any choice of the free variables will lead to a valid solution.

Example 1.19.

Determine the pivot variables and the free variables for the system represented below.
\begin{equation*} \left[ \begin{array}{rrrrr|r} 1 \amp 3 \amp 0 \amp 7 \amp 2 \amp 4 \\ 0 \amp 0 \amp 2 \amp 0 \amp 4 \amp -2 \\ 0 \amp 0 \amp 0 \amp -3 \amp 0 \amp 0 \\ \end{array} \right] \end{equation*}
Solution.
Notice that the pivots are in columns 1, 3, and 4. So the pivot variables are \(x_1, x_3, \text{ and } x_4\text{.}\) Therefore, the free variables are \(x_2 \text{ and } x_5\text{.}\)