Linear Combinations of Vectors

When studying vectors, the two main operations we have learned about are vector addition and scalar multiplication. Both are involved in the important concept of a linear combination of vectors.

For example, \(\begin{bmatrix} -4\\9\\-10\\-1\end{bmatrix}\) is a linear combination of \(\begin{bmatrix} -1\\3\\-3\\0\end{bmatrix}\), \(\begin{bmatrix} 2\\0\\1\\4\end{bmatrix}\) and \(\begin{bmatrix} 0\\1\\-1\\1\end{bmatrix}\) because

\[\begin{bmatrix} -4\\9\\-10\\-1\end{bmatrix}=2\begin{bmatrix} -1\\3\\-3\\0\end{bmatrix}+(-1)\begin{bmatrix} 2\\0\\1\\4\end{bmatrix}+3\begin{bmatrix} 0\\1\\-1\\1\end{bmatrix}\]

In this section we will focus on vectors in \(\RR ^2\) and \(\RR ^3\).

Visualizing Linear Combinations in \(\RR ^2\) and \(\RR ^3\)

Let’s start by visualizing linear combinations of two vectors in \(\RR ^2\).

Answer the questions below using the GeoGebra interactive. To use the interactive, you can
(a)
Change vectors \(\vec {v}\) and \(\vec {w}\) by dragging the tips of these vectors.
(b)
Change the coefficients \(k_1\) and \(k_2\) of the linear combination by using sliders.

(a)
Let \(\vec {w}=\begin{bmatrix}1\\2\end{bmatrix}\) and \(\vec {v}=\begin{bmatrix}1\\-1\end{bmatrix}\). Find \(k_1\) and \(k_2\) such that \(k_1\vec {w}+k_2\vec {v}=\begin{bmatrix}4\\-1\end{bmatrix}\)
\[k_1=\answer {1},\quad k_2=\answer {3}\]
(b)
Let \(\vec {w}=\begin{bmatrix}1\\2\end{bmatrix}\) and \(\vec {v}=\begin{bmatrix}-2\\0\end{bmatrix}\). Find \(k_1\) and \(k_2\) such that \(k_1\vec {w}+k_2\vec {v}=\begin{bmatrix}3\\-2\end{bmatrix}\)
\[k_1=\answer {-1},\quad k_2=\answer {-2}\]
(c)
Use the same vectors \(\vec {w}\) and \(\vec {v}\) as in the previous part. Do you think it is possible to express any vector in \(\RR ^2\) as a linear combination of \(\vec {w}\) and \(\vec {v}\)? Yes, No
(d)
Let \(\vec {w}=\begin{bmatrix}4\\2\end{bmatrix}\) and \(\vec {v}=\begin{bmatrix}-2\\-1\end{bmatrix}\). Do you think it is possible to express any vector in \(\RR ^2\) as a linear combination of \(\vec {w}\) and \(\vec {v}\)? Yes, No

Visualizing linear combinations of vectors in \(\RR ^3\) is more difficult than doing so in \(\RR ^2\). The following Exploration will help you do this.

We will start by visualizing linear combinations of two vectors, \(\vec {u}\) and \(\vec {v}\), in \(\RR ^3\). To use the interactive below, define vectors \(\vec {u}\) and \(\vec {v}\). Use sliders to change the coefficients \(k_1\) and \(k_2\) of the linear combination. You will see the linear combination \(k_1\vec {u}+k_2\vec {v}\) as the pink vector along the diagonal of the parallelogram determined by \(\vec {u}\) and \(\vec {v}\).

RIGHT-CLICK and DRAG the left panel to rotate the image.

We will now consider three vectors. Define vectors \(\vec {u}\), \(\vec {v}\) and \(\vec {w}\). Use sliders to change the coefficients \(k_1, k_2\) and \(k_3\) of the linear combination. The linear combination \(k_1\vec {u}+k_2\vec {v}+k_3\vec {w}\) is shown as the pink vector along the diagonal of the parallelepiped.

RIGHT-CLICK and DRAG the left panel to rotate the image.

Geometry of Linear Combinations

The method we used in Example 4 to express the given vector as a linear combination of two other vectors is sufficiently useful that we summarize the steps.

This GeoGebra interactive will allow you to go through the steps given in Procedure 6 for a combination of vectors of your choice. To use the interactive
(a)
Enter components of vectors \(\vec {u}\) and \(\vec {v}\).
(b)
Enter components of vector \(\vec {w}\) that you want to express as a linear combination of \(\vec {u}\) and \(\vec {v}\).
(c)
Use the navigation bar to go through the steps of Procedure 6

From Geometry to Algebra of Linear Combinations

One of the stipulations in Procedure 6 is that vectors \(\vec {u}\) and \(\vec {v}\) should be non-collinear. You can use the interactive in Exploration to investigate what happens when \(\vec {u}\) and \(\vec {v}\) are collinear. The following example examines what happens from a geometric as well as an algebraic standpoint.

Practice Problems

Solve a system of linear equations to express \(\begin{bmatrix}-1\\7\end{bmatrix}\) as a linear combination of \(\begin{bmatrix}1\\2\end{bmatrix}\) and \(\begin{bmatrix}-1\\1\end{bmatrix}\).

System of linear equations:

\[\begin{array}{ccccc} \answer {1}a & +&\answer {-1}b&= &\answer {-1} \\ \answer {2}a& +&\answer {1}b&=&\answer {7} \end{array}\]

Values of \(a\) and \(b\):

\[a=\answer {2}\quad \text {and}\quad b=\answer {3}\]

Linear Combination:

\[\begin{bmatrix}-1\\7\end{bmatrix}=\answer {2}\begin{bmatrix}1\\2\end{bmatrix}+\answer {3}\begin{bmatrix}-1\\1\end{bmatrix}\]
Use Procedure 6 to express \(\begin{bmatrix}-3\\0\end{bmatrix}\) as a linear combination of \(\begin{bmatrix}2\\4\end{bmatrix}\) and \(\begin{bmatrix}-1\\1\end{bmatrix}\).

Linear Combination:

\[\begin{bmatrix}-3\\0\end{bmatrix}=\answer {-0.5}\begin{bmatrix}2\\4\end{bmatrix}+\answer {2}\begin{bmatrix}-1\\1\end{bmatrix}\]
Use two different approaches (algebraic and geometric) to explain why the vector \(\begin{bmatrix}5\\1\end{bmatrix}\) cannot be expressed as a linear combination of vectors \(\begin{bmatrix}2\\-1\end{bmatrix}\) and \(\begin{bmatrix}-4\\2\end{bmatrix}\).
We have seen Procedure 6 applied to vectors in \(\RR ^2\). The same process can, in certain cases be applied to vectors in \(\RR ^3\). Follow the steps in Procedure 6 to express one vector as a linear combination of two given vectors.

The following GeoGebra interactive shows vectors \({\bf u}=\begin{bmatrix}3\\0\\-1\end{bmatrix}\), \({\bf v}=\begin{bmatrix}1\\-2\\1\end{bmatrix}\) and \({\bf w}=\begin{bmatrix}7\\4\\-5\end{bmatrix}\). Use the navigation bar to click through the construction steps. RIGHT-CLICK and DRAG to rotate the image.

(a)
Can \(\vec {w}\) be expressed as a linear combination of \(\vec {u}\) and \(\vec {v}\)?
No, because \(\vec {w}\) is not between \(\vec {u}\) and \(\vec {v}\). Yes, because all three vectors are in the same plane. Yes, because all three vectors are in the same plane, AND \(\vec {u}\) and \(\vec {v}\) are not collinear.
(b)
Use the navigation bar at the bottom of the interactive window to view construction steps of Procedure 6 applied to vectors \(\vec {u}\), \(\vec {v}\) and \(\vec {w}\). (Right-click and drag to rotate the image.) Use the final image to express \(\bf w\) as a linear combination of \(\bf v\) (blue) and \(\bf u\) (red).
\[{\bf w}=\answer {-2}{\bf v}+\answer {3}{\bf u}\]
The following GeoGebra interactive shows vectors \({\bf v}=\begin{bmatrix}1\\-2\\1\end{bmatrix}\), \({\bf u}=\begin{bmatrix}3\\0\\-1\end{bmatrix}\), and \({\bf w}=\begin{bmatrix}7\\4\\0\end{bmatrix}\). RIGHT-CLICK and DRAG to rotate the image. Use geometry to explain why \(\bf w\) cannot be expressed as a linear combination of \(\bf v\) and \(\bf u\).

We can also show that \(\bf w\) is not a linear combination of \(\bf v\) and \(\bf u\) algebraically by attempting to solve a system of equations corresponding to

\[x_1{\bf v}+x_2{\bf u}={\bf w}\]
Set up the system of equations
\[\begin{array}{ccccccc} \answer {1}x_1 & +&\answer {3}x_2&= &\answer {7} \\ \answer {-2}x_1& +&\answer {0}x_2&=&\answer {4}\\ \answer {1}x_1& +&\answer {-1}x_2&=&\answer {0} \end{array}\]

Find the reduced row echelon form.

\[\left [\begin{array}{cc|c} \answer {1}&\answer {0}&\answer {0}\\\answer {0}&\answer {1}&\answer {0}\\\answer {0}&\answer {0}&\answer {1} \end{array}\right ]\]