Span

Linear Combinations Revisited

Recall that a vector \(\vec {v}\) is said to be a linear combination of vectors \(\vec {v}_1, \vec {v}_2,\ldots , \vec {v}_n\) if

\[\vec {v}=a_1\vec {v}_1+ a_2\vec {v}_2+\ldots + a_n\vec {v}_n\]

for some scalars \(a_1, a_2, \ldots ,a_n\).

In part (a) of Example 1 we expressed \(\vec {u}\) as a linear combination of \(\vec {v}_1\) and \(\vec {v}_2\), and concluded that \(\vec {u}\) lies in the plane determined by \(\vec {v}_1\) and \(\vec {v}_2\). We say that \(\vec {u}\) is in the span of \(\vec {v}_1\) and \(\vec {v}_2\). In fact, every vector in the plane determined by \(\vec {v}_1\) and \(\vec {v}_2\) is in the span of \(\vec {v}_1\) and \(\vec {v}_2\). We say that \(\vec {v}_1\) and \(\vec {v}_2\) span the plane.

In contrast, vector \(\vec {w}\) of part (b) of Example 1 is not a linear combination of \(\vec {v}_1\) and \(\vec {v}_2\). We say that \(\vec {w}\) is not in the span of \(\vec {v}_1\) and \(\vec {v}_2\).

The following video takes another look at Example 1 using our new vocabulary.

Definition of Span

Redundant Vectors

If a friend told you that they have a line spanned by \(\begin{bmatrix}1\\1\end{bmatrix}\) and \(\begin{bmatrix}2\\2\end{bmatrix}\) and \(\begin{bmatrix}3\\3\end{bmatrix}\), you would probably think that your friend’s description is a little excessive. Isn’t one of the above vectors sufficient to describe the line? A line can be described as a span of one vector, but it can also be described as a span of two or more vectors. There are many advantages, however, to using the most efficient description possible. In this section we will begin to explore what makes a description “more efficient."

Consider the following collection of vectors:
\[\left \{\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right \}\]
What is the span of these vectors? A line, \(\RR ^2\), A parallelogram, A parallelepiped

In this Exploration we will examine what can happen to the span of a collection of vectors when a vector is removed from the collection.

First, let’s remove \(\begin{bmatrix}2\\1\end{bmatrix}\) from \(\left \{\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right \}\).

Which of the following is true?

\(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}\right )=\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\) \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}\right )\) is a line \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}\right )=\RR ^2\) \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}\right )\) is a parallelogram.

Removing \(\begin{bmatrix}2\\1\end{bmatrix}\) from \(\left \{\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right \}\) changed, did not change the span.

Now let’s remove \(\begin{bmatrix}-4\\2\end{bmatrix}\) from the original collection of vectors.

Which of the following is true?

\(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )=\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\) \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\) is a line \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\) is the right side of the coordinate plane. \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\) is a parallelogram.

Removing \(\begin{bmatrix}-4\\2\end{bmatrix}\) from \(\left \{\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right \}\) changed, did not change the span.

As you just discovered, removing a vector from a collection of vectors may or may not affect the span of the collection. We will refer to vectors that can be removed from a collection without changing the span as redundant. In Exploration , \(\begin{bmatrix}-4\\2\end{bmatrix}\) is redundant, while \(\begin{bmatrix}2\\1\end{bmatrix}\) is not.

Our next goal is to see what causes \(\begin{bmatrix}-4\\2\end{bmatrix}\) of Exploration to be redundant. The answer lies not in the vector itself, but in its relationship to the other vectors in the collection. Observe that \(\begin{bmatrix}-4\\2\end{bmatrix}=-2\begin{bmatrix}2\\-1\end{bmatrix}\). In other words, \(\begin{bmatrix}-4\\2\end{bmatrix}\) is a scalar multiple of another vector in the set. To see why this matters, let’s pick an arbitrary vector \(\vec {w}=\begin{bmatrix}0\\2\end{bmatrix}\) in \(\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\). Vector \(\vec {w}\) is in the span because it can be written as a linear combination of the three vectors as follows

\[\vec {w}=\begin{bmatrix}0\\2\end{bmatrix}=\begin{bmatrix}2\\-1\end{bmatrix}+ \begin{bmatrix}-4\\2\end{bmatrix}+ \begin{bmatrix}2\\1\end{bmatrix}\]

But \(\begin{bmatrix}-4\\2\end{bmatrix}\) is not essential to this linear combination because it can be replaced with \(-2\begin{bmatrix}2\\-1\end{bmatrix}\), as shown below.

\[\begin{bmatrix}0\\2\end{bmatrix}=\begin{bmatrix}2\\-1\end{bmatrix}+ \begin{bmatrix}-4\\2\end{bmatrix}+ \begin{bmatrix}2\\1\end{bmatrix}=\begin{bmatrix}2\\-1\end{bmatrix}+ (-2)\begin{bmatrix}2\\-1\end{bmatrix}+ \begin{bmatrix}2\\1\end{bmatrix}=-\begin{bmatrix}2\\-1\end{bmatrix}+ \begin{bmatrix}2\\1\end{bmatrix}\]

Regardless of what vector \(\vec {w}\) we write as a linear combination of\(\begin{bmatrix}2\\-1\end{bmatrix}\),\( \begin{bmatrix}-4\\2\end{bmatrix}\) and \(\begin{bmatrix}2\\1\end{bmatrix}\), we will always be able to replace \(\begin{bmatrix}-4\\2\end{bmatrix}\) with \(-2\begin{bmatrix}2\\-1\end{bmatrix}\), placing \(\vec {w}\) into the span of \(\begin{bmatrix}2\\-1\end{bmatrix}\) and \(\begin{bmatrix}2\\1\end{bmatrix}\), and making \(\begin{bmatrix}-4\\2\end{bmatrix}\) redundant. (Note that we can just as easily write \(\begin{bmatrix}2\\-1\end{bmatrix}=-\frac {1}{2}\begin{bmatrix}-4\\2\end{bmatrix}\), and argue that \(\begin{bmatrix}2\\-1\end{bmatrix}\) is redundant.) We conclude that only one of \(\begin{bmatrix}-4\\2\end{bmatrix}\) and \(\begin{bmatrix}2\\-1\end{bmatrix}\) is needed to maintain the span of the original three vectors. We have

\[\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )=\mbox {span}\left (\begin{bmatrix}2\\-1\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )=\mbox {span}\left (\begin{bmatrix}-4\\2\end{bmatrix}, \begin{bmatrix}2\\1\end{bmatrix}\right )\]

The left-most collection in this expression contains redundant vectors; the other two collections do not.

In Exploration we found one vector to be redundant because we could replace it with a scalar multiple of another vector in the set. The following Exploration delves into what happens when a vector in a given set is a linear combination of the other vectors.

Consider the set of vectors
\[\left \{\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right \}\]
The three vectors are shown below. RIGHT-CLICK and DRAG to rotate the interactive graph.

\(\mbox {span}\left (\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right )\) is A line, A plane, \(\RR ^3\), A parallelepiped

Can we remove one of the vectors from the set without changing the span? Observe that we can write \(\begin{bmatrix}4\\4\\-1\end{bmatrix}\) as a linear combination of the other two vectors

\begin{equation}\label {eq:redundant}\begin{bmatrix}4\\4\\-1\end{bmatrix}=2\begin{bmatrix}1\\2\\-1\end{bmatrix}+1\begin{bmatrix}2\\0\\1\end{bmatrix}\end{equation}

This means that we can write any vector in \(\mbox {span}\left (\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right )\) as a linear combination of only \(\begin{bmatrix}1\\2\\-1\end{bmatrix}\) and \(\begin{bmatrix}2\\0\\1\end{bmatrix}\) by replacing \(\begin{bmatrix}4\\4\\-1\end{bmatrix}\) with the expression in (1). For example,

\[\begin{bmatrix}7\\6\\-1\end{bmatrix}=\begin{bmatrix}1\\2\\-1\end{bmatrix}+\begin{bmatrix}2\\0\\1\end{bmatrix}+\begin{bmatrix}4\\4\\-1\end{bmatrix}=\answer {3}\begin{bmatrix}1\\2\\-1\end{bmatrix}+\answer {2}\begin{bmatrix}2\\0\\1\end{bmatrix}\]

We have

\[\mbox {span}\left (\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right )=\mbox {span}\left (\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix}\right )\]

We conclude that vector \(\begin{bmatrix}4\\4\\-1\end{bmatrix}\) is redundant. Can each of the other two vectors in the set \(\left \{\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right \}\) be considered redundant? You will address this question in the problem set.

Collections of vectors that do not contain redundant vectors are very important in linear algebra. In subsequent sections, we will formally introduce such collections as linearly independent. Collections of vectors that contain redundant vectors will be called linearly dependent.

Practice Problems

Choose the best description for the set below.
\[\mbox {span}\left (\begin{bmatrix}1\\1\\-2\end{bmatrix}, \begin{bmatrix}2\\2\\-4\end{bmatrix}\right )\]
Plane in \(\RR ^3\) Line in \(\RR ^2\) Line in \(\RR ^3\) \(\RR ^3\) \(\RR ^2\)
Choose the best description for the set below.
\[\mbox {span}\left (\begin{bmatrix}1\\-2\end{bmatrix}, \begin{bmatrix}1\\0\end{bmatrix}\right )\]
Plane in \(\RR ^3\) Line in \(\RR ^2\) Line in \(\RR ^3\) \(\RR ^3\) \(\RR ^2\)
Choose the best description for the set below.
\[\mbox {span}\left (\begin{bmatrix}-3\\1\end{bmatrix}, \begin{bmatrix}6\\-2\end{bmatrix}, \begin{bmatrix}3\\-1\end{bmatrix}\right )\]
Plane in \(\RR ^3\) Line in \(\RR ^2\) Line in \(\RR ^3\) \(\RR ^3\) \(\RR ^2\)
Which of the following pairs of sets are equal? Select all that apply.
\(V=\mbox {span}\left (\begin{bmatrix}5\\0\\0\end{bmatrix},\begin{bmatrix}10\\0\\0\end{bmatrix},\begin{bmatrix}0\\0\\-4\end{bmatrix}\right )\quad \text {and}\quad W=\mbox {span}\left (\begin{bmatrix}-2\\0\\0\end{bmatrix},\begin{bmatrix}0\\0\\1\end{bmatrix}\right )\) \(V=\mbox {span}\left (\begin{bmatrix}5\\3\end{bmatrix},\begin{bmatrix}10\\-1\end{bmatrix},\begin{bmatrix}0\\2\end{bmatrix}\right )\quad \text {and}\quad W=\mbox {span}\left (\begin{bmatrix}-2\\0\end{bmatrix},\begin{bmatrix}0\\1\end{bmatrix}\right )\) \(V=\mbox {span}\left (\begin{bmatrix}1\\-2\\4\end{bmatrix}\right )\quad \text {and}\quad W=\mbox {span}\left (\begin{bmatrix}-1\\2\\-4\end{bmatrix},\begin{bmatrix}0\\0\\1\end{bmatrix}\right )\) \(V=\mbox {span}\left (\begin{bmatrix}5\\0\end{bmatrix}\right )\quad \text {and}\quad W=\mbox {span}\left (\begin{bmatrix}-2\\0\end{bmatrix},\begin{bmatrix}1\\0\end{bmatrix},\begin{bmatrix}-4\\0\end{bmatrix},\begin{bmatrix}0\\0\end{bmatrix}\right )\)
Let \(\vec {v}=\begin{bmatrix}3\\4\\5\end{bmatrix}\). Give an example of at least one vector \(\vec {w}\) such that \(\vec {v}\), \(\vec {w}\) do NOT span a plane in \(\RR ^3\). Describe \(\mbox {span}(\vec {v}, \vec {w})\).
Prove or disprove. The zero vector of \(\RR ^n\) is contained in the span of any collection of vectors of \(\RR ^n\).
In Exploration we considered the following set of vectors
\[\left \{\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right \}\]

and demonstrated that \(\begin{bmatrix}4\\4\\-1\end{bmatrix}\) is redundant by using the fact that it is a linear combination of the other two vectors.

(a)
Express each of \(\begin{bmatrix}1\\2\\-1\end{bmatrix}\) and \(\begin{bmatrix}2\\0\\1\end{bmatrix}\) as a linear combination of the remaining vectors.
\[\begin{bmatrix}1\\2\\-1\end{bmatrix}=\answer {-\frac {1}{2}}\begin{bmatrix}2\\0\\1\end{bmatrix}+\answer {\frac {1}{2}}\begin{bmatrix}4\\4\\-1\end{bmatrix}\]
\[\begin{bmatrix}2\\0\\1\end{bmatrix}=\answer {-2}\begin{bmatrix}1\\2\\-1\end{bmatrix}+\answer {1}\begin{bmatrix}4\\4\\-1\end{bmatrix}\]
(b)
Which of the following is NOT true?
If \(\vec {w}\) is in \(\mbox {span}\left (\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right )\), then \(\vec {w}\) is in \(\mbox {span}\left (\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right )\). Both \(\begin{bmatrix}1\\2\\-1\end{bmatrix}\) and \(\begin{bmatrix}2\\0\\1\end{bmatrix}\) are redundant in \(\left \{\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right \}\). We can remove \(\begin{bmatrix}1\\2\\-1\end{bmatrix}\) and \(\begin{bmatrix}2\\0\\1\end{bmatrix}\) from \(\left \{\begin{bmatrix}1\\2\\-1\end{bmatrix},\begin{bmatrix}2\\0\\1\end{bmatrix},\begin{bmatrix}4\\4\\-1\end{bmatrix}\right \}\) at the same time without affecting the span.
Show that if the zero vector is part of a collection of two or more vectors, the zero vector is redundant.