Introduction to Taylor series

$\newenvironment {prompt}{}{} \newcommand {\ungraded }[0]{} \newcommand {\todo }[0]{} \newcommand {\oiint }[0]{{\large \bigcirc }\kern -1.56em\iint } \newcommand {\mooculus }[0]{\textsf {\textbf {MOOC}\textnormal {\textsf {ULUS}}}} \newcommand {\npnoround }[0]{\nprounddigits {-1}} \newcommand {\npnoroundexp }[0]{\nproundexpdigits {-1}} \newcommand {\npunitcommand }[1]{\ensuremath {\mathrm {#1}}} \newcommand {\RR }[0]{\mathbb R} \newcommand {\R }[0]{\mathbb R} \newcommand {\N }[0]{\mathbb N} \newcommand {\Z }[0]{\mathbb Z} \newcommand {\sagemath }[0]{\textsf {SageMath}} \newcommand {\d }[0]{\mathop {}\!d} \newcommand {\l }[0]{\ell } \newcommand {\ddx }[0]{\frac {d}{\d x}} \newcommand {\zeroOverZero }[0]{\ensuremath {\boldsymbol {\tfrac {0}{0}}}} \newcommand {\inftyOverInfty }[0]{\ensuremath {\boldsymbol {\tfrac {\infty }{\infty }}}} \newcommand {\zeroOverInfty }[0]{\ensuremath {\boldsymbol {\tfrac {0}{\infty }}}} \newcommand {\zeroTimesInfty }[0]{\ensuremath {\small \boldsymbol {0\cdot \infty }}} \newcommand {\inftyMinusInfty }[0]{\ensuremath {\small \boldsymbol {\infty -\infty }}} \newcommand {\oneToInfty }[0]{\ensuremath {\boldsymbol {1^\infty }}} \newcommand {\zeroToZero }[0]{\ensuremath {\boldsymbol {0^0}}} \newcommand {\inftyToZero }[0]{\ensuremath {\boldsymbol {\infty ^0}}} \newcommand {\numOverZero }[0]{\ensuremath {\boldsymbol {\tfrac {\#}{0}}}} \newcommand {\dfn }[0]{\textbf } \newcommand {\unit }[0]{\mathop {}\!\mathrm } \newcommand {\eval }[1]{\bigg [ #1 \bigg ]} \newcommand {\seq }[1]{\left ( #1 \right )} \newcommand {\epsilon }[0]{\varepsilon } \newcommand {\phi }[0]{\varphi } \newcommand {\iff }[0]{\Leftrightarrow } \DeclareMathOperator {\arccot }{arccot} \DeclareMathOperator {\arcsec }{arcsec} \DeclareMathOperator {\arccsc }{arccsc} \DeclareMathOperator {\si }{Si} \DeclareMathOperator {\scal }{scal} \DeclareMathOperator {\sign }{sign} \newcommand {\arrowvec }[1]{{\overset {\rightharpoonup }{#1}}} \newcommand {\vec }[1]{{\overset {\boldsymbol {\rightharpoonup }}{\mathbf {#1}}}\hspace {0in}} \newcommand {\point }[1]{\left (#1\right )} \newcommand {\pt }[1]{\mathbf {#1}} \newcommand {\Lim }[2]{\lim _{\point {#1} \to \point {#2}}} \DeclareMathOperator {\proj }{\mathbf {proj}} \newcommand {\veci }[0]{{\boldsymbol {\hat {\imath }}}} \newcommand {\vecj }[0]{{\boldsymbol {\hat {\jmath }}}} \newcommand {\veck }[0]{{\boldsymbol {\hat {k}}}} \newcommand {\vecl }[0]{\vec {\boldsymbol {\l }}} \newcommand {\uvec }[1]{\mathbf {\hat {#1}}} \newcommand {\utan }[0]{\mathbf {\hat {t}}} \newcommand {\unormal }[0]{\mathbf {\hat {n}}} \newcommand {\ubinormal }[0]{\mathbf {\hat {b}}} \newcommand {\dotp }[0]{\bullet } \newcommand {\cross }[0]{\boldsymbol \times } \newcommand {\grad }[0]{\boldsymbol \nabla } \newcommand {\divergence }[0]{\grad \dotp } \newcommand {\curl }[0]{\grad \cross } \newcommand {\lto }[0]{\mathop {\longrightarrow \,}\limits } \newcommand {\bar }[0]{\overline } \newcommand {\surfaceColor }[0]{violet} \newcommand {\surfaceColorTwo }[0]{redyellow} \newcommand {\sliceColor }[0]{greenyellow} \newcommand {\vector }[1]{\left \langle #1\right \rangle } \newcommand {\sectionOutcomes }[0]{} \newcommand {\HyperFirstAtBeginDocument }[0]{\AtBeginDocument }$

We study Taylor and Maclaurin series.

We’ve seen that we can approximate functions with polynomials, given that enough derivative information is available. We have also seen that certain functions can be represented by a power series. In this section we combine these concepts: If a function $f(x)$ is infinitely differentiable, we show how to represent it with a power series function.

Let $f(x)$ have derivatives of all orders at $x=c$ .

The Taylor series of $f(x)$ , centered at $c$ is $\sum _{n=0}^\infty \frac {f^{(n)}(c)}{n!}(x-c)^n.$
Setting $c=0$ gives the Maclaurin series of $f(x)$ : $\sum _{n=0}^\infty \frac {f^{(n)}(0)}{n!}x^n.$

Quick: Write down the Taylor series for $f(x) = x^3-6x^2+1$ centered at $x=0$ . $\answer {x^3-6x^2+1}$

Write down the Taylor series for $f(x) = x^3-6x^2+1$ centered at $x=1$ . - $\answer {-4} + \answer {-9}(x-1) + \answer {-3}(x-1)^2 + \answer {1}(x-1)^3$

The difference between a Taylor polynomial and a Taylor series is the former is a polynomial, containing only a finite number of terms, whereas the latter is a series, a summation of an infinite set of terms, any number of which (including an infinite number) may be zero. When creating the Taylor polynomial of degree $n$ for a function $f(x)$ at $x=c$ , we needed to evaluate $f$ , and the first $n$ derivatives of $f$ , at $x=c$ . When creating the Taylor series of $f$ , it helps to find a pattern that describes the $n$ th derivative of $f$ at $x=c$ . Time for examples!

Compute the Taylor series for $f(x) = \sin (x)$ centered at $x=0$ .

We’ll start by making a table of derivatives: $\begin {array}{lcl} f(x) = \sin (x) & \Rightarrow &f(0) = 0\\ f'(x) = \answer [given]{\cos (x)} & \Rightarrow & f'(0) = \answer [given]{1}\\ f''(x) = \answer [given]{-\sin (x)} &\Rightarrow &f''(0) = \answer [given]{0}\\ f'''(x) = \answer [given]{-\cos (x)} &\Rightarrow &f'''(0) = \answer [given]{-1}\\ f^{(4)}(x) = \answer [given]{\sin (x)} &\Rightarrow &f^{(4)}(0) = \answer [given]{0}\\ f^{(5)}(x) = \answer [given]{\cos (x)} &\Rightarrow &f^{(5)}(0) = \answer [given]{1}\\ f^{(6)}(x) = \answer [given]{-\sin (x)} &\Rightarrow &f^{(6)}(0) =\answer [given]{0}\\ f^{(7)}(x) = \answer [given]{-\cos (x)} &\Rightarrow &f^{(7)}(0) = \answer [given]{-1}\\ f^{(8)}(x) = \answer [given]{\sin (x)} &\Rightarrow &f^{(8)}(0) = \answer [given]{0}\\ f^{(9)}(x) = \answer [given]{\cos (x)} &\Rightarrow &f^{(9)}(0) = \answer [given]{1}\\ \end {array}$ Since a repeating pattern has emerged, we see that the Maclaurin series for $\sin (x)$ is: $x-\frac {x^3}{3!}+\frac {x^5}{5!}-\frac {x^7}{7!}+\cdots = \sum _{n=0}^\infty \frac {(-1)^{n}}{(2n+1)!} x^{2n+1}$

Let’s see an example that is not centered at $x=0$ :

Compute the Taylor series for $f(x) = \ln (x)$ centered at $x=1$ .

We’ll start by making a table of derivatives: $\begin {array}{lcl} f(x) = \ln (x) &\Rightarrow &f(1) = 0\\ f'(x) = \answer [given]{1/x}&\Rightarrow &f'(1) = \answer [given]{1}\\ f''(x) = \answer [given]{-1/x^2}&\Rightarrow &f''(1) = \answer [given]{-1}\\ f'''(x) = \answer [given]{2/x^3}&\Rightarrow &f'''(1) = \answer [given]{2}\\ f^{(4)}(x) = \answer [given]{-6/x^4}&\Rightarrow &f^{(4)}(1) = \answer [given]{-6}\\ f^{(5)}(x) = \answer [given]{24/x^5}&\Rightarrow &f^{(5)}(1) = \answer [given]{24}\\ \ \vdots & &\ \vdots \\ f^{(n)}(x) = \answer [given]{\frac {(-1)^{n+1}(n-1)!}{x^n}} &\Rightarrow & f^{(n)}(1) = \answer [given]{(-1)^{n+1}(n-1)!} \end {array}$

$0! = 1,\ 1! = 1,\ 2!=2,\ 3! = 6,\ 4! = 24, \ 5!=120, \ 6! = 720.$

Since a pattern has emerged, we see that the Taylor series for $\ln (x)$ is: $\begin{align*} (x-1) &- \frac{(x-1)^2}{\answer[given]{2}} + \frac{(x-1)^3}{\answer[given]{3}} - \frac{(x-1)^4}{\answer[given]{4}} + \cdots \\ &= \sum_{n=1}^\infty (-1)^{n+1}\frac{(x-1)^n}{\answer[given]{n}} \end{align*}$

Finally, sometimes Taylor’s formula may not be the best way to compute the Taylor series.

Compute the Taylor series for $f(x) = \arctan (x)$ centered at $x=0$ .

If we try to use Taylor’s formula, we must start by making a table of derivatives: $\begin{align*} f(x) &= \arctan(x)\\ f'(x) &= \answer[given]{\frac{1}{1+x^2}}\\ f''(x) &= \answer[given]{\frac{-2x}{(1+x^2)^2}} \end{align*}$

Hmm. This is getting messy. Let’s try to find the Taylor series via known power series. We know that $\frac {1}{1-z} = 1+ z+ z^2 + z^3 + \cdots \qquad |z|< 1$ setting $z = -x^2$ we now have $\frac {1}{1-(-x^2)} = 1 + (-x^2)+ (-x^2)^2 + (-x^2)^3 + \cdots$ when $|(-x^2)|< 1$ and $\frac {1}{1+x^2} = 1 - x^2 + x^4 - x^6 + \cdots$ when $|x|< 1$ . Since $\int \frac {1}{1+x^2} \d x = \arctan (x) + C$ we can find the desired power series by integrating. Write with me

$\begin{align*} \int &\left(1 - x^2 + x^4 - x^6 + \cdots\right)\d x \\ &= \answer[given]{x - \frac{x^3}{3} + \frac{x^5}{5}} - \frac{x^7}{7} + \cdots +C \end{align*}$

since $\arctan (0) = 0$ , $C=0$ , and we have our desired power series, which converges with radius of convergence $R=1$ . However, note the interval of convergence may be different, and it is in this case. First note that our power series can be written in summation notation as $\sum _{n=0}^\infty \frac {(-1)^n x^{2n+1}}{2n+1}$ If $x=1$ or $x=-1$ we can see that this sequence is $\sum _{n=0}^\infty \frac {(-1)^n}{2n+1}\qquad \text {or}\qquad \sum _{n=0}^\infty \frac {(-1)^{n+1}}{2n+1}$ In both cases, the series converges by the alternating series test. Hence the interval of convergence is $[\answer [given]{-1},\answer [given]{1}]$ .

Above we implicitly used the following theorem:

The Taylor series centered at $x=c$ of a polynomial in $(x-c)$ is exactly that polynomial and the Taylor series of power series centered at $(x-c)$ is exactly that power series.

This is just saying that if you know a power series for a function, then using Taylor’s formula will do nothing but give you the power series.

Since we designed Taylor polynomials to approximate functions, you might guess that the Taylor series of a function is equal to the function (at least on the interval of convergence for the Taylor series). This is false.

Here is an somewhat unsatisfying example:

Consider: $f(x) = \begin {cases} 1 &\text {if $|x|<1$},\\ 0 &\text {if $|x|\ge 1$}. \end {cases}$

(a): Compute the Maclaurin series of $f$ .
(b): Find the radius of convergence.
(c): Is the Maclaurin series for $f$ equal to $f$ on the interval of convergence?

We’ll start by making a table of derivatives: $\begin{align*} f(0) &= \answer[given]{1}\\ f'(0) &= \answer[given]{0}\\ f''(0) &=\answer[given]{0}\\ &\vdots \end{align*}$

So our Maclaurin series for $f$ is: $1+0+0+\cdots$ This converges for all values of $x$ , and hence the radius of convergence is $R=\infty$ , with interval of convergence $(-\infty ,\infty )$ . However, $1\ne f$ as functions.

A more satisfying example is the following:

Let $f(x) = \begin {cases} e^{-1/x^2} &\text {if $x \neq 0$,}\\ 0 &\text {if $x = 0$.} \end {cases}$ It turns out that $f$ is infinitely differentiable everywhere, but all of its derivatives vanish at $x=0$ . Thus the Maclaurin series for $f$ is just $1 + 0 + 0+ \cdots$ The derivatives of $f$ “go to $0$ ” as $x$ goes to zero faster than any polynomial, and so no polynomial term “detects” that this function is not the horizontal line $y=1$ .

It is within your power to show that $f$ is infinitely differentiable everywhere, and to prove that $f^{(k)}(0) = 0$ . This is quite involved, and we will not do it here. If you have the gumption, and the willpower, it would make a fantastic exercise.

We will find that “most of the time” they are equal, but we need to consider the conditions that allow us to conclude this. Taylor’s theorem states that the error between a function $f(x)$ and its $n$ th degree Taylor polynomial is $R_n(x)$ : $f(x) = p_n(x) + R_n(x)$ and that $\left |R_n(x)\right | \leq \frac {M}{(n+1)!}|x-c|^{(n+1)}$ where $M$ is the maximum value of $|f^{(n+1)}|$ on $[c,x]$ . If $R_n(x)$ goes to $0$ for each $x$ in an interval $I$ as $n$ approaches infinity, we conclude that the function is equal to its Taylor series expansion. This leads us to our next theorem:

Function and Taylor Series Equality Let $f(x)$ have derivatives of all orders at $x=c$ , let $R_n(x)$ , and let $I$ be an interval on which the Taylor series of $f$ converges. If $\lim _{n\to \infty } R_n(x) = 0$ for all $x$ in $I$ containing $c$ , then $f(x) = \sum _{n=0}^\infty \frac {f\,^{(n)}(c)}{n!}(x-c)^n$ on $I$ .

We’ll work a representative example of this theorem to see what is going on, the general case is much the same.

The Maclaurin series for $e^x$ is $1+x+\frac {x^2}{2!} +\frac {x^3}{3!}+\dots$ show that: $e^x = 1+x+\frac {x^2}{2!} +\frac {x^3}{3!}+\dots$

To start, note that using the ratio test this power series has an infinite radius of convergence. We want to know whether $e^x = 1+x+\frac {x^2}{2!} +\frac {x^3}{3!}+\dots$ for every real number $x$ . Another way of phrasing this is that we want the remainder $R_n(x)$ to go to zero as $n$ goes to infinity. We know that $\left |R_n(x)\right | \le \frac {M}{(n+1)!}|x-c|^{(n+1)}$ where $M$ is the maximum value of $|f^{(n+1)}|$ on $[0,x]$ . We know $f^{(n+1)}(b) = \answer [given]{e^b}$ , since all the derivatives of $e^x$ are just $e^x$ Thus $R_n(x) = \frac {\answer [given]{e^b}}{(n+1)!}x^{n+1}$ So how large can $R_n(x)$ be? If $b$ is between $0$ and $x$ , then $e^b$ is between $0$ and $e^{|b|}$ , so $0\le \left | R_n(x)\right | \leq \frac {e^{|b|}}{(n+1)!}|x|^{n+1}$ Thus by the Squeeze Theorem, $\lim _{n \to \infty }\left | R_n(x)\right | = 0$ as $\lim _{n \to \infty } \frac {e^{|b|}}{(n+1)!}|x|^{n+1} = 0,$ proving that the Maclaurin series for $e^x$ converges to $e^x$ everywhere!

There is good news. A function $f$ that is equal to its Taylor series, centered at any point the domain of $f(x)$ , is said to be an analytic function, and most, if not all, functions that we encounter within this course are analytic functions. Generally speaking, any function that one creates with elementary functions (polynomials, exponentials, trigonometric functions, etc.) that is not piecewise defined is probably analytic. For most functions, we assume the function is equal to its Taylor series on the series’ interval of convergence and only check the remainder (as above) when we suspect something may not work as expected.