upgrade
upgrade

Linear Algebra and Differential Equations

Key Concepts of Fourier Series

Study smarter with Fiveable

Get study guides, practice questions, and cheatsheets for all your subjects. Join 500,000+ students with a 96% pass rate.

Get Started

Why This Matters

Fourier Series sit at the intersection of two major course themes: orthogonal decomposition from linear algebra and solving differential equations with boundary conditions. When you represent a periodic function as a sum of sines and cosines, you're essentially projecting that function onto an orthonormal basis—the same concept you learned with vectors, just extended to infinite-dimensional function spaces. This technique transforms impossible-looking PDEs (heat equation, wave equation) into manageable systems of ODEs.

You're being tested on your ability to compute coefficients, recognize convergence behavior, and apply these series to solve boundary value problems. Don't just memorize the integral formulas—understand that each coefficient captures how much of a particular frequency "lives" in your function, and that orthogonality is what makes the whole decomposition work cleanly.


The Foundation: Series Definition and Coefficients

The core idea is simple: any reasonable periodic function can be written as a (possibly infinite) sum of sines and cosines. The coefficients tell you the "weight" of each frequency component.

Definition of Fourier Series

  • General formf(x)=a0+n=1(ancos(nx)+bnsin(nx))f(x) = a_0 + \sum_{n=1}^{\infty} (a_n \cos(nx) + b_n \sin(nx)) expresses a periodic function as a superposition of harmonic oscillations
  • Frequency decomposition allows you to analyze which frequencies are present and how strongly each contributes to the overall shape
  • Period TT determines the fundamental frequency; all other terms are integer multiples (harmonics) of this base frequency

Fourier Coefficients (ana_n and bnb_n)

  • Coefficient formulasan=2T0Tf(x)cos(2πnxT)dxa_n = \frac{2}{T} \int_{0}^{T} f(x) \cos\left(\frac{2\pi nx}{T}\right) dx and bn=2T0Tf(x)sin(2πnxT)dxb_n = \frac{2}{T} \int_{0}^{T} f(x) \sin\left(\frac{2\pi nx}{T}\right) dx extract each frequency's amplitude
  • a0a_0 represents the average value of the function over one period (the DC component in engineering language)
  • Integration over one complete period ensures you capture the full behavior of the function without bias from starting point

Euler's Formula and Complex Form

  • Euler's formula eix=cos(x)+isin(x)e^{ix} = \cos(x) + i\sin(x) bridges trigonometric and exponential representations
  • Complex form f(x)=n=cneinxf(x) = \sum_{n=-\infty}^{\infty} c_n e^{inx} combines sine and cosine into a single elegant expression with complex coefficients cnc_n
  • Computational efficiency—exponentials are often easier to differentiate and integrate, making this form preferred in advanced applications

Compare: Real form vs. Complex form—both represent the same information, but the complex form uses a single coefficient cnc_n instead of separate ana_n and bnb_n. If an FRQ asks you to "simplify" a Fourier calculation, switching to complex exponentials often streamlines the algebra.


The Linear Algebra Connection: Orthogonality

Orthogonality of basis functions is what makes Fourier analysis work. Just as orthogonal vectors simplify projections in Rn\mathbb{R}^n, orthogonal functions let you isolate each coefficient independently.

Orthogonality of Trigonometric Functions

  • Inner product equals zero0Tsin(nx)cos(mx)dx=0\int_{0}^{T} \sin(nx) \cos(mx) \, dx = 0 for all integers n,mn, m, and similarly for same-type functions when nmn \neq m
  • Independence of frequency components means changing one coefficient doesn't affect others—each term in the series is "decoupled"
  • Projection formula for coefficients follows directly: multiply by the basis function and integrate, just like projvu=uvv2\text{proj}_{\vec{v}} \vec{u} = \frac{\vec{u} \cdot \vec{v}}{|\vec{v}|^2}

Parseval's Theorem

  • Energy conservation1T0Tf(x)2dx=a022+n=1(an2+bn2)\frac{1}{T} \int_{0}^{T} |f(x)|^2 \, dx = \frac{a_0^2}{2} + \sum_{n=1}^{\infty} (a_n^2 + b_n^2) shows total energy equals sum of energies in each mode
  • Time-frequency equivalence connects the integral of f2|f|^2 (time domain) to the sum of squared coefficients (frequency domain)
  • Useful for checking work—if your coefficients don't satisfy Parseval's identity, something went wrong in your calculation

Compare: Orthogonality in Rn\mathbb{R}^n vs. function spaces—in both cases, orthogonality lets you compute projections independently. The integral f(x)g(x)dx\int f(x)g(x)\,dx plays the role of the dot product uv\vec{u} \cdot \vec{v}.


Exploiting Symmetry: Even and Odd Functions

Recognizing symmetry cuts your work in half. Even and odd functions have simplified Fourier representations that eliminate entire families of coefficients.

Even and Odd Functions in Fourier Series

  • Even functions (f(x)=f(x)f(-x) = f(x)) have only cosine terms—all bn=0b_n = 0 because sine is odd and the integral vanishes
  • Odd functions (f(x)=f(x)f(-x) = -f(x)) have only sine terms—all an=0a_n = 0 because cosine is even and the product integrates to zero
  • Symmetry detection should be your first step; it reduces computation and helps verify your final answer

Half-Range Expansions

  • Functions on [0,L][0, L] only can be extended to a full period by choosing an even extension (cosine series) or odd extension (sine series)
  • Boundary value problems often dictate which extension to use—Dirichlet conditions (fixed endpoints) suggest sine series; Neumann conditions (zero derivative) suggest cosine series
  • Practical technique for heat and wave equations where the physical domain is a finite interval, not a full period

Compare: Cosine series vs. Sine series—both can represent the same function on [0,L][0, L], but they extend it differently outside that interval. Choose based on boundary conditions: sine series vanish at endpoints, cosine series have zero slope at endpoints.


Convergence Behavior and Limitations

Not all functions behave equally well under Fourier expansion. Understanding convergence tells you when to trust your series and where to expect trouble.

Convergence of Fourier Series

  • Pointwise convergence—at points where ff is continuous, the series converges to f(x)f(x) exactly as you add more terms
  • At discontinuities, the series converges to the average of left and right limits: 12[f(x)+f(x+)]\frac{1}{2}[f(x^-) + f(x^+)]
  • Dirichlet conditions (piecewise continuous, finite discontinuities, bounded variation) guarantee convergence—most functions you'll encounter satisfy these

Gibbs Phenomenon

  • 9% overshoot near jump discontinuities persists no matter how many terms you include—this is a fundamental limitation, not a computational error
  • Oscillations concentrate near the discontinuity but don't spread; the "ringing" gets narrower as nn \to \infty but never disappears
  • Exam relevance—if asked why a Fourier approximation looks "wrong" near a jump, Gibbs phenomenon is your answer

Compare: Continuous vs. discontinuous functions—smooth functions have rapidly decaying coefficients (an,bn1/n2a_n, b_n \sim 1/n^2 or faster), while discontinuous functions decay slowly (1/n\sim 1/n). This explains why discontinuities require more terms to approximate well.


Applications to Differential Equations

This is where Fourier Series earn their keep. The technique transforms PDEs with periodic or boundary conditions into algebraic problems.

Solving Differential Equations with Fourier Series

  • Separation of variables combined with Fourier Series converts PDEs (heat, wave, Laplace) into infinite systems of ODEs, each solvable independently
  • Superposition principle—because the equations are linear, you can solve for each Fourier mode separately and sum the results
  • Initial/boundary conditions determine your coefficients; the Fourier expansion of the initial condition gives you the weights for each mode

Fourier Transforms and Their Relationship

  • Non-periodic generalization—Fourier transforms extend the series concept to functions on (,)(-\infty, \infty) by letting the period TT \to \infty
  • Continuous spectrum replaces discrete frequencies; instead of coefficients cnc_n, you get a continuous function f^(ω)\hat{f}(\omega)
  • Conceptual bridge—Fourier Series are the "discrete" version for periodic functions; transforms handle the general case

Compare: Fourier Series vs. Fourier Transform—series give you discrete frequencies (harmonics of the fundamental), while transforms give a continuous frequency spectrum. Use series for periodic problems, transforms for non-periodic or infinite-domain problems.


Quick Reference Table

ConceptBest Examples
Computing coefficientsana_n, bnb_n formulas, complex cnc_n
Orthogonality principleInner products of sin(nx)\sin(nx), cos(mx)\cos(mx); Parseval's theorem
Symmetry exploitationEven/odd functions, half-range expansions
Convergence behaviorDirichlet conditions, Gibbs phenomenon
Energy relationshipsParseval's theorem
PDE applicationsHeat equation, wave equation, boundary value problems
Series vs. TransformPeriodic functions vs. non-periodic/infinite domain

Self-Check Questions

  1. Why does orthogonality of sine and cosine functions allow you to compute each Fourier coefficient independently? How is this analogous to projecting onto orthogonal vectors?

  2. Given a function with a jump discontinuity, what value does the Fourier Series converge to at that point, and what phenomenon affects the approximation nearby?

  3. Compare and contrast: When would you use a half-range cosine expansion versus a half-range sine expansion? What boundary conditions does each satisfy?

  4. If f(x)f(x) is an odd function, which coefficients are automatically zero? Explain why using the properties of odd and even functions under integration.

  5. (FRQ-style) A function f(x)f(x) on [0,π][0, \pi] satisfies f(0)=f(π)=0f(0) = f(\pi) = 0. You need to solve the heat equation with these boundary conditions. Would you use a sine series or cosine series expansion? Justify your choice and explain how Fourier's method transforms the PDE into solvable components.