3.2 Vectors and matrices

Vectors and matrices are essential tools in engineering mathematics that let you represent and manipulate complex systems. They show up everywhere: solving force problems in mechanics, analyzing circuits in electronics, and modeling fluid flow. This section covers vector operations, matrix algebra, and their applications, giving you the foundation for more advanced engineering analysis.

Vector Operations in Engineering

Vector Arithmetic and Representation

Vectors carry both magnitude and direction, which makes them perfect for representing physical quantities like force, velocity, and displacement. You can add and subtract vectors in 2D or 3D using two main approaches:

• Graphical method: Arrange vectors tip-to-tail. The resultant vector goes from the tail of the first to the tip of the last.
• Component-wise method: Add or subtract corresponding components. If $\mathbf{a} = (3, 4)$ and $\mathbf{b} = (1, -2)$, then $\mathbf{a} + \mathbf{b} = (4, 2)$.

Scalar multiplication scales a vector's magnitude. Multiplying by a positive scalar stretches or shrinks the vector while keeping its direction. Multiplying by a negative scalar also reverses the direction.

Vector decomposition breaks a vector into components along specified directions. This is especially useful in mechanics when you need to resolve a force into its x and y components (think: forces on an inclined plane).

Unit vectors have a magnitude of 1 and represent pure direction. The standard basis unit vectors in 3D are $\hat{i}$, $\hat{j}$, and $\hat{k}$, aligned with the x, y, and z axes respectively.

Vector Products and Their Applications

There are two ways to multiply vectors, and they give very different results.

The dot product (scalar product) returns a single number:

$\mathbf{a} \cdot \mathbf{b} = a_x b_x + a_y b_y + a_z b_z$

• It measures how much two vectors point in the same direction.
• It gives you the angle between vectors: $\cos \theta = \frac{\mathbf{a} \cdot \mathbf{b}}{|\mathbf{a}||\mathbf{b}|}$
• Engineering use: calculating work done by a force ($W = \mathbf{F} \cdot \mathbf{d}$).

The cross product returns a new vector that's perpendicular to both inputs (3D only):

$\mathbf{a} \times \mathbf{b} = (a_y b_z - a_z b_y)\hat{i} - (a_x b_z - a_z b_x)\hat{j} + (a_x b_y - a_y b_x)\hat{k}$

• Its magnitude equals the area of the parallelogram formed by the two vectors.
• Engineering use: calculating torque ($\boldsymbol{\tau} = \mathbf{r} \times \mathbf{F}$).

A quick way to remember the difference: dot product tells you how aligned two vectors are, cross product tells you how perpendicular they are.

Engineering Applications of Vector Operations

• Statics: Decompose forces into components. For example, resolving the weight of an object on an inclined plane into a component normal to the surface and one parallel to it.
• Dynamics: Use vector addition for relative velocity. A boat crossing a river adds its own velocity vector to the river current's velocity vector to find the actual path of travel.
• Electromagnetics: The Lorentz force law ($\mathbf{F} = q(\mathbf{E} + \mathbf{v} \times \mathbf{B})$) combines electric and magnetic field vectors to find the force on a charged particle.
• Fluid dynamics: Vector fields represent flow velocities at every point in a fluid, which lets you analyze lift and drag on surfaces like airfoils.

Solving Systems with Matrices

Matrix Fundamentals and Basic Operations

A matrix is a rectangular array of numbers arranged in rows and columns. A 2×2 matrix looks like:

$A = \begin{bmatrix} a & b \\ c & d \end{bmatrix}$

The basic operations:

• Addition/subtraction: Done element-wise. Both matrices must have the same dimensions.
• Scalar multiplication: Multiply every element by the scalar.
• Matrix multiplication: This one has rules. The number of columns in the first matrix must equal the number of rows in the second. The result has the row count of the first matrix and the column count of the second.

One thing that trips people up: matrix multiplication is not commutative. In general, $AB \neq BA$. Order matters.

Determinants and Matrix Inverses

The determinant of a square matrix is a single number that tells you whether the matrix is invertible and how it scales area (2D) or volume (3D) under transformation.

For a 2×2 matrix: $\det(A) = ad - bc$

If the determinant is zero, the matrix is singular and has no inverse.

The inverse of a matrix $A^{-1}$ satisfies $AA^{-1} = A^{-1}A = I$, where $I$ is the identity matrix. For a 2×2 matrix:

$A^{-1} = \frac{1}{ad - bc}\begin{bmatrix} d & -b \\ -c & a \end{bmatrix}$

For larger matrices, you can use the adjoint method (based on cofactors) or row reduction to find the inverse.

Solving Linear Systems and Engineering Applications

Matrices give you systematic ways to solve systems of linear equations. Two key methods:

Cramer's Rule solves for each variable using determinants:

$x_i = \frac{\det(A_i)}{\det(A)}$

where $A_i$ is the coefficient matrix with column $i$ replaced by the constants vector. This works well for small systems but gets impractical for large ones.

Gaussian Elimination is a step-by-step process:

1. Write the system as an augmented matrix.
2. Use row operations to get zeros below the diagonal (row echelon form).
3. Back-substitute to find each variable.
4. For Gauss-Jordan elimination, continue reducing until you reach reduced row echelon form, where the solution can be read directly.

Engineering applications include:

• Circuit analysis: Kirchhoff's voltage and current laws produce systems of linear equations that you solve with matrices to find unknown currents or voltages.
• Structural engineering: The stiffness method sets up equilibrium equations as a matrix system to analyze forces in trusses and frames.

Matrix Transformations in Engineering

Linear Transformations and Rotation Matrices

A linear transformation maps vectors from one space to another while preserving vector addition and scalar multiplication. Every linear transformation can be represented as a matrix multiplied by a vector.

Rotation matrices are among the most common transformations. In 2D, rotating a vector by angle $\theta$ uses:

$R(\theta) = \begin{bmatrix} \cos \theta & -\sin \theta \\ \sin \theta & \cos \theta \end{bmatrix}$

You'll see rotation matrices in computer graphics (rotating objects on screen) and robotics (calculating joint positions as arms rotate).

Scaling, Reflection, and Shear Transformations

• Scaling changes size without rotation. A 2D scaling matrix: $S = \begin{bmatrix} s_x & 0 \\ 0 & s_y \end{bmatrix}$. Setting $s_x = 2$ and $s_y = 1$ would stretch an object to double width while keeping its height. Used in CAD for resizing designs.
• Reflection flips objects across an axis. Reflection about the y-axis: $R_y = \begin{bmatrix} -1 & 0 \\ 0 & 1 \end{bmatrix}$. This negates all x-coordinates while leaving y-coordinates unchanged. Used in image processing for mirroring.
• Shear slants objects. A horizontal shear: $H = \begin{bmatrix} 1 & k \\ 0 & 1 \end{bmatrix}$. This shifts each point horizontally by an amount proportional to its y-coordinate. Shows up in fluid dynamics when modeling laminar flow.

Advanced Concepts in Matrix Transformations

Composition of transformations combines multiple operations by multiplying their matrices together. The order of multiplication matters: the rightmost matrix is applied first.

Eigenvalues and eigenvectors are directions that don't change under a transformation (they only get scaled). They satisfy:

$A\mathbf{v} = \lambda\mathbf{v}$

where $\lambda$ is the eigenvalue (the scaling factor) and $\mathbf{v}$ is the eigenvector (the invariant direction). These are critical in vibration analysis and structural stability, where eigenvalues can tell you the natural frequencies of a system.

Other applications:

• Stress-strain analysis: Transformation matrices rotate stress tensors between different coordinate systems.
• Coordinate conversions: Transformation matrices convert between Cartesian, polar, and spherical coordinate systems.

Vectors and Matrices for Modeling

Vector Calculus in Engineering

Vector fields assign a vector (magnitude and direction) to every point in space. Electric fields and fluid velocity fields are classic examples.

Three key operations on vector fields:

• Gradient ($\nabla f$): Points in the direction of steepest increase of a scalar field. Used in optimization and potential energy analysis.
• Divergence ($\nabla \cdot \mathbf{F}$): Measures how much a field "spreads out" from a point. Positive divergence means a source; negative means a sink. Applied in fluid dynamics.
• Curl ($\nabla \times \mathbf{F}$): Measures the rotation or "swirl" in a vector field. Central to electromagnetic theory and Maxwell's equations.

Matrix Methods in System Analysis

• State-space representation models dynamic systems using matrices:
  • $\dot{\mathbf{x}} = A\mathbf{x} + B\mathbf{u}$, $\mathbf{y} = C\mathbf{x} + D\mathbf{u}$
  • This format is standard for analyzing control systems with multiple inputs and outputs.
• Transfer matrices relate system inputs to outputs in linear systems, used in mechanical vibration analysis and electrical network theory.
• Finite element method (FEM) breaks continuous structures into small elements, each described by matrix equations. This lets engineers analyze stress, heat transfer, and other phenomena in complex geometries that don't have neat analytical solutions.

Advanced Modeling Techniques

• Principal Component Analysis (PCA) reduces the number of variables in a dataset by finding the directions of greatest variance. Applied in pattern recognition and data compression.
• Tensor notation extends vectors (1D arrays) and matrices (2D arrays) to higher dimensions. Tensors are crucial in continuum mechanics for describing stress and strain in 3D materials.
• Finite difference methods approximate derivatives using matrix operations, enabling numerical solutions to partial differential equations. These are the backbone of computational fluid dynamics and heat transfer simulations.