15.6 Entropy and the Second Law of Thermodynamics: Disorder and the Unavailability of Energy

Entropy and the Second Law of Thermodynamics

Entropy in thermodynamic processes

Entropy ($S$) measures the degree of disorder or randomness in a system. A gas spreading freely through a room has high entropy, while a compressed gas confined to one corner has low entropy. The concept gives us a way to quantify why certain processes happen spontaneously and others don't.

The change in entropy ($\Delta S$) is defined for a reversible process as:

$\Delta S = \int \frac{dQ}{T}$

where $dQ$ is the heat exchanged and $T$ is the absolute temperature in Kelvin. For an irreversible process (which is every real process), the entropy change is always greater:

$\Delta S > \int \frac{dQ}{T}$

A few key properties of entropy:

• Entropy change depends only on the initial and final states, not on the path taken between them. This makes entropy a state function, just like internal energy.
• In any closed (isolated) system, $\Delta S \geq 0$. Entropy either stays the same (reversible process) or increases (irreversible process). It never decreases on its own.
• The total entropy of the universe always increases during spontaneous processes. When salt dissolves in water, for example, the ions spread out and the overall disorder increases.
• At a microscopic level, entropy connects to the number of possible microstates a system can occupy. More microstates means higher entropy. This is the statistical mechanics perspective developed by Ludwig Boltzmann.

Second law and energy availability

The Second Law of Thermodynamics states that the total entropy of an isolated system always increases over time. This single statement explains a surprising amount of physics.

Heat flows spontaneously from hot objects to cold objects, never the reverse. A cup of coffee cools to room temperature because that direction increases total entropy. You'll never see a lukewarm cup spontaneously heat itself back up while cooling the table beneath it.

As entropy increases, energy becomes less available for useful work:

• In any real engine, some energy is always lost as waste heat. A car engine, for instance, converts only about 20-30% of the fuel's chemical energy into motion. The rest dissipates as heat, increasing entropy.
• The quality of energy degrades during conversions. Electrical energy is highly ordered and can do many kinds of work. But when a light bulb converts it to thermal energy (heat and light), much of that energy spreads out and becomes harder to harness again.

Systems naturally tend toward their most probable, disordered state. This is why a room gets messy on its own but never tidies itself. Maintaining order requires a continuous input of energy.

Long-term implications of entropy

The universe as a whole is treated as an isolated system, so the Second Law applies to it directly. Total entropy is always increasing, and the universe is gradually moving toward a state of maximum disorder sometimes called heat death, where all energy is evenly distributed and no further work can be done. Stars will burn out, temperature differences will vanish, and all processes will effectively stop.

Entropy also explains many everyday phenomena:

1. Ice melts at room temperature because the disordered liquid state has higher entropy than the ordered crystal structure of ice.
2. Perfume diffuses throughout a room because the dispersed state (molecules spread everywhere) has far more microstates than the concentrated state (molecules clustered near the bottle).
3. Living organisms eat food to maintain their highly ordered internal structures. You're constantly fighting the tendency toward disorder by importing energy from your surroundings. But the total entropy of you plus your surroundings still increases.

The Second Law also imposes hard limits on efficiency and spontaneity:

• 100% efficiency is impossible in any real energy conversion. Some energy always ends up as waste heat. This is why engineers can never build a perfect engine.
• Spontaneous processes always involve an increase in the total entropy of the system and its surroundings. Iron rusts spontaneously because the products (iron oxide) represent a higher-entropy state overall.

Statistical interpretation and thermodynamic equilibrium

Ludwig Boltzmann connected entropy to microscopic physics with his famous relation:

$S = k_B \ln W$

where $k_B$ is Boltzmann's constant ($1.38 \times 10^{-23} \, \text{J/K}$) and $W$ is the number of microstates corresponding to a given macrostate. A macrostate with more microstates is more probable, so systems naturally evolve toward it.

Thermodynamic equilibrium is the state of maximum entropy for a given set of constraints. Once a system reaches equilibrium, no further spontaneous changes occur because entropy is already at its peak. How quickly a system approaches equilibrium depends partly on its heat capacity: systems with large heat capacities change temperature slowly and take longer to equilibrate.

The steady increase of entropy also gives time its direction. Physical laws at the microscopic level work the same forward and backward, but entropy increase picks out a preferred direction. This connection between entropy and the arrow of time is one of the deepest ideas in physics.