The statistical definition of entropy
Entropy measures the number of microscopic arrangements consistent with a system's observed macroscopic state — the second law's tendency toward higher entropy is simply the statistical tendency toward the overwhelmingly more probable arrangement.
Practise this conceptThermodynamics defines entropy through heat and temperature, which tells you how to calculate it but not what it is. Boltzmann's answer is that entropy counts. Fix what you can see about a system — its energy, volume, particle number — and there will be an enormous number of microscopic arrangements consistent with that description. Entropy is the logarithm of that number: S = k ln W.
Once you read it that way, the second law stops being a mysterious arrow and becomes arithmetic. Systems drift towards macroscopic states that can be realised in more ways, simply because there are more ways to land in them. Gas fills its container not because molecules repel — in an ideal gas they barely interact — but because arrangements spread through the whole volume outnumber arrangements confined to one corner by a factor so vast it has no useful name. Nothing forbids the gas from crowding into a corner; it is just overwhelmingly unlikely, and for macroscopic numbers of molecules "overwhelmingly" means never observed in the age of the universe.
Two cautions. "Disorder" is a lossy translation: a tidy room is not a thermodynamic state, and the intuition misleads as often as it helps — think in terms of how many arrangements look the same from outside. And the second law constrains the total, not each part. A refrigerator lowers the entropy of its contents every day without difficulty; it just discharges more entropy into the kitchen than it removes from the food, which is also why it warms the room overall rather than cooling it.
Key ideas
Requires: Entropy and the second law, The Maxwell-Boltzmann distribution
Unlocks: Critical phenomena and continuous phase transitions, Free energy and spontaneity, Microstates and multiplicity
Formulas
| Symbol | Name | Unit |
|---|---|---|
| entropy | J/K (joule per kelvin) | |
| multiplicity | 1 (dimensionless) |
Common misconceptions
- Entropy is disorder in the everyday sense, so a tidy room has low entropy and a messy one high entropy.
- The second law forbids entropy from ever decreasing anywhere.
- A gas spreads out to fill its container because the molecules repel one another.
Resources
Part of these UT courses
This concept is mapped as covering part of the following course(s) in the University of Tartu curriculum.
- Thermodynamics and statistical physicsLOFY.04.004
- Physical chemistry, part 1LOKT.02.037