Entropy measures how many microscopic arrangements can produce the same visible situation. Ordered states are rare. Mixed, spread-out states are common. That simple probability idea explains why heat flows, why perfume spreads through a room, and why every real machine wastes some energy.
Learning Goals
Define entropyConnect entropy to multiplicity: the number of possible microstates behind one macrostate.
Explain spontaneous changePredict why isolated systems tend to move toward more probable, more mixed arrangements.
Use the Second LawDescribe why total entropy increases in real processes, even when local order appears.
Connect physics to informationCompare thermal entropy with uncertainty, compression, and information patterns.
Entropy is a Counting Problem
A neat row of particles on the left side of a box can happen, but there are very few ways to arrange it. A mixed box has far more possible particle arrangements. When particles move randomly, they are much more likely to land in one of the many mixed arrangements than in one of the rare ordered ones.
S = k ln WBoltzmann's idea: entropy S grows with W, the number of microstates. k is Boltzmann's constant.
Key idea: Entropy is not just "mess." It is probability, energy spreading, and missing information all pointing at the same deep pattern.
Feynman's Thermodynamic Route
Feynman builds entropy from ideal heat engines before turning it into a general state variable. In a reversible engine, heat taken from a hot reservoir and heat delivered to a cold reservoir are not equal, but their ratios to absolute temperature are equal.
Q1/T1 = Q2/T2This comes from Carnot's reversible engine argument: every reversible engine between the same two temperatures has the same best possible performance.
1Reversible heat flowHeat crosses only between objects at almost the same temperature, so a tiny change can reverse the direction.
2Cycle returns homeThe working substance finishes where it started, so any remaining change belongs to the reservoirs and surroundings.
3Entropy balancesThe amount Q/T absorbed equals the amount delivered. In an irreversible process, the total increases.
Interactive Mixing Lab
Start with separated particles, then let random motion mix them. The entropy score rises as the box becomes harder to describe with a simple pattern.
Entropy Score0.00
Mixing0%
Temperature1.0x
StateOrdered
Where Entropy Shows Up
Heat flowThermal energy spreads from hotter matter to colder matter because there are vastly more spread-out energy arrangements.
EnginesNo heat engine can convert every bit of heat into useful work. Some energy must disperse into the surroundings.
LifeLiving things build local order by taking in energy and exporting more entropy to their environment.
DataIn information theory, entropy measures uncertainty. A random message is harder to compress than a repeated pattern.
Practice Problems
Easy1. Which state usually has higher entropy: ten particles separated by color, or ten particles mixed together?
Hint: there are more ways to be mixed than to be neatly separated.
Medium2. A reversible process adds 600 J of heat at 300 K. What is ΔS in J/K?
Hint: ΔS = Q/T = 600/300.
Hard3. If system A has W = 10 microstates and system B has W = 1,000 microstates, which has larger entropy?
Hint: S = k ln W, so larger W means larger entropy.