Superadditivity of Entropy

Entropy of a composite system is at least the sum of the entropies of its parts (with matching conserved quantities), expressing extensivity and leading to concavity.
Superadditivity of Entropy

This lemma is most naturally formulated for the , and it encodes the thermodynamic intuition behind being extensive.

Statement (microcanonical form)

Consider two subsystems with disjoint degrees of freedom (e.g. two disjoint regions Λ1,Λ2\Lambda_1,\Lambda_2) whose Hamiltonian is additive when they are decoupled:

HΛ1Λ2=HΛ1+HΛ2. H_{\Lambda_1\cup\Lambda_2} = H_{\Lambda_1}+H_{\Lambda_2}.

Let ΩΛ(E,Δ)\Omega_\Lambda(E,\Delta) denote the number (or volume, in phase space) of microstates in an energy window [E,E+Δ][E,E+\Delta], and define the windowed microcanonical entropy

SΛ(E,Δ)=logΩΛ(E,Δ). S_\Lambda(E,\Delta)=\log \Omega_\Lambda(E,\Delta).

Then for any E1,E2E_1,E_2 and any Δ>0\Delta>0,

ΩΛ1Λ2(E1+E2,Δ)    ΩΛ1(E1,Δ)ΩΛ2(E2,Δ), \Omega_{\Lambda_1\cup\Lambda_2}(E_1+E_2,\Delta) \;\ge\; \Omega_{\Lambda_1}(E_1,\Delta)\,\Omega_{\Lambda_2}(E_2,\Delta),

and therefore

SΛ1Λ2(E1+E2,Δ)    SΛ1(E1,Δ)+SΛ2(E2,Δ). S_{\Lambda_1\cup\Lambda_2}(E_1+E_2,\Delta) \;\ge\; S_{\Lambda_1}(E_1,\Delta)+S_{\Lambda_2}(E_2,\Delta).

Key hypotheses and conclusions

Hypotheses

  • The two subsystems are independent/decoupled so that the composite Hamiltonian is additive.
  • Entropy is defined by logarithmic counting/volume of microstates (Boltzmann form).

Conclusions

  • Superadditivity: the entropy of the union is at least the sum of entropies of parts at matching conserved totals.
  • By optimizing over the split E=E1+E2E=E_1+E_2, one obtains the familiar inequality SΛ1Λ2(E,Δ)supE1+E2=E(SΛ1(E1,Δ)+SΛ2(E2,Δ))S_{\Lambda_1\cup\Lambda_2}(E,\Delta)\ge \sup_{E_1+E_2=E}\big(S_{\Lambda_1}(E_1,\Delta)+S_{\Lambda_2}(E_2,\Delta)\big), which is a precursor to concavity of the entropy density.

Proof idea / significance

If x1x_1 is a microstate of subsystem 1 with energy in [E1,E1+Δ][E_1,E_1+\Delta] and x2x_2 is a microstate of subsystem 2 with energy in [E2,E2+Δ][E_2,E_2+\Delta], then the product state (x1,x2)(x_1,x_2) is a microstate of the composite system with energy in [E1+E2,E1+E2+Δ][E_1+E_2,E_1+E_2+\Delta]. This injective map from pairs of microstates to composite microstates gives the multiplicative lower bound on Ω\Omega, and taking log\log yields superadditivity.

For weakly interacting short-range systems, a variant holds up to boundary corrections (analogous to ): interactions across an interface contribute only O()O(|\partial|) to the energy accounting, which is negligible per unit volume in the thermodynamic limit.

Superadditivity (or approximate superadditivity) is a standard route to existence of an entropy density via the superadditive form of , and it underlies the concavity/stability properties expected of equilibrium entropy.