Concavity of the von Neumann entropy

The von Neumann entropy is concave on density operators: mixing quantum states cannot decrease entropy.
Concavity of the von Neumann entropy

Let ρ\rho be a on a finite-dimensional Hilbert space. Its is S(ρ)=Tr(ρlogρ)S(\rho) = -\mathrm{Tr}(\rho \log \rho).

Statement

For any density operators ρ1,,ρn\rho_1,\dots,\rho_n and any probabilities p1,,pnp_1,\dots,p_n with ipi=1\sum_i p_i = 1, define the mixture ρˉ=i=1npiρi\bar\rho = \sum_{i=1}^n p_i \rho_i. Then

S(ρˉ)i=1npiS(ρi). S(\bar\rho) \ge \sum_{i=1}^n p_i\, S(\rho_i).

Key hypotheses

  • Each ρi\rho_i is positive semidefinite and has unit trace: ρi0\rho_i \succeq 0 and Tr(ρi)=1\mathrm{Tr}(\rho_i)=1.
  • The coefficients form a probability vector: pi0p_i \ge 0 and ipi=1\sum_i p_i = 1.

Key conclusion

  • The map ρS(ρ)\rho \mapsto S(\rho) is concave on the convex set of density operators. In particular, classical randomization (“forgetting which state was prepared”) cannot decrease entropy.

Proof idea / significance

A standard route uses .

Introduce a classical register XX with orthonormal basis {i}\{|i\rangle\} and form the block-diagonal (classical–quantum) state ωXQ=ipiiiρi\omega_{XQ} = \sum_i p_i\, |i\rangle\langle i| \otimes \rho_i, whose QQ-marginal is ωQ=ρˉ\omega_Q = \bar\rho. One then checks the identity

S(ρˉ)ipiS(ρi)=D ⁣(ωXQωXωQ), S(\bar\rho) - \sum_i p_i S(\rho_i) = D\!\left(\omega_{XQ}\,\|\, \omega_X \otimes \omega_Q\right),

where D()D(\cdot\|\cdot) denotes quantum relative entropy. The right-hand side is nonnegative, yielding the concavity inequality.

Thermodynamically, this expresses the idea that coarse-graining or mixing increases uncertainty: entropy is increased by ignoring classical information about the preparation.