Definition
Irreducible unitary representation
An irreducible unitary representation has no nonzero proper closed invariant subspace.
Definition
Let be a strongly continuous unitary representation on a nonzero Hilbert space. It is irreducible if its only closed invariant subspaces are and . Closedness is essential in infinite-dimensional Hilbert spaces: the definition is topological, not purely algebraic. Because every is unitary and , a closed invariant subspace is automatically reducing, so its orthogonal complement is invariant as well.
Commutant characterization
The representation is irreducible if and only if every bounded operator satisfying for all is a scalar multiple of the identity. Equivalently, the commutant of is . This is the unitary form of Schur's lemma. A nontrivial invariant subspace yields a nonscalar commuting orthogonal projection, while the spectral projections of a nonscalar self-adjoint operator in the commutant recover a nontrivial invariant subspace Folland, §3.1.
Examples and reducible cases
Every one-dimensional unitary representation is irreducible. The trivial representation on is the simplest example. A nontrivial orthogonal direct sum is reducible because each summand is a proper closed invariant subspace. An irreducible representation cannot have two orthogonal nonzero invariant summands.
Conventions and scope
References
- Gerald B. Folland, A Course in Abstract Harmonic Analysis, 2nd ed., CRC Press, 2016. DOI record. Relevant: §3.1 on invariant subspaces, irreducibility, and Schur's lemma.