Statement

Let π\pi be a unitary representation of a group GG on a nonzero complex H\mathcal H. Schur's lemma for unitary representations states that π\pi is if and only if every bounded operator TT satisfying

Tπ(g)=π(g)T(gG)T\pi(g)=\pi(g)T\qquad(g\in G)

is a scalar multiple of the identity. Equivalently, the commutant π(G)\pi(G)' equals CI\mathbb C I. Here irreducibility means that H\mathcal H has no nonzero proper closed invariant subspace. No finite-dimensionality, compactness, or local compactness hypothesis on GG is required.

Proof mechanism

If a closed subspace is invariant under a unitary representation, its is invariant, so the corresponding orthogonal projection lies in the commutant. Conversely, for a self-adjoint operator in the commutant, every spectral projection also commutes with π(G)\pi(G). Irreducibility forces all these projections to be 00 or II, hence the operator is scalar. Applying this to the real and imaginary parts of an arbitrary commutant element proves the theorem Folland, Theorem 3.5.

Intertwiners between irreducibles

Let π\pi and σ\sigma be irreducible unitary representations and let TT be a bounded from π\pi to σ\sigma. Then T=0T=0, or TT is a positive scalar multiple of a unitary intertwiner. Thus inequivalent irreducibles admit no nonzero bounded intertwiner; if π=σ\pi=\sigma, every such TT is scalar. This follows by applying the commutant statement to TTT^*T and TTTT^*.

Conventions and scope
References
  1. Gerald B. Folland, A Course in Abstract Harmonic Analysis, 2nd ed., CRC Press, 2016. DOI record. Relevant: §3.1, especially Theorem 3.5.
  2. Jacques Dixmier, CC^*-Algebras, North-Holland Mathematical Library 15, North-Holland, 1977. Publisher record. Relevant: Chapter 2 on representations and commutants.