Theorem
Variance of a normalized exponential weight
The variance of an exponential likelihood ratio is a ratio of moment generating functions and increases with a positive tilt parameter.
Statement
Let be a bounded real random variable and define the normalized weight , where . Then , and its variance under the original measure is
If is not almost surely constant, this variance is strictly increasing for .
Proof and limits
The formula follows by integrating . With , the derivative of is , since the tilted variance identity gives . The variance of is different from the tilted variance of . Monotonicity alone does not imply divergence as : for a Bernoulli variable with success probability , the limit is .