The mathematics of uncertainty
Mutual information measures how much knowing one variable tells you about another: the reduction in uncertainty about X once you observe Y. It's the KL divergence between the true joint and the "pretend they're independent" product of marginals:
🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.
▶ Mutual Information