The mathematics of uncertainty
KL divergence measures how far one distribution q is from another p: the extra surprise you pay for modeling reality p with the wrong distribution q. It's the gap inside cross-entropy:
🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.
▶ KL Divergence