How models actually learn, from vanilla gradient descent to Adam
Mixed precision training uses smaller number formats for speed and memory. Instead of storing every calculation in full precision (standard 32-bit floats), many operations use float16 or bfloat16: 16-bit formats that take half the memory in exchange for less precision and, for float16, a narrower range of representable sizes.
🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.
▶ Mixed Precision & Loss Scaling