Conditioning & Zig-Zag

How models actually learn, from vanilla gradient descent to Adam

Gradient descent behaves very differently on a round loss surface and a stretched one. Conditioning measures that stretch. Poor conditioning makes the optimizer zig-zag: one direction is steep, another is flat.

🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.

▶ Conditioning & Zig-Zag
← Schedules & WarmupMomentum →