The Learning Rate

How models actually learn, from vanilla gradient descent to Adam

The learning rate is the step size of gradient descent. The gradient says which way the loss rises fastest; the optimizer moves the opposite way. The learning rate η decides how far it moves.

🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.

▶ The Learning Rate
← Why Optimization in ML?Schedules & Warmup →