RMSProp

How models actually learn, from vanilla gradient descent to Adam

RMSProp adapts the step size separately for each parameter. It tracks a moving average of squared gradients, then divides the gradient by the root of that average.

🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.

▶ RMSProp
← MomentumAdam →