Second-Order Methods

How models actually learn, from vanilla gradient descent to Adam

First-order methods use gradients. Second-order methods also use curvature, usually through the Hessian. Curvature tells the optimizer how the gradient itself changes as parameters move.

🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.

▶ Second-Order Methods
← Regularization as GeometryThe Loss Landscape →