How models actually learn, from vanilla gradient descent to Adam
Adam and AdamW differ in how they handle weight decay. Adam mixes an L2 penalty into the adaptive gradient update. AdamW applies weight decay as a separate shrinkage step.
🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.
▶ Adam vs AdamW