How models actually learn, from vanilla gradient descent to Adam
Full-batch gradient descent uses every training example to compute each update; stochastic gradient descent goes to the other extreme and uses just one. Mini-batch gradient descent sits in between with a small batch, and that compromise is what deep learning actually runs on.
🔒 This is a Pro lesson — the interactive figure, worked examples, quiz and practice open with Pro access.
▶ Stochastic & Mini-Batch GD