Shapes, Widths and Parameter Counts

How a network computes, why gradients vanish, and what makes depth trainable

A network is a list of matrices and vectors. Before any training happens you should be able to say how many numbers that list contains, where they sit, and what shape the data has at each step. Those are questions of arithmetic, and getting them wrong is the most common way a first network fails to run at all.

๐Ÿ”’ This is a Pro lesson โ€” the interactive figure, worked examples, quiz and practice open with Pro access.

โ–ถ Shapes, Widths and Parameter Counts
โ† The Hidden LayerUniversal Approximation โ†’