Maria Colombo, Xavier Fernandez-Real Girona, Lénaïc Chizat
This paper studies the infinite-width limit of deep linear neural networks (NNs) initialized with random parameters. We obtain that, when the number of parameters diverges, the training dynamics converge (in a precise sense) to the dynamics obtained from a ...
Hoboken2024
