Initialisation du poids

Définition

XXXXXXXXX

Français

XXXXXXXXX

Anglais

Weight Initialization

The point of weight initialization is to make sure that a neural network doesn’t converge to a trivial solution. If the weights are all initialized to the same value(eg. equal to zero) then each unit will get exactly the same signal and every layer would behave as if it were a single cell. Therefore, you want to randomly initialize the weights near zero, but not equal to zero. This is an expectation of the stochastic optimization algorithm that’s used to train the model.

Source : towardsdatascience