Linear Warm-Up
en construction
Définition
XXXXXXXX
Voir aussi Learning-Rate Warm-Up
Français
XXXXXX
Anglais
Linear Warm-Up
Linear Warmup
Gradual Warm-Up
Gradual Warmup
Linear Warmup is a learning rate schedule where we linearly increase the learning rate from a low rate to a constant rate thereafter. This reduces volatility in the early stages of training.
Source
Contributeurs: Arianne
