Linear Warm-Up


en construction

Définition

XXXXXXXX

Voir aussi Learning-Rate Warm-Up

Français

XXXXXX

Anglais

Linear Warm-Up

Linear Warmup

Gradual Warm-Up

Gradual Warmup

Linear Warmup is a learning rate schedule where we linearly increase the learning rate from a low rate to a constant rate thereafter. This reduces volatility in the early stages of training.

Source

Source : Baeldung

Source : Paperwithcode

Contributeurs: Arianne