Problème de l'explosion du gradient

Domaine

Catégorie Démo Apprentissage profond

Anglais

Exploding Gradient Problem

The Exploding Gradient Problem is the opposite of the Vanishing Gradient Problem. In Deep Neural Networks gradients may explode during backpropagation, resulting number overflows. A common technique to deal with exploding gradients is to perform Gradient Clipping. • On the difficulty of training recurrent neural networks