Representation Fine-Tuning

Définition

XXXXXXXXX

Français

XXXXXXXXX

Anglais

Representation Fine-Tuning

PYREFT, a representation fine-tuning (ReFT) library that supports adapting internal language model representations via trainable interventions. With fewer fine-tuning parameters and more robust performance, pyreft can boost fine-tuning efficiency, decrease fine-tuning cost, while opening the doors to study the interpretability of adapting parameters.

Source

Source : github