« Peaufinage de représentations » : différence entre les versions
Aucun résumé des modifications |
Aucun résumé des modifications |
||
| (4 versions intermédiaires par 2 utilisateurs non affichées) | |||
| Ligne 1 : | Ligne 1 : | ||
== Définition == | == Définition == | ||
== Français == | == Français == | ||
| Ligne 7 : | Ligne 6 : | ||
''' peaufinage d'espace latent ''' | ''' peaufinage d'espace latent ''' | ||
== Anglais == | == Anglais == | ||
''' representation fine-tuning ''' | ''' representation fine-tuning ''' | ||
<!-- PYREFT, a representation fine-tuning (ReFT) library that supports adapting internal language model representations via trainable interventions. With fewer fine-tuning parameters and more robust performance, pyreft can boost fine-tuning efficiency, decrease fine-tuning cost, while opening the doors to study the interpretability of adapting parameters. --> | <!-- PYREFT, a representation fine-tuning (ReFT) library that supports adapting internal language model representations via trainable interventions. With fewer fine-tuning parameters and more robust performance, pyreft can boost fine-tuning efficiency, decrease fine-tuning cost, while opening the doors to study the interpretability of adapting parameters. --> | ||
== Source == | == Source == | ||
[https://arxiv.org/pdf/2404.03592 | [https://arxiv.org/pdf/2404.03592 ''ReFT: Representation Finetuning for Language Models'', Wu et al. (2024)] | ||
[https://blog.paperspace.com/reft-representation-finetuning-for-language-models/ | [https://blog.paperspace.com/reft-representation-finetuning-for-language-models/ ''ReFT: Representation Finetuning for Language Models'', Shaoni Mukherjee (2024)] | ||
[https://medium.com/@techsachin/representation-fine-tuning-reft-a-powerful-parameter-efficient-way-to-fine-tune-language-models-3bc6dd14e8b5 | [https://medium.com/@techsachin/representation-fine-tuning-reft-a-powerful-parameter-efficient-way-to-fine-tune-language-models-3bc6dd14e8b5 ''Representation fine-tuning (ReFT): A Powerful Parameter-Efficient Way to Fine-tune Language Models'', Sachin Mukar] | ||
[https://github.com/stanfordnlp/pyreft | [https://github.com/stanfordnlp/pyreft Github - PYREFT] | ||
[[Catégorie: | [[Catégorie:GRAND LEXIQUE FRANÇAIS]] | ||
Dernière version du 13 juin 2024 à 23:30
Définition
Français
peaufinage de représentations
peaufinage d'espace latent
Anglais
representation fine-tuning
Source
ReFT: Representation Finetuning for Language Models, Wu et al. (2024)
ReFT: Representation Finetuning for Language Models, Shaoni Mukherjee (2024)
Contributeurs: Patrick Drouin, wiki
