« Modèle sans MatMul » : différence entre les versions
(Page créée avec « == en construction == == Définition == xxxxx == Français == ''' XXXXXX''' == Anglais == ''' MatMul free models''' ==Sources== [https://arxiv.org/abs/2406.02528 Source : arxiv] Catégorie:vocabulary ») |
Aucun résumé des modifications |
||
| Ligne 5 : | Ligne 5 : | ||
== Français == | == Français == | ||
''' | ''' modèles sans multiplication matricielle''' | ||
''' modèles sans MatMul''' | |||
''' modèles sans multiplication de matrices''' | |||
== Anglais == | == Anglais == | ||
''' MatMul free models''' | ''' MatMul free models''' | ||
''' MatMul-free language models''' | |||
''' Matmul-free LM''' | |||
''MatMul free models are large language models in wich MatMul operations are completly eliminated. These models are both effective and ressource-efficient, almost like biological neural networks, since the replacement of multiplication-heavy operations with simpler additions and substraction enabled by ternary weight.'' | |||
==Sources== | ==Sources== | ||
[https://arxiv.org/abs/2406.02528 | [https://arxiv.org/abs/2406.02528 Source : arxiv] | ||
[https://www.datacamp.com/blog/matmul-free-language-models Source : datacamp] | |||
[[Catégorie:vocabulary]] | [[Catégorie:vocabulary]] | ||
Version du 16 octobre 2024 à 14:56
en construction
Définition
xxxxx
Français
modèles sans multiplication matricielle
modèles sans MatMul
modèles sans multiplication de matrices
Anglais
MatMul free models
MatMul-free language models
Matmul-free LM
MatMul free models are large language models in wich MatMul operations are completly eliminated. These models are both effective and ressource-efficient, almost like biological neural networks, since the replacement of multiplication-heavy operations with simpler additions and substraction enabled by ternary weight.
Sources
