RetNet


en construction

Définition

Français

architecture RetNet

Anglais

RetNet


 It is foundational architecture for LLMs, simultaneously achieving training parallelism, low-cost inference, and good performance.

Source : medium.com



Contributeurs: Patrick Drouin, wiki