ECE-TRIOMPHANT-2.1-YL-72B-SLERP-V1
This model has been produced by:
- ROBERGE Marial, engineering student at French Engineering School ECE
- ESCRIVA Mathis, engineering student at French Engineering School ECE
- LALAIN Youri, engineering student at French Engineering School ECE
- RAGE LILIAN, engineering student at French Engineering School ECE
- HUVELLE Baptiste, engineering student at French Engineering School ECE
Under the supervision of:
- Andre-Louis Rochet, Lecturer at ECE & Co-Founder of TW3 Partners
- Paul Lemaistre, CTO of TW3 Partners
With the contribution of:
- ECE engineering school as sponsor and financial contributor
- François STEPHAN as director of ECE
- Gérard REUS as acting director of iLAB
- Matthieu JOLLARD ECE Alumni
- Louis GARCIA ECE Alumni
Supervisory structure
The iLab (intelligence Lab) is a structure created by the ECE and dedicated to artificial intelligence
About ECE
ECE, a multi-program, multi-campus, and multi-sector engineering school specializing in digital engineering, trains engineers and technology experts for the 21st century, capable of meeting the challenges of the dual digital and sustainable development revolutions.
ECE-TRIOMPHANT-2.1-YL-72B-SLERP-V1 est un modèle de langage fusionné créé à partir des modèles Sakalti/ultiima-72B et MaziyarPanahi/calme-3.2-instruct-78b. Grâce à la méthode SLERP (Spherical Linear Interpolation), il combine les forces des deux architectures pour offrir des performances optimales sur des tâches complexes de traitement du langage naturel (NLP).
Caractéristiques
- Méthode de fusion : SLERP (Spherical Linear Interpolation).
- Modèles sources :
- Points forts :
- Performances améliorées sur des tâches multi-domaines et de raisonnement.
- Capacité de traitement étendue grâce à la fusion des couches critiques.
- Optimisation en bfloat16 pour des calculs rapides et efficaces.
- Applications cibles :
- Raisonnement mathématique.
- Compréhension contextuelle.
- Tâches instructives (Instruction Following).
- Downloads last month
- 98