2 7 287

Jeff Cook

jeffcookio

sjuxax

AI & ML interests

None yet

Recent Activity

liked a model 4 days ago

dashtoon/hunyuan-video-keyframe-control-lora

updated a model 4 days ago

jeffcookio/Qwen2.5-VL-7B-Instruct-W4A16-G128

liked a model 5 days ago

rhymes-ai/Aria-sequential_mlp

View all activity

Organizations

None yet

jeffcookio's activity

liked a model 4 days ago

dashtoon/hunyuan-video-keyframe-control-lora

Updated 5 days ago • 58

updated a model 4 days ago

jeffcookio/Qwen2.5-VL-7B-Instruct-W4A16-G128

Updated 4 days ago • 27

liked 2 models 5 days ago

rhymes-ai/Aria-sequential_mlp

Image-Text-to-Text • Updated Nov 22, 2024 • 32 • 17

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • Updated 3 days ago • 962 • 6

reacted to ehristoforu's post with 🔥 16 days ago

Post

2721

Introducing our first standalone model – FluentlyLM Prinum

Introducing the first standalone model from Project Fluently LM! We worked on it for several months, used different approaches and eventually found the optimal one.

General characteristics:
- Model type: Causal language models (QwenForCausalLM, LM Transformer)
- Number of parameters: 32.5B
- Number of parameters (not embedded): 31.0B
- Number of layers: 64
- Context: 131,072 tokens
- Language(s) (NLP): English, French, Spanish, Russian, Chinese, Japanese, Persian (officially supported)
- License: MIT

Creation strategy:
The basis of the strategy is shown in Pic. 2.
We used Axolotl & Unsloth for SFT-finetuning with PEFT LoRA (rank=64, alpha=64) and Mergekit for SLERP and TIES mergers.

Evolution:
🏆 12th place in the Open LLM Leaderboard ( open-llm-leaderboard/open_llm_leaderboard) (21.02.2025)

Detailed results and comparisons are presented in Pic. 3.

Links:
- Model: fluently-lm/FluentlyLM-Prinum
- GGUF version: mradermacher/FluentlyLM-Prinum-GGUF
- Demo on ZeroGPU: ehristoforu/FluentlyLM-Prinum-demo