ehristoforu/Testrumoe-2x1.5b-instruct
Updated
•
15
•
1
Evgeniy Hristoforu
ehristoforu
AI & ML interests
Diffusers, LLM and others ML.
Recent Activity
new activity
9 days ago
fluently-lm/FluentlyLM-Prinum:Any plans for a Paper/Report?
updated
a model
14 days ago
ehristoforu/Testrumoe-2x1.5b-instruct
published
a model
14 days ago
ehristoforu/Testrumoe-2x1.5b-instruct
Organizations
ehristoforu's activity
Any plans for a Paper/Report?
2
#2 opened 22 days ago
by
Impulse2000
updated
a
model
14 days ago
published
a
model
14 days ago
liked
a
model
16 days ago
updated
a
collection
19 days ago
liked
a
model
19 days ago
updated
a
collection
19 days ago
liked
a
model
19 days ago
updated
a
model
21 days ago
published
a
model
21 days ago
upvoted
a
collection
22 days ago
updated
a
collection
22 days ago
updated
2
Spaces
23 days ago
replied to
their
post
23 days ago
Perhaps the seed was unsuccessful or perhaps the temperature you set or the system prompt had an effect. We are happy to answer your other questions if they appear)
replied to
their
post
24 days ago
I have 3 apples. Last week I ate 2 apples. How many apples do I have?
You currently have 3 apples. The fact that you ate 2 apples last week does not affect the number of apples you have now. So, you still have 3 apples.
replied to
their
post
28 days ago
Thank you for your interest in our model! I hope you like it)
reacted to
their
post with 🔥
28 days ago
Post
2832
Introducing our first standalone model – FluentlyLM Prinum
Introducing the first standalone model from Project Fluently LM! We worked on it for several months, used different approaches and eventually found the optimal one.
General characteristics:
- Model type: Causal language models (QwenForCausalLM, LM Transformer)
- Number of parameters: 32.5B
- Number of parameters (not embedded): 31.0B
- Number of layers: 64
- Context: 131,072 tokens
- Language(s) (NLP): English, French, Spanish, Russian, Chinese, Japanese, Persian (officially supported)
- License: MIT
Creation strategy:
The basis of the strategy is shown in Pic. 2.
We used Axolotl & Unsloth for SFT-finetuning with PEFT LoRA (rank=64, alpha=64) and Mergekit for SLERP and TIES mergers.
Evolution:
🏆 12th place in the Open LLM Leaderboard ( open-llm-leaderboard/open_llm_leaderboard) (21.02.2025)
Detailed results and comparisons are presented in Pic. 3.
Links:
- Model: fluently-lm/FluentlyLM-Prinum
- GGUF version: mradermacher/FluentlyLM-Prinum-GGUF
- Demo on ZeroGPU: ehristoforu/FluentlyLM-Prinum-demo
Introducing the first standalone model from Project Fluently LM! We worked on it for several months, used different approaches and eventually found the optimal one.
General characteristics:
- Model type: Causal language models (QwenForCausalLM, LM Transformer)
- Number of parameters: 32.5B
- Number of parameters (not embedded): 31.0B
- Number of layers: 64
- Context: 131,072 tokens
- Language(s) (NLP): English, French, Spanish, Russian, Chinese, Japanese, Persian (officially supported)
- License: MIT
Creation strategy:
The basis of the strategy is shown in Pic. 2.
We used Axolotl & Unsloth for SFT-finetuning with PEFT LoRA (rank=64, alpha=64) and Mergekit for SLERP and TIES mergers.
Evolution:
🏆 12th place in the Open LLM Leaderboard ( open-llm-leaderboard/open_llm_leaderboard) (21.02.2025)
Detailed results and comparisons are presented in Pic. 3.
Links:
- Model: fluently-lm/FluentlyLM-Prinum
- GGUF version: mradermacher/FluentlyLM-Prinum-GGUF
- Demo on ZeroGPU: ehristoforu/FluentlyLM-Prinum-demo
-
- 7 replies