Post
582
Mariusz Kurman
mkurman
AI & ML interests
AI Tech Lead | MD
Recent Activity
liked
a dataset
21 days ago
UCSC-VLAA/MedReason
liked
a dataset
about 1 month ago
FreedomIntelligence/medical-o1-reasoning-SFT
liked
a dataset
about 1 month ago
ThinkAgents/Function-Calling-with-Chain-of-Thoughts
Organizations
Posts
17
Post
878
Just released NVAMP Loss!
āļø modification of the cross-entropy loss function designed specifically for training LLMs.
āļø twist on the standard cross-entropy loss by emphasizing the importance of outlier prediction errors and dynamically normalizing token-level variance.
āļø more stable and efficient training, leading to models that generalize better.
Check it out, give it a spin, and let me know what you think!
Licensed under the Apache 2.0 license and ready to use. Happy training! š„š¤
https://github.com/mkurman/nvamp-loss
āļø modification of the cross-entropy loss function designed specifically for training LLMs.
āļø twist on the standard cross-entropy loss by emphasizing the importance of outlier prediction errors and dynamically normalizing token-level variance.
āļø more stable and efficient training, leading to models that generalize better.
Check it out, give it a spin, and let me know what you think!
Licensed under the Apache 2.0 license and ready to use. Happy training! š„š¤
https://github.com/mkurman/nvamp-loss
spaces
1
models
6
mkurman/llama-3.2-MEDIT-3B-o1-GRPO-LLM-Eval
Text Generation
ā¢
Updated
ā¢
4
mkurman/Llama-3.2-MedIT-3B-R1
Updated
ā¢
5
ā¢
1
mkurman/Llama-3.2-MedIT-SUN-2.5B-BT-GRPO
Updated
ā¢
26
ā¢
3
mkurman/Qwen2.5-14B-DeepSeek-R1-1M
Text Generation
ā¢
Updated
ā¢
338
ā¢
51
mkurman/phi4-MedIT-10B-o1
Text Generation
ā¢
Updated
ā¢
23
ā¢
4
mkurman/llama-3.2-MEDIT-3B-o1
Text Generation
ā¢
Updated
ā¢
25
ā¢
12