ZClip: Adaptive Spike Mitigation for LLM Pre-Training
Paper
•
2504.02507
•
Published
•
67
Louis Owen
louisowen6
AI & ML interests
GenAI, LLM, NLP
Recent Activity
authored
a paper
2 days ago
ZClip: Adaptive Spike Mitigation for LLM Pre-Training
upvoted
a
paper
2 days ago
ZClip: Adaptive Spike Mitigation for LLM Pre-Training
commented on
a paper
2 days ago
ZClip: Adaptive Spike Mitigation for LLM Pre-Training
Organizations
louisowen6's activity
authored
a
paper
2 days ago
upvoted
a
paper
2 days ago
commented
a
paper
2 days ago
authored
a
paper
6 days ago
upvoted
a
paper
6 days ago
commented
a
paper
6 days ago
authored
a
paper
12 days ago
upvoted
a
paper
12 days ago
commented
a
paper
12 days ago
liked
a
Space
about 2 months ago
weird response when using vllm
2
#3 opened 10 months ago
by
raihan2345
authored
a
paper
about 1 year ago
upvoted
a
paper
about 1 year ago
Why llama2 and not mistral 7b?
1
#1 opened about 1 year ago
by
Kernel
updated
a
model
about 1 year ago
reacted to
vishesh-t27's
post with 🚀🔥
about 1 year ago
Post
Komodo-7B is here !! Today we are releasing the base version of Komodo-7B along with the technical report.
Komodo-7B is a family of LLMs that consist of Komodo-7B-Base and Komodo-7B-Instruct.
Komodo-7B performers really good in multiple Indonesian languages including Indonesian, Acehnese, Balinese, Banjarese, Buginese, Dayak Ngaju, Javanese, Lampungnese, Madurese, Minangkabau, Sundanese, and Toba Batak.
Our model outperforms various existing large language models including some multilingual models.
Technical Report: https://arxiv.org/abs/2403.09362
Base Model HuggingFace: Yellow-AI-NLP/komodo-7b-base
Kudos to the team @louisowen6 , @akanyaani & @biddwan Komodo: A Linguistic Expedition into Indonesia's Regional Languages (2403.09362)
Komodo-7B is a family of LLMs that consist of Komodo-7B-Base and Komodo-7B-Instruct.
Komodo-7B performers really good in multiple Indonesian languages including Indonesian, Acehnese, Balinese, Banjarese, Buginese, Dayak Ngaju, Javanese, Lampungnese, Madurese, Minangkabau, Sundanese, and Toba Batak.
Our model outperforms various existing large language models including some multilingual models.
Technical Report: https://arxiv.org/abs/2403.09362
Base Model HuggingFace: Yellow-AI-NLP/komodo-7b-base
Kudos to the team @louisowen6 , @akanyaani & @biddwan Komodo: A Linguistic Expedition into Indonesia's Regional Languages (2403.09362)
liked
a
model
about 1 year ago