Post
122
Excited to launch SKT-ST-X-0-3B by SKT AI Labs! 🚀🇮🇳
A powerful 3B Parameter Mixture of Experts (MoE) model optimized for high-performance reasoning with a small footprint.
--> Quick Specs:
> Total Params: ~3B | Active Params: ~1.1B (2 experts/token)
> Pre-trained on 40B tokens (SKT-OMNI-CORPUS-2T)
1.Context: 8K tokens
2.Bilingual: English & Hindi 🇬🇧🇮🇳
3. Base: Built on ST-X-0 with Mixtral stability
Get 3B intelligence at 1B inference speeds. Fully open-source under Apache-2.0! 👇
🔗 Try it on Hugging Face: sKT-Ai-Labs/SKT-ST-X-0-3B
#AI #OpenSource #LLM #MixtureOfExperts #SKTAILabs #MachineLearning
A powerful 3B Parameter Mixture of Experts (MoE) model optimized for high-performance reasoning with a small footprint.
--> Quick Specs:
> Total Params: ~3B | Active Params: ~1.1B (2 experts/token)
> Pre-trained on 40B tokens (SKT-OMNI-CORPUS-2T)
1.Context: 8K tokens
2.Bilingual: English & Hindi 🇬🇧🇮🇳
3. Base: Built on ST-X-0 with Mixtral stability
Get 3B intelligence at 1B inference speeds. Fully open-source under Apache-2.0! 👇
🔗 Try it on Hugging Face: sKT-Ai-Labs/SKT-ST-X-0-3B
#AI #OpenSource #LLM #MixtureOfExperts #SKTAILabs #MachineLearning