Hugging Face's logo

deepseek-ai
/
DeepSeek-V2-Chat

Text Generation
Transformers
Safetensors
deepseek_v2
conversational
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
16

MoE offloading strategy？

#8
by Minami-su - opened
Discussion
Minami-su

As title.

Minami-su

https://arxiv.org/abs/2312.17238

kristaller486

It's will be helpful. 236B is too large.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment