meituan
/

DeepSeek-R1-Block-INT8

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions Community

4-bits

#19

by zhnagchenchne - opened Mar 25

Mar 25

Hi! 感谢你们优秀的开源的工作，想问下，现在 int8 也需要 2**A100 之类的机器才能部署，所以想问下有计划开源 4-bit 的工作嘛

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment