HandH1998's picture

13 1

HandH1998

HandH1998

·

HandH1998

AI & ML interests

None yet

Organizations

HandH1998's activity

New activity in meituan/DeepSeek-R1-Block-INT8 3 months ago

After deploying with the latest sglang, I found that the responses when calling the interface were chaotic.

#13 opened 3 months ago by

是否有明确的sglang镜像版本推荐：）

#14 opened 3 months ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 3 months ago

Add `quantization_config` in config.json?

#4 opened 3 months ago by

运行channel INT8后sglang报错OOM

#3 opened 3 months ago by

New activity in meituan/DeepSeek-R1-Block-INT8 3 months ago

量化类型

#11 opened 4 months ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 4 months ago

Difference with Block-wise Int8?

#1 opened 4 months ago by

New activity in meituan/DeepSeek-R1-Block-INT8 4 months ago

Why hasn't the model file size changed?

#9 opened 4 months ago by

New activity in cognitivecomputations/DeepSeek-V3-AWQ 4 months ago

What calibration dataset do you use when applying AWQ?

#5 opened 4 months ago by