tencent
/

DeepSeek-V3.1-Terminus-W4AFP8

Text Generation

TensorRT-Model-Optimizer

text-generation-inference

8-bit precision

Model card Files Files and versions

TiaoTiaoDog commited on 12 days ago

Commit

e1f500b

·

verified ·

1 Parent(s): 9e6eee3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ The accuracy below was obtained with SGLang V0.5.3 in non-thinking mode.
 | Model                          | math_500  | gpqa  | aime2024  | mmlu-pro  |
 |:------------------------------:|:---------:|:-----:|:---------:|:---------:|
-| DeepSeek-V3.1-Terminus-W4AFP8  | 89.83     | 78.28 | 0.8       | 83.66     |
 ## Inference with SGLang

 | Model                          | math_500  | gpqa  | aime2024  | mmlu-pro  |
 |:------------------------------:|:---------:|:-----:|:---------:|:---------:|
+| DeepSeek-V3.1-Terminus-W4AFP8  | 89.83     | 78.28 | 80.0      | 83.66     |
 ## Inference with SGLang