OPEA
/

DeepSeek-V3-int4-sym-awq-inc

4-bit precision

Model card Files Files and versions

cicdatopea commited on Apr 30

Commit

68b6a44

·

verified ·

1 Parent(s): fcb46ec

Update config.json

Files changed (1) hide show

config.json +0 -1

config.json CHANGED Viewed

@@ -61,7 +61,6 @@
     "scale_dtype": "torch.float16",
     "seqlen": 2048,
     "sym": true,
-    "to_quant_block_names": null,
     "version": "gemm",
     "zero_point": false
   },

     "scale_dtype": "torch.float16",
     "seqlen": 2048,
     "sym": true,
     "version": "gemm",
     "zero_point": false
   },