codys12
/

bitnet-r1-qwen-32b

Text Generation

text-generation-inference

Model card Files Files and versions Community

codys12 commited on 6 days ago

Commit

bd6d9bd

·

verified ·

1 Parent(s): 075d37d

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -17,7 +17,7 @@
   "num_key_value_heads": 8,
   "quantization_config": {
     "quant_method": "bitnet",
-    "linear_class": "autobitlinear",
     "quantization_mode": "offline",
     "with_rms_norm": true
   },

   "num_key_value_heads": 8,
   "quantization_config": {
     "quant_method": "bitnet",
+    "linear_class": "bitlinear",
     "quantization_mode": "offline",
     "with_rms_norm": true
   },