Hugging Face's logo

Zenabius
/
calme-3.2-instruct-78b-exl2-6.5bpw

Safetensors
qwen2
6-bit
exl2
Model card Files Community
Zenabius commited on
Commit
e9807f9
·
verified ·
1 Parent(s): 7694f7e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -2,13 +2,14 @@
2
  base_model:
3
  - MaziyarPanahi/calme-3.2-instruct-78b
4
  ---
 
 
5
  EXL2 Quantizations of calme-3.2-instruct-78b
6
 
7
  Using exllamav2 release 0.2.6 for quantization.
8
 
9
  Original model: https://huggingface.co/MaziyarPanahi/calme-3.2-instruct-78b
10
 
11
- Bits 6.5bpw
12
 
13
  "quantization_config": {
14
  "quant_method": "exl2",
 
2
  base_model:
3
  - MaziyarPanahi/calme-3.2-instruct-78b
4
  ---
5
+ Bits - 6.5bpw
6
+
7
  EXL2 Quantizations of calme-3.2-instruct-78b
8
 
9
  Using exllamav2 release 0.2.6 for quantization.
10
 
11
  Original model: https://huggingface.co/MaziyarPanahi/calme-3.2-instruct-78b
12
 
 
13
 
14
  "quantization_config": {
15
  "quant_method": "exl2",