Hugging Face's logo

Anthonyg5005
/
c4ai-command-r7b-12-2024-exl2

Text Generation
ExLlama2
Model card Files Community
Anthonyg5005 commited on
Commit
94a8f55
·
verified ·
1 Parent(s): fa9dd68

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +49 -15
README.md CHANGED
@@ -1,15 +1,49 @@
1
- # Exl2 quants for [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4ai-command-r7b-12-2024)
2
-
3
- ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
4
-
5
- ### BPW:
6
-
7
- [2.8](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/2.8bpw)\
8
- [3.5](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/3.5bpw)\
9
- [4.25](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/4.25bpw)\
10
- [4.5](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/4.5bpw)\
11
- [5.0](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/5.0bpw)\
12
- [6.0](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/6.0bpw)\
13
- [6.5](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/6.5bpw)\
14
- [8.0](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/8.0bpw)\
15
- [measurement.json](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/blob/main/measurement.json)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ inference: false
3
+ library_name: ExLlama2
4
+ language:
5
+ - en
6
+ - fr
7
+ - de
8
+ - es
9
+ - it
10
+ - pt
11
+ - ja
12
+ - ko
13
+ - zh
14
+ - ar
15
+ - el
16
+ - fa
17
+ - pl
18
+ - id
19
+ - cs
20
+ - he
21
+ - hi
22
+ - nl
23
+ - ro
24
+ - ru
25
+ - tr
26
+ - uk
27
+ - vi
28
+ license: cc-by-nc-4.0
29
+ base_model:
30
+ - CohereForAI/c4ai-command-r7b-12-2024
31
+ base_model_relation: quantized
32
+ pipeline_tag: text-generation
33
+ ---
34
+
35
+ # Exl2 quants for [c4ai-command-r7b-12-2024](https://huggingface.co/CohereForAI/c4ai-command-r7b-12-2024)
36
+
37
+ ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
38
+
39
+ ### BPW:
40
+
41
+ [2.8](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/2.8bpw)\
42
+ [3.5](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/3.5bpw)\
43
+ [4.25](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/4.25bpw)\
44
+ [4.5](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/4.5bpw)\
45
+ [5.0](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/5.0bpw)\
46
+ [6.0](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/6.0bpw)\
47
+ [6.5](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/6.5bpw)\
48
+ [8.0](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/tree/8.0bpw)\
49
+ [measurement.json](https://huggingface.co/Anthonyg5005/c4ai-command-r7b-12-2024-exl2/blob/main/measurement.json)