Anthonyg5005 commited on
Commit
da5f0bf
·
verified ·
1 Parent(s): b1496ff

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +64 -14
README.md CHANGED
@@ -1,14 +1,64 @@
1
- # Exl2 quants for [Meta-Llama-Guard-2-8B](https://huggingface.co/meta-llama/Meta-Llama-Guard-2-8B)
2
-
3
- ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
4
-
5
- Would recommend Anthonyg5005 to change up this README to include more info.
6
-
7
- ### BPW:
8
-
9
- [3.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/3.0bpw)\
10
- [4.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/4.0bpw)\
11
- [5.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/5.0bpw)\
12
- [6.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/6.0bpw)\
13
- [8.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/8.0bpw)\
14
- [measurement.json](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/blob/main/measurement.json)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - facebook
7
+ - meta
8
+ - pytorch
9
+ - llama
10
+ - llama-3
11
+ license: other
12
+ license_name: llama3
13
+ license_link: LICENSE
14
+ ---
15
+ # Exl2 quants for [Meta-Llama-Guard-2-8B](https://huggingface.co/meta-llama/Meta-Llama-Guard-2-8B)
16
+
17
+ ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
18
+
19
+ Llama Guard 2 8B is the moderation tuned llama3-8B model by Meta.\
20
+ Use this moderation model to protect your platform from unwanted generations.\
21
+ [BF16 weights](https://huggingface.co/meta-llama/Meta-Llama-Guard-2-8B/tree/main) are recommended for optimal accuracy in production environments.\
22
+ This model has the following harm categories:
23
+ <table align="center">
24
+ <thead>
25
+ <tr>
26
+ <th colspan="2">Harm categories</th>
27
+ </tr>
28
+ </thead>
29
+ <tbody>
30
+ <tr>
31
+ <td>S1: Violent Crimes</td>
32
+ <td>S2: Non-Violent Crimes</td>
33
+ </tr>
34
+ <tr>
35
+ <td>S3: Sex-Related Crimes</td>
36
+ <td>S4: Child Sexual Exploitation</td>
37
+ </tr>
38
+ <tr>
39
+ <td>S5: Specialized Advice</td>
40
+ <td>S6: Privacy</td>
41
+ </tr>
42
+ <tr>
43
+ <td>S7: Intellectual Property</td>
44
+ <td>S8: Indiscriminate Weapons </td>
45
+ </tr>
46
+ <tr>
47
+ <td>S9: Hate</td>
48
+ <td>S10: Suicide &amp; Self-Harm</td>
49
+ </tr>
50
+ <tr>
51
+ <td>S11: Sexual Content</td>
52
+ <td></td>
53
+ </tr>
54
+ </tbody>
55
+ </table>
56
+
57
+ ### BPW:
58
+
59
+ [3.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/3.0bpw)\
60
+ [4.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/4.0bpw)\
61
+ [5.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/5.0bpw)\
62
+ [6.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/6.0bpw)\
63
+ [8.0](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/tree/8.0bpw)\
64
+ [measurement.json](https://huggingface.co/Anthonyg5005/Meta-Llama-Guard-2-8B-exl2/blob/main/measurement.json)