Hugging Face's logo

Anthonyg5005
/
gpt2-exl2

Text Generation
English
ExLlama2
Model card Files
xet
Community
Anthonyg5005 commited on
Commit
76f25ba
·
verified ·
1 Parent(s): 0a0beb9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -17
README.md CHANGED
@@ -1,17 +1,19 @@
1
- ---
2
- library_name: ExLlama2
3
- pipeline_tag: text-generation
4
- base_model: openai-community/gpt2
5
- base_model_relation: quantized
6
- ---
7
-
8
- # Exl2 quants for [gpt2](https://huggingface.co/openai-community/gpt2)
9
-
10
- ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
11
-
12
- ### BPW:
13
-
14
- [6.0](https://huggingface.co/Anthonyg5005/gpt2-exl2/tree/6.0bpw)\
15
- [6.5](https://huggingface.co/Anthonyg5005/gpt2-exl2/tree/6.5bpw)\
16
- [8.0](https://huggingface.co/Anthonyg5005/gpt2-exl2/tree/8.0bpw)\
17
- [measurement.json](https://huggingface.co/Anthonyg5005/gpt2-exl2/blob/main/measurement.json)
 
 
 
1
+ ---
2
+ library_name: ExLlama2
3
+ pipeline_tag: text-generation
4
+ base_model: openai-community/gpt2
5
+ base_model_relation: quantized
6
+ language: en
7
+ license: mit
8
+ ---
9
+
10
+ # Exl2 quants for [gpt2](https://huggingface.co/openai-community/gpt2)
11
+
12
+ ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
13
+
14
+ ### BPW:
15
+
16
+ [6.0](https://huggingface.co/Anthonyg5005/gpt2-exl2/tree/6.0bpw)\
17
+ [6.5](https://huggingface.co/Anthonyg5005/gpt2-exl2/tree/6.5bpw)\
18
+ [8.0](https://huggingface.co/Anthonyg5005/gpt2-exl2/tree/8.0bpw)\
19
+ [measurement.json](https://huggingface.co/Anthonyg5005/gpt2-exl2/blob/main/measurement.json)