Hugging Face's logo

SpongeEngine
/
Meta-Llama-3.1-8B-Instruct-abliterated-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
imatrix
conversational
Model card Files Community
dclipca commited on
Commit
7f3b2f3
·
verified ·
1 Parent(s): 6dea9ea

Upload folder using huggingface_hub

Browse files
Files changed (21) hide show
  1. .gitattributes +19 -0
  2. README.md +26 -0
  3. meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_M.gguf +3 -0
  4. meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_S.gguf +3 -0
  5. meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_XS.gguf +3 -0
  6. meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_XXS.gguf +3 -0
  7. meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_M.gguf +3 -0
  8. meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_S.gguf +3 -0
  9. meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_XS.gguf +3 -0
  10. meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_XXS.gguf +3 -0
  11. meta-llama-3.1-8b-instruct-abliterated-i1-IQ4_NL.gguf +3 -0
  12. meta-llama-3.1-8b-instruct-abliterated-i1-IQ4_XS.gguf +3 -0
  13. meta-llama-3.1-8b-instruct-abliterated-i1-Q2_K.gguf +3 -0
  14. meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_L.gguf +3 -0
  15. meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_M.gguf +3 -0
  16. meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_S.gguf +3 -0
  17. meta-llama-3.1-8b-instruct-abliterated-i1-Q4_K_M.gguf +3 -0
  18. meta-llama-3.1-8b-instruct-abliterated-i1-Q4_K_S.gguf +3 -0
  19. meta-llama-3.1-8b-instruct-abliterated-i1-Q5_K_M.gguf +3 -0
  20. meta-llama-3.1-8b-instruct-abliterated-i1-Q5_K_S.gguf +3 -0
  21. meta-llama-3.1-8b-instruct-abliterated-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,22 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
45
+ meta-llama-3.1-8b-instruct-abliterated-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
48
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
51
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
52
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ meta-llama-3.1-8b-instruct-abliterated-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/086.png" alt="86. House (Africa)">
17
+ <figcaption>86. House (Africa)</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/015.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>15. The Magic Flute (Die Zauberflöte), K. 620, Act II: Hell’s Vengeance Boils in My Heart – Bavarian State Opera Orchestra and Chorus / Wolfgang Sawallisch (Wolfgang Amadeus Mozart)</figcaption>
26
+ </figure>
meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72cb80b7e89303f8238b1bea82f8c87f2329279551c3a473bc05123d46120fae
3
+ size 2948281440
meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:744141ec4c407bf28270db92c95f722a96f14a30545123fba0fb892f050f498e
3
+ size 2758489184
meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02728d286f7e741d80ce3c37f42fd07b58f94d61b7b3064e07ffad8b0c720ee6
3
+ size 2605782112
meta-llama-3.1-8b-instruct-abliterated-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:207ad293b2e5099a1a0cce913024f3081023fb87ab692204ae4c5ec14504cb5b
3
+ size 2399212640
meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7fb543ddb8079f98ea270f4c5172652ab26dd112dd5555edb061c07f7a31bae
3
+ size 3784823904
meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f17a937173b515db26a8e16708fffffa83fd2bdfa000f2661f587ddf1e574e21
3
+ size 3682325600
meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ccac40ec69637fb505184702d703beaa42a2d371c790c9d552b6054a0028623
3
+ size 3518747744
meta-llama-3.1-8b-instruct-abliterated-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb4995a287b6864911b1f13a684705460c30776350f29f4a99d980045e46261f
3
+ size 3274912864
meta-llama-3.1-8b-instruct-abliterated-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1db78cb82c55dcbc6b6290498d17afaa15de049cdf4d0b36b0fcdb513fc976d8
3
+ size 4677989472
meta-llama-3.1-8b-instruct-abliterated-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4b7ac7877a153019a30ff0cb4515e0bdaee48c69b52638d9c980ec0344a87a6
3
+ size 4447663200
meta-llama-3.1-8b-instruct-abliterated-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:29bf6a5762ab8d263627148f3c67d0bcb3cb1519f0c2d77f35e38fbb8d95ecbf
3
+ size 3179132000
meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd1012f5da0b2a2a003b3620219011ee88eb977ac5d5208cb212070bc0677d05
3
+ size 4321956960
meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:204e2d9adc3c926cff4de985f7578cd6206eaaa119db48e50e85baf8dee48d59
3
+ size 4018918496
meta-llama-3.1-8b-instruct-abliterated-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c75023885bc9d7ffe38304922048974e2beb6902a62eeea50f56e46084c2764f
3
+ size 3664499808
meta-llama-3.1-8b-instruct-abliterated-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45ef9155a0a116b33079da68ba920410fd08626f11a52c4b559c3e808cb793be
3
+ size 4920734816
meta-llama-3.1-8b-instruct-abliterated-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d62aa1ef4ceb958ec4e53d50aec5e5093f5ab69f1170b666bd95141453769836
3
+ size 4692669536
meta-llama-3.1-8b-instruct-abliterated-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63a94825a6519a4ae8ee29b495684cad0796adf537524ea029026fd0e5b1eed8
3
+ size 5732988000
meta-llama-3.1-8b-instruct-abliterated-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d286c470ee21f10dc7a68a1abf810729941361de6480560fd946ef0fcbc142f
3
+ size 5599294560
meta-llama-3.1-8b-instruct-abliterated-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d62358bba5e48e12729a753e8e200f51b79b62db192e714ddb43e1b8481e9b9f
3
+ size 6596007008