Hugging Face's logo

SpongeEngine
/
LLAMA-3_8B_Unaligned_Alpha_RP_Soup-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
imatrix
conversational
Model card Files Community
dclipca commited on
Commit
cf04f56
·
verified ·
1 Parent(s): 4ade5c0

Upload folder using huggingface_hub

Browse files
Files changed (24) hide show
  1. .gitattributes +22 -0
  2. LLAMA-3_8B_Unaligned_Alpha_RP_Soup.imatrix.dat +3 -0
  3. README.md +5 -5
  4. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_S.gguf +3 -0
  5. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_XS.gguf +3 -0
  6. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_XXS.gguf +3 -0
  7. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_M.gguf +3 -0
  8. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_S.gguf +3 -0
  9. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_XS.gguf +3 -0
  10. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_XXS.gguf +3 -0
  11. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ4_NL.gguf +3 -0
  12. llama-3_8b_unaligned_alpha_rp_soup-i1-IQ4_XS.gguf +3 -0
  13. llama-3_8b_unaligned_alpha_rp_soup-i1-Q2_K.gguf +3 -0
  14. llama-3_8b_unaligned_alpha_rp_soup-i1-Q2_K_S.gguf +3 -0
  15. llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_L.gguf +3 -0
  16. llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_M.gguf +3 -0
  17. llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_S.gguf +3 -0
  18. llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_0.gguf +3 -0
  19. llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_1.gguf +3 -0
  20. llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_K_M.gguf +3 -0
  21. llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_K_S.gguf +3 -0
  22. llama-3_8b_unaligned_alpha_rp_soup-i1-Q5_K_M.gguf +3 -0
  23. llama-3_8b_unaligned_alpha_rp_soup-i1-Q5_K_S.gguf +3 -0
  24. llama-3_8b_unaligned_alpha_rp_soup-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ LLAMA-3_8B_Unaligned_Alpha_RP_Soup.imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
38
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
39
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
45
+ llama-3_8b_unaligned_alpha_rp_soup-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
47
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
49
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
52
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
53
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
56
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
57
+ llama-3_8b_unaligned_alpha_rp_soup-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
LLAMA-3_8B_Unaligned_Alpha_RP_Soup.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc57551a3641d2fa903ef7da97fb5d884e39921e75e1f222252a38f410f937d0
3
+ size 4988161
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: LLAMA-3_8B_Unaligned_Alpha_RP_Soup
3
  language:
4
  - en
5
  license: mit
@@ -13,14 +13,14 @@ tags:
13
  Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
 
15
  <figure>
16
- <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/106.png" alt="106. Airplane in flight">
17
- <figcaption>106. Airplane in flight</figcaption>
18
  </figure>
19
 
20
  <figure>
21
  <audio controls>
22
- <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/023.mp3" type="audio/mp3">
23
  Your browser does not support the audio element.
24
  </audio>
25
- <figcaption>23. Izlel e Delyu Haydutin – Valya Balkanska</figcaption>
26
  </figure>
 
1
  ---
2
+ base_model: SicariusSicariiStuff/LLAMA-3_8B_Unaligned_Alpha_RP_Soup
3
  language:
4
  - en
5
  license: mit
 
13
  Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
 
15
  <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/096.png" alt="96. Artisan with drill">
17
+ <figcaption>96. Artisan with drill</figcaption>
18
  </figure>
19
 
20
  <figure>
21
  <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/001.mp3" type="audio/mp3">
23
  Your browser does not support the audio element.
24
  </audio>
25
+ <figcaption>1. Greetings from the Secretary-General of the UN – Kurt Waldheim</figcaption>
26
  </figure>
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfc5ebcc25dcb35ce5ab875468f3a40214e9d0cde6670e3cdc10ad3d992ff895
3
+ size 2758488960
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc87db6d09432c867667ab3b364e44e4d9db9ecabd828e94a2b4366d92b92615
3
+ size 2605781888
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e001b13c3cdc63362b4c93a25f6ceffdebd9d89811b1730ff0b429ee5776f35c
3
+ size 2399212416
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b752e95b4487f5d05f83a66afdcfc98cefa12814aa340ff349e7aebf5a9e9385
3
+ size 3784823680
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a16bc181cd044e08f6c6270c051a0bdab0d55a8ff2666a25067d889ab73ba80
3
+ size 3682325376
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f72b79f6b6f3cc400db474be88f72c2956f68e8cc950f64d19f2e58792978442
3
+ size 3518747520
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28841c6b15a3101da7feb8f7bea0b716d757a25a8a5752d8a24d6a1be074a5b6
3
+ size 3274912640
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4622675e6f63bc6fa7f5247d6cc504b8aa96c3e1defcadebe086b4e3bbe5cb81
3
+ size 4677989248
llama-3_8b_unaligned_alpha_rp_soup-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7893dbfc5b45858330a2478bd91b4dd12b3daf8c960cedf83a00e3831ae3430
3
+ size 4447662976
llama-3_8b_unaligned_alpha_rp_soup-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf6598b1f57e8ceffb04a153059a7b61164bacb76970af5c551b71ed528c2a12
3
+ size 3179131776
llama-3_8b_unaligned_alpha_rp_soup-i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b670bb020aa0bb1fdbc28f75809beb94853675380e25d25c543bfddc1a78c7a
3
+ size 2988815232
llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ecc0b86d1d0424bb2a0f64264545e39a6204a588cce0b0089e9ae9f87be2433
3
+ size 4321956736
llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6028f521b044513c3df722873bffd7723209e31d4b033221b6b6c76fae57988a
3
+ size 4018918272
llama-3_8b_unaligned_alpha_rp_soup-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8de6258b99ecf888c869954f46813589d9a0e19119835fc248e144a797157c40
3
+ size 3664499584
llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bae3aeaf96776b899889922a2112935403154c544e2c0ef4e1e9c31e235151ed
3
+ size 4675892096
llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31d7357af208e5245b349e1e7e84713777cc38d9613eeaf4ca0f59276be16a03
3
+ size 5130253184
llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b24f5af2e409784177ac3326de530e255d2b4783c452a4a403611eebd0d990e7
3
+ size 4920734592
llama-3_8b_unaligned_alpha_rp_soup-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e9fbcfc11fc357300a58c9e7e3681e162e074217488b11a395075f37973d3da
3
+ size 4692669312
llama-3_8b_unaligned_alpha_rp_soup-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b426be1471f2e298ebe0d0b5252572a695d8e081f217f27d25a5d2a138f04179
3
+ size 5732987776
llama-3_8b_unaligned_alpha_rp_soup-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b5184ef8800c199ccc8c78a511a4aaf6331791d19df32e85ff0878bbebcd701
3
+ size 5599294336
llama-3_8b_unaligned_alpha_rp_soup-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15fb1286b1d3fdcc964efd284fb27c21280bc6d8405727e75c2eae0fd716e2d0
3
+ size 6596006784