Hugging Face's logo

mradermacher
/
DeepHermes-3-Llama-3-3B-Preview-i1-GGUF

Transformers
GGUF
English
Llama-3
instruct
finetune
chatml
gpt4
synthetic data
distillation
function calling
json mode
axolotl
roleplaying
chat
reasoning
r1
vllm
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
e3d5470
·
verified ·
1 Parent(s): 6dd764a

uploaded from marco

Browse files
Files changed (25) hide show
  1. .gitattributes +24 -0
  2. DeepHermes-3-Llama-3-3B-Preview.i1-IQ1_M.gguf +3 -0
  3. DeepHermes-3-Llama-3-3B-Preview.i1-IQ1_S.gguf +3 -0
  4. DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_M.gguf +3 -0
  5. DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_S.gguf +3 -0
  6. DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_XS.gguf +3 -0
  7. DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_XXS.gguf +3 -0
  8. DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_M.gguf +3 -0
  9. DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_S.gguf +3 -0
  10. DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_XS.gguf +3 -0
  11. DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_XXS.gguf +3 -0
  12. DeepHermes-3-Llama-3-3B-Preview.i1-IQ4_NL.gguf +3 -0
  13. DeepHermes-3-Llama-3-3B-Preview.i1-IQ4_XS.gguf +3 -0
  14. DeepHermes-3-Llama-3-3B-Preview.i1-Q2_K.gguf +3 -0
  15. DeepHermes-3-Llama-3-3B-Preview.i1-Q2_K_S.gguf +3 -0
  16. DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_L.gguf +3 -0
  17. DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_M.gguf +3 -0
  18. DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_S.gguf +3 -0
  19. DeepHermes-3-Llama-3-3B-Preview.i1-Q4_0.gguf +3 -0
  20. DeepHermes-3-Llama-3-3B-Preview.i1-Q4_1.gguf +3 -0
  21. DeepHermes-3-Llama-3-3B-Preview.i1-Q4_K_M.gguf +3 -0
  22. DeepHermes-3-Llama-3-3B-Preview.i1-Q4_K_S.gguf +3 -0
  23. DeepHermes-3-Llama-3-3B-Preview.i1-Q5_K_M.gguf +3 -0
  24. DeepHermes-3-Llama-3-3B-Preview.i1-Q5_K_S.gguf +3 -0
  25. DeepHermes-3-Llama-3-3B-Preview.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,27 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ DeepHermes-3-Llama-3-3B-Preview.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ DeepHermes-3-Llama-3-3B-Preview.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
DeepHermes-3-Llama-3-3B-Preview.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa862ea41ceeb59565f165818c389a035e6af46024a7a6c3d8730ac3aaa3dbff
3
+ size 924193984
DeepHermes-3-Llama-3-3B-Preview.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a71006d1cab83949a1eddbe58b293a01e6de54554d29e964978c86597a31491
3
+ size 868160704
DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b86561b090d0816a5e1a437f06288d7891afe6d1e5595ceea6f380836312adb
3
+ size 1229034688
DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01d321cdffac8e75e7daeda2879cbbd3de3d3bdb8dee6faf3c0d24d5110ee0f6
3
+ size 1154323648
DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:326bc9d57fe64cf34eeaceefcec8dd7c658e74b585b27fb7cd53cea449095261
3
+ size 1100551360
DeepHermes-3-Llama-3-3B-Preview.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a00160e79bf1cf91aa0807a893bc11fc77f6f5b77a718be233f4d0369e69916
3
+ size 1017582784
DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef7819d5c6c615210c6d4ae351dd139df3bfe96a772fad2d9290e0ee1ca1e8b1
3
+ size 1599671488
DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:895203d6250c067cfeecc18f1bf6f6d61c8aa07ccfdd8f5f79efa5f5f39adef8
3
+ size 1542851776
DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3330dc7fabb69053fb3a46a944aa7e93907d9a930312d36e69ce3df03b90097c
3
+ size 1476791488
DeepHermes-3-Llama-3-3B-Preview.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd3b581726e5415b7833915c82f243a3746d57113c67cc569f37471482fae199
3
+ size 1348768960
DeepHermes-3-Llama-3-3B-Preview.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fa46544c9b4c959f57a8d6b1fb529ffe9ce09770913c8a626b8a1da6075dfcf6
3
+ size 1917193408
DeepHermes-3-Llama-3-3B-Preview.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:078400c1fbe6c74b4e79793629612a958b584462835591661297c0b996d6d0df
3
+ size 1829113024
DeepHermes-3-Llama-3-3B-Preview.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee4e0a0c165aa48631e74098430d265a6b6d182e32e3eecb74d5e839c18aef32
3
+ size 1363938496
DeepHermes-3-Llama-3-3B-Preview.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b34091449b668b287dc1f6fcf0c45c3780d88396a5817dde763077f5689f685c
3
+ size 1274285248
DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25b34baf2aabc8bfc594bd5c6803174450d415463e5939dbb79276b6cebace49
3
+ size 1815350464
DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2794fdc5d4b259d4c3d68713213fdb6d63132974556a6842d7b28eec8dc9be2f
3
+ size 1687162048
DeepHermes-3-Llama-3-3B-Preview.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fcdbd2bd1be0c3c418fd9906f947260af0e818e38362d431a2466b16800d9cd
3
+ size 1542851776
DeepHermes-3-Llama-3-3B-Preview.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73eb769b568600b5dda89e3f05bb093f7e4b3be089380898ca254cef1396f4a6
3
+ size 1921912000
DeepHermes-3-Llama-3-3B-Preview.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27aec9169a4078f6ff9b97cba19f25c5a41f9864ae2c7f89dcbcce3831d50a94
3
+ size 2093354176
DeepHermes-3-Llama-3-3B-Preview.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:091e87061932469d7cc2b691b01eb97177ee56391b2b9a4b7436dcbd8de50321
3
+ size 2019380416
DeepHermes-3-Llama-3-3B-Preview.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc648d50f320bb0694d24747500869436250a50b3b52f2679ae7ad2926a62411
3
+ size 1928203456
DeepHermes-3-Llama-3-3B-Preview.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a3505fa7fe26f7f44122c70ee80dd7d5875d365a2fefc9e1a30df803e34ca23
3
+ size 2322156736
DeepHermes-3-Llama-3-3B-Preview.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed043621e93201722ea5c04e6f3bd43141d78d92bd0f48551c0977f886c8e4fd
3
+ size 2269514944
DeepHermes-3-Llama-3-3B-Preview.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86219f02e6b6ddfedc897b5a49459925277d13d4dfb0a7c313b6df129de52671
3
+ size 2643856576