Hugging Face's logo

mradermacher
/
reasoning-llama3.2-3b-GGUF

Transformers
GGUF
English
text-generation-inference
llama
trl
Inference Endpoints
conversational
Model card Files Community
mradermacher commited on
Commit
2d0958a
·
verified ·
1 Parent(s): 74e10fa

uploaded from kaos

Browse files
Files changed (13) hide show
  1. .gitattributes +12 -0
  2. reasoning-llama3.2-3b.IQ4_XS.gguf +3 -0
  3. reasoning-llama3.2-3b.Q2_K.gguf +3 -0
  4. reasoning-llama3.2-3b.Q3_K_L.gguf +3 -0
  5. reasoning-llama3.2-3b.Q3_K_M.gguf +3 -0
  6. reasoning-llama3.2-3b.Q3_K_S.gguf +3 -0
  7. reasoning-llama3.2-3b.Q4_K_M.gguf +3 -0
  8. reasoning-llama3.2-3b.Q4_K_S.gguf +3 -0
  9. reasoning-llama3.2-3b.Q5_K_M.gguf +3 -0
  10. reasoning-llama3.2-3b.Q5_K_S.gguf +3 -0
  11. reasoning-llama3.2-3b.Q6_K.gguf +3 -0
  12. reasoning-llama3.2-3b.Q8_0.gguf +3 -0
  13. reasoning-llama3.2-3b.f16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ reasoning-llama3.2-3b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ reasoning-llama3.2-3b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ reasoning-llama3.2-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
39
+ reasoning-llama3.2-3b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ reasoning-llama3.2-3b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ reasoning-llama3.2-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ reasoning-llama3.2-3b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ reasoning-llama3.2-3b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ reasoning-llama3.2-3b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ reasoning-llama3.2-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
46
+ reasoning-llama3.2-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
47
+ reasoning-llama3.2-3b.f16.gguf filter=lfs diff=lfs merge=lfs -text
reasoning-llama3.2-3b.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca4e93f8928699b4df3cb654876d0b47852d404fc2532c0d6d180a8e8ca968ce
3
+ size 1840907392
reasoning-llama3.2-3b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cfddd12736caaa7dae318a341dc1a69fa42a3f7bc99998a5b49b35fdce8403f4
3
+ size 1363936384
reasoning-llama3.2-3b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d20df06efdc284444c078b83b289a686753c97d881dbeb26a377f3204d4054f0
3
+ size 1815348352
reasoning-llama3.2-3b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df9176bdafda12815f12a6fd6f6a8c4a0126d1b1c04e3a6ff593bed2ffd15d05
3
+ size 1687159936
reasoning-llama3.2-3b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d2942e34922fd6afb4736fe01524cc8428508f626f48dec60a3762b1ee9ebdb
3
+ size 1542849664
reasoning-llama3.2-3b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:902c233b73c9c068e5676e673b4ae581a61abb6d0950d967a7a05c3a4c2d28d0
3
+ size 2019378304
reasoning-llama3.2-3b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f1e0aca123dc0339716908dcdc51082787d90f36037622103da256cedf11f35
3
+ size 1928201344
reasoning-llama3.2-3b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccf2b12a77d244b74bcbe15d03856eb3205471562a0e3412731f5a7bcdc9c716
3
+ size 2322154624
reasoning-llama3.2-3b.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c96f845821e91c6c91091737e143b0523cb74b2efe15cbdfd5c6a4e32fd224e
3
+ size 2269512832
reasoning-llama3.2-3b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23080a729999c840d1402b5f65c66058dc530614945ed76be06a675822091222
3
+ size 2643854464
reasoning-llama3.2-3b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5ec17f14d0e317e028152658a7cef988a6cdcd770c5a7c797fbeba5fc0a38fd0
3
+ size 3421899904
reasoning-llama3.2-3b.f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eeda16085233f3b9b3ea6694e8f0699e3911a9739bf05adb6ce511a242b28277
3
+ size 6433688704