Hugging Face's logo

second-state
/
Yi-6B-Chat-GGUF

Text Generation
Transformers
GGUF
llama
conversational
Model card Files Community
Xin Liu commited on
Commit
89720b6
·
1 Parent(s): deb785a

Add models

Browse files

Signed-off-by: Xin Liu <[email protected]>

Files changed (12) hide show
  1. .gitattributes +1 -0
  2. Yi-6B-Chat-Q2_K.gguf +3 -0
  3. Yi-6B-Chat-Q3_K_L.gguf +3 -0
  4. Yi-6B-Chat-Q3_K_M.gguf +3 -0
  5. Yi-6B-Chat-Q3_K_S.gguf +3 -0
  6. Yi-6B-Chat-Q4_0.gguf +3 -0
  7. Yi-6B-Chat-Q4_K_M.gguf +3 -0
  8. Yi-6B-Chat-Q4_K_S.gguf +3 -0
  9. Yi-6B-Chat-Q5_0.gguf +3 -0
  10. Yi-6B-Chat-Q5_K_S.gguf +3 -0
  11. Yi-6B-Chat-Q6_K.gguf +3 -0
  12. Yi-6B-Chat-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Yi-6B-Chat-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc806602f79ed2aebe424008cbfc686e170eaf3b4737ac48e2112d0d2f753ec3
3
+ size 2337066560
Yi-6B-Chat-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccdd89d615949ad4dbb91bfea8bcec78a10c9ac9b765079cae6e6b39f91eeff1
3
+ size 3236892224
Yi-6B-Chat-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75626fc7ea6c4e01a41170bbc43124a6bd2963b493a78b46b328d599f0529592
3
+ size 2992836160
Yi-6B-Chat-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb3e35dd5b243380804f3d38308acc35cef7b75f8204ab8a9a276a8656cb819a
3
+ size 2709196352
Yi-6B-Chat-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b952595b8f04e799c2d89d580f643a4b18a97af2496c89916def76fb8b2b5e8
3
+ size 3479326272
Yi-6B-Chat-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d576bd9326c2c33e0fa1cb06126c9142b87124209471e50c84c6784061d89f21
3
+ size 3673968192
Yi-6B-Chat-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5050681a0f9f8aff8836cd8b873f01a99c36758214958952e8f68064dfb80cce
3
+ size 3502919232
Yi-6B-Chat-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:638bb22db311dec304a100f08481b20d2c735bc1e16d3c38c6badd1a6d141a3a
3
+ size 4204154432
Yi-6B-Chat-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bc210a78a21ac0a8e1780ee4b44372f2918ddfa6e63bf115d9a147dbe2ed6cb
3
+ size 4204154432
Yi-6B-Chat-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e0052b8971dcbc21f73d12db00526f0325851b0b26c597fea868f5f5dd2276b
3
+ size 4974284352
Yi-6B-Chat-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e98959bfa3bddc221eb45ba9d870174844e7de9e9b8f05e0b953e100e5ebe343
3
+ size 6442126912