Hugging Face's logo

bullerwins
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
3
bullerwins commited on
Commit
df24c4e
•
1 Parent(s): a4ac94c

Upload folder using huggingface_hub

Browse files
Files changed (10) hide show
  1. Meta-Llama-3.1-8B-Instruct-Q2_K.gguf +2 -2
  2. Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf +2 -2
  3. Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf +2 -2
  4. Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf +2 -2
  5. Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf +2 -2
  6. Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf +2 -2
  7. Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf +2 -2
  8. Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf +2 -2
  9. Meta-Llama-3.1-8B-Instruct-Q6_K.gguf +2 -2
  10. Meta-Llama-3.1-8B-Instruct-Q8_0.gguf +2 -2
Meta-Llama-3.1-8B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36f76cdd64fe85a8ec3f24884ef636c1811d20d9085dda0ffe5ac0bb3e3b4a80
3
- size 3179131552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:683f61e3eeea78283a6d2347874c2b5113c8894c8af802e297e7e6275c94d213
3
+ size 3179131840
Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9ddc1a667841b5fc76dae2a75ad6c9beae78b86978c6c1272c41634840e79e92
3
- size 4321956512
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b056a8c5568eb66cfee0da11e0b259e8fe5b3c880833d4c0d8e22bd8b6fe2900
3
+ size 4321956800
Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8c46f2d4b71cd52557abc429bedcfeed032f66b9c1e71fe899a1159631b70ee5
3
- size 4018918048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06068f26c7286c9d67e67e5b87571441b257865f30517bfd7ec0dbd51eb199c4
3
+ size 4018918336
Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:00fa8c59732daddb90ffa1dc47f33b3501769308c6a2e92febff7186e7b7a3d3
3
- size 3664499360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da9c21e3f133806e0cd018845a737786bf2cf0821df7ee823d0de53dd82ec1dd
3
+ size 3664499648
Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:64c9cb433f5beb37734d8f73192e7583fe3d99eb6a4c66ca2278a75a11392b16
3
- size 4920734368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:595e92fc5893cb149b6c15064e004c6ef3d4ba32dbf629cbf12aef05fc65226c
3
+ size 4920734656
Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36859bd63c6d33fa9441afa2ed18e8756e2046f4e712de1b0e9934a01576dcb1
3
- size 4692669088
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2161825b46983870f2245207d2e874a71f4b55d5a4bddab518385b5d7bf21169
3
+ size 4692669376
Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d734276c37168f2e41dc64274136cc3ed91cfea1bf87b5e159bc1ab520786808
3
- size 5732987552
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:295903fef6fb80e07d61343db9b321627a4dbbc1fc0a69c19a409522d76aff21
3
+ size 5732987840
Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:46d2bb614792c803ba9d726ddfc6def2ef85c011b371ec9c02fc38e907472b91
3
- size 5599294112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57bfbbd02a13b4da534f0cca2029f1c97b1249e23d49a58b74b81b5717d7577a
3
+ size 5599294400
Meta-Llama-3.1-8B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8888570126d3bd4bfc07a52b3fac0af705ded111a0bc5fe267c85cbd0310d34e
3
- size 6596006560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ffd9eb9001d44cd34b7a8be73d05fac3e3e18a47a5feb5c3b00b8a01fa4bc54
3
+ size 6596006848
Meta-Llama-3.1-8B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f3772912a6d68f24ec279516f7daff88f491d4b4b89504cf05d710e5294c3d51
3
- size 8540770976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d373c706df65761a174b77a80a19c95f65aad95f2c731cfb80c1c48489d46025
3
+ size 8540771264