Hugging Face's logo

bullerwins
/
Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
facebook
meta
llama
llama-3
Inference Endpoints
conversational
Model card Files Community
3
bullerwins commited on
Commit
6638a75
•
1 Parent(s): 774d16a

Upload folder using huggingface_hub

Browse files
Files changed (12) hide show
  1. .gitattributes +11 -0
  2. Meta-Llama-3.1-8B-Instruct-Q2_K.gguf +3 -0
  3. Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf +3 -0
  4. Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf +3 -0
  5. Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf +3 -0
  6. Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf +3 -0
  7. Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf +3 -0
  8. Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf +3 -0
  9. Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf +3 -0
  10. Meta-Llama-3.1-8B-Instruct-Q6_K.gguf +3 -0
  11. Meta-Llama-3.1-8B-Instruct-Q8_0.gguf +3 -0
  12. Meta-Llama-3.1-8B-Instruct-bf16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Meta-Llama-3.1-8B-Instruct-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Meta-Llama-3.1-8B-Instruct-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Meta-Llama-3.1-8B-Instruct-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Meta-Llama-3.1-8B-Instruct-bf16.gguf filter=lfs diff=lfs merge=lfs -text
Meta-Llama-3.1-8B-Instruct-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:931d0ce3471561a6c8337667ac5a437356942196c3baf69df7454b26c384358e
3
+ size 3179131552
Meta-Llama-3.1-8B-Instruct-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ae8c38cf572f582618882357869f7ea8cf9c96a0c18165ea831d907ace53233
3
+ size 4321956512
Meta-Llama-3.1-8B-Instruct-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c78a6fe676cc8a5fad7754ea4261b7343f660a99054536316d4a3f3e858a31fe
3
+ size 4018918048
Meta-Llama-3.1-8B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e3534509034c3c684c2fccde7db17037d3acb3c564b4b52232ce874e1b22cf6
3
+ size 3664499360
Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ed384545886c00c0b07192e2c51fda91fc0d236a25704cb1dd742763bdc7fb2
3
+ size 4920734368
Meta-Llama-3.1-8B-Instruct-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e134da69a91768cdf53c4d73e2db73a163ed9b7ac7e33b51198d562d24b1ba0a
3
+ size 4692669088
Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8256542d82b1c1337cc7279434871e144cdfcdd4f54af5da4665162d6046ac7b
3
+ size 5732987552
Meta-Llama-3.1-8B-Instruct-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2251e503d5e71e25c3bfaa6d7bde23544e0eeb65e15b7ff4a15c3c2ca888d00b
3
+ size 5599294112
Meta-Llama-3.1-8B-Instruct-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e41330056ee65d8f41636fd070dbb4e8c695a5754bcba80a744ba150afde133d
3
+ size 6596006560
Meta-Llama-3.1-8B-Instruct-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:256d535b5044217b2fc8443b17df5c5c3a3e247241c5171e51b5e3a81644eaf2
3
+ size 8540770976
Meta-Llama-3.1-8B-Instruct-bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac84ede971a0e3002acc627bdc9a249a1e7a7a4d76c590088ef15216ceb33e99
3
+ size 16068891296