Hugging Face's logo

unsloth
/
Llama-3_1-Nemotron-Ultra-253B-v1-GGUF

Text Generation
Transformers
GGUF
PyTorch
English
nemotron-nas
nvidia
llama-3
custom_code
conversational
Model card Files
xet
Community
2
danielhanchen commited on
Commit
7cddbb2
·
verified ·
1 Parent(s): 081fa8d

Add files using upload-large-folder tool

Browse files
Files changed (22) hide show
  1. .gitattributes +21 -0
  2. Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00001-of-00003.gguf +3 -0
  3. Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00002-of-00003.gguf +3 -0
  4. Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00003-of-00003.gguf +3 -0
  5. Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00001-of-00003.gguf +3 -0
  6. Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00002-of-00003.gguf +3 -0
  7. Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00003-of-00003.gguf +3 -0
  8. Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00001-of-00004.gguf +3 -0
  9. Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00002-of-00004.gguf +3 -0
  10. Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00003-of-00004.gguf +3 -0
  11. Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00004-of-00004.gguf +3 -0
  12. UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00001-of-00005.gguf +3 -0
  13. UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00002-of-00005.gguf +3 -0
  14. UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00003-of-00005.gguf +3 -0
  15. UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00004-of-00005.gguf +3 -0
  16. UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00005-of-00005.gguf +3 -0
  17. UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00001-of-00006.gguf +3 -0
  18. UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00002-of-00006.gguf +3 -0
  19. UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00003-of-00006.gguf +3 -0
  20. UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00004-of-00006.gguf +3 -0
  21. UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00005-of-00006.gguf +3 -0
  22. UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00006-of-00006.gguf +3 -0
.gitattributes CHANGED
@@ -110,3 +110,24 @@ IQ4_NL/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_NL-00002-of-00003.gguf filter=lfs di
110
  IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
111
  IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
112
  IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
111
  IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
112
  IQ4_XS/Llama-3_1-Nemotron-Ultra-253B-v1-IQ4_XS-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
113
+ Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00004-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
114
+ UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00005-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
115
+ UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00006-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
116
+ UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00004-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
117
+ UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00003-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
118
+ Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00003-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
119
+ Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
120
+ UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00002-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
121
+ UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00001-of-00006.gguf filter=lfs diff=lfs merge=lfs -text
122
+ Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
123
+ Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00002-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
124
+ UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
125
+ Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00003-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
126
+ UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
127
+ Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
128
+ UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
129
+ Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00001-of-00004.gguf filter=lfs diff=lfs merge=lfs -text
130
+ UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
131
+ Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00001-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
132
+ Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00002-of-00003.gguf filter=lfs diff=lfs merge=lfs -text
133
+ UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4353c5c0e5b57001b61c84b5119131d55bc9a7548786124ec051a5f2fe712ac3
3
+ size 50001361216
Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8be50be68854172b52a885d7cbaa6fc8331aba5d2ea8a77404995f699d1b46ea
3
+ size 49982417376
Q3_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q3_K_S-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80617d2049f223d4c02172aee71f3b52ffc907cbb704f4c987f0f16a54813ccb
3
+ size 9736819520
Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00001-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd4d18d1bedf11058dc369918419053d8def504c44e46a1da0eb4c4f76649ebe
3
+ size 49917732384
Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00002-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:545be6eda61bf48bc4a2d8c563e2042d499603c9407321d7aa51b592c6ea0c28
3
+ size 46934537824
Q4_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q4_K_S-00003-of-00003.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60ad7bee47390ef4b2d12ef8b2713a623bf86dcd888b504bce1cd65aa0803f41
3
+ size 47531956704
Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00001-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1860548c9552812ae43cb5be0ed01c91d7a3a11ebbfb638baf01b952e4f0975
3
+ size 49672297728
Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00002-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a26621c1b57385e2099d65ee5c67dc0e5f742c213bdfd39ebf5f9eefe1b152e0
3
+ size 49788565312
Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00003-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4d960db7f4a43b7197b2adf09280d8f6d76096528bb8ce8bc4492b659c4137f
3
+ size 47438498528
Q5_K_S/Llama-3_1-Nemotron-Ultra-253B-v1-Q5_K_S-00004-of-00004.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a1a99f5a874b10887e3f9b4ee9ace663ea38d4900c9dfd1832ef13b203661a6
3
+ size 27608881088
UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00001-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:514e9bf30a3c4acc88d38c0ffda1d8f4bc7a624fba7b73a3902238893142b964
3
+ size 49619964832
UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00002-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a6485f1bc8c2c9c8dbdc1b2043932fb05337399cce6b434d731bd07a435442e
3
+ size 49604798144
UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00003-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1160001d66cf3befe66d632b44e7159b17c40b61bb752c337e40e5959b5b8f1
3
+ size 44757492352
UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00004-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:552b9f073ddfd03a9aa98ca810e10225482a29edb951b02c21e63fe604536c35
3
+ size 49921459616
UD-Q6_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q6_K_XL-00005-of-00005.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1adb533c65071ed87b664784122eea75b651f02dc763f8a1e309a40a3ce1b449
3
+ size 21077431456
UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00001-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7682e7ef4a8e285fd371d04f1fbd03787672f00f849b22dd4b81c780588898d4
3
+ size 49839179104
UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00002-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d5e3bfb134f3e1d31cb01969ef9ca6cc39bb79515608e7cb56dc7bede97e1e9
3
+ size 49508524576
UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00003-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f0bb86a969401af0ba7cbdc2e9c4a94dcc9db1c2f517fa8b1b7ee4dafe05907
3
+ size 49921074336
UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00004-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d9dfc723dcce61e537a53abbdb9fb8d9b525e90cc5135c1a5a6c7d87e6d686e
3
+ size 44481450368
UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00005-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1abe843c2f65b5d0cbce3687fa3547cf1953c01fbf6439b8a2952b37aa0db10
3
+ size 45402423968
UD-Q8_K_XL/Llama-3_1-Nemotron-Ultra-253B-v1-UD-Q8_K_XL-00006-of-00006.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:593cd44d402d010e2208e4f548843de1da76bc2970d2aedd6b6a4c3d475bf9a9
3
+ size 41799260032