bartowski
/

Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation

Model card Files Files and versions

Llama-3_1-Nemotron-51B-Instruct-GGUF

680 GB

1 contributor

History: 30 commits

bartowski's picture

Upload folder using huggingface_hub

da2384f verified 10 months ago

Llama-3_1-Nemotron-51B-Instruct-Q8_0
Upload folder using huggingface_hub 10 months ago
.gitattributes

3.69 kB

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ2_M.gguf

17.8 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ2_M.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ2_S.gguf

16.5 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ2_S.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ2_XS.gguf

15.5 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ2_XS.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ2_XXS.gguf

14 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ2_XXS.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ3_M.gguf

23.5 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ3_M.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ3_XS.gguf

21.6 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ3_XS.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ4_NL.gguf

29.3 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ4_NL.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-IQ4_XS.gguf

27.7 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-IQ4_XS.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q2_K.gguf

19.4 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q2_K.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q2_K_L.gguf

20.4 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q2_K_L.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q3_K_L.gguf

27.3 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q3_K_L.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q3_K_M.gguf

25.2 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q3_K_M.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q3_K_S.gguf

22.7 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q3_K_S.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q3_K_XL.gguf

28.3 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q3_K_XL.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q4_0.gguf

29.3 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q4_0.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q4_K_L.gguf

31.8 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q4_K_L.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q4_K_M.gguf

31 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q4_K_M.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q4_K_S.gguf

29.5 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q4_K_S.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q5_K_L.gguf

37.1 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q5_K_L.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q5_K_M.gguf

36.5 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q5_K_M.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q5_K_S.gguf

35.6 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q5_K_S.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q6_K.gguf

42.3 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q6_K.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct-Q6_K_L.gguf

42.8 GB
xet

Upload Llama-3_1-Nemotron-51B-Instruct-Q6_K_L.gguf with huggingface_hub 11 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix

19.5 MB
xet

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix with huggingface_hub 11 months ago
README.md

15.1 kB

Remove lmstudio reference (not yet supported) 11 months ago