featherless-ai-quants
/

minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-GGUF

Text Generation

Model card Files Files and versions

minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-GGUF

9.13 GB

1 contributor

History: 2 commits

m8than's picture

Upload folder using huggingface_hub

eabe149 verified 4 months ago

.gitattributes

2.63 kB

Upload folder using huggingface_hub 4 months ago
README.md

3.86 kB

Upload folder using huggingface_hub 4 months ago
featherless-quants.png

1.61 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-IQ4_XS.gguf

748 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q2_K.gguf

581 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q3_K_L.gguf

733 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q3_K_M.gguf

691 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q3_K_S.gguf

642 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q4_K_M.gguf

808 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q4_K_S.gguf

776 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q5_K_M.gguf

911 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q5_K_S.gguf

893 MB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q6_K.gguf

1.02 GB
xet

Upload folder using huggingface_hub 4 months ago
minpeter-Llama-3.2-1B-AlternateTokenizer-chatml-Q8_0.gguf

1.32 GB
xet

Upload folder using huggingface_hub 4 months ago