Hugging Face's logo

bartowski
/
meta-llama_Llama-4-Scout-17B-16E-Instruct-GGUF

Text Generation
GGUF
facebook
meta
llama
llama-4
imatrix
conversational
Model card Files
xet
Community
1

Using multiple gguf files?

#1
by SuperbEmphasis - opened
Discussion
SuperbEmphasis

Sorry if this is a stupid question, but how can I load multiple gguf files?

https://huggingface.co/bartowski/meta-llama_Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/meta-llama_Llama-4-Scout-17B-16E-Instruct-IQ4_XS

I've never done this before with llamacpp using the web server.

Thank you! Very excited to try this!

bartowski
 Owner

with llama.cpp (and most tools) you just need to point the tool to the first part, so

-m meta-llama_Llama-4-Scout-17B-16E-Instruct-IQ4_XS-00001-of-00002.gguf

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment