Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

unsloth
/
Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit

Image-Text-to-Text
Transformers
Safetensors
PyTorch
llama4
facebook
meta
llama
llama-4
conversational
text-generation-inference
4-bit precision
bitsandbytes
Model card Files Files and versions
xet
Community
9
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

L40 GPU facing OutOfMemoryError

1
#9 opened 22 days ago by
Rans111

vllm not starting (vllm-docker)

#8 opened about 1 month ago by
asher9972

Why Am I Getting an Out-Of-Memory Error with My GPU Specs?

2
#7 opened about 1 month ago by
chunjae

What is the mininmum VRAM required to deploy this model?

7
#6 opened about 1 month ago by
GradAscend

assert self.quant_method is not None

4
#5 opened about 1 month ago by
Seri0usLee

Model issue with 64GB ram

5
#4 opened about 1 month ago by
llama-anon

ValueError: Unrecognized image processor in unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit. Should have a `image_processor_type` key

1
#3 opened about 1 month ago by
ievnsk
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs