unsloth
/

gemma-2-27b-it-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (0)

ValueError: The following `model_kwargs` are not used by the model: ['num_logits_to_keep'] (note: typos in the generate arguments will also show up in this list)

#6 opened 10 days ago by

Aphrodite/VLLM/SGLang all refuse to load this model

#5 opened about 1 year ago by

Dealing with the split safetensor files

#4 opened about 1 year ago by

How to create gguf fromm this

#3 opened about 1 year ago by

hidden state is nan

#2 opened about 1 year ago by

whats the best tool to run this model

#1 opened about 1 year ago by