Uploaded model
- Developed by: akumaburn
- License: apache-2.0
- Un-finetuned model : unsloth/llama-3-8b-bnb-4bit
This llama model was quantized from https://huggingface.co/unsloth/llama-3-8b-bnb-4bit/tree/main without any finetuning.
Using Unsloth and Huggingface's TRL library.
- Downloads last month
- 246
Hardware compatibility
Log In
to view the estimation
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no pipeline_tag.
Model tree for akumaburn/llama-3-8b-bnb-4bit-GGUF
Base model
meta-llama/Meta-Llama-3-8B
Quantized
unsloth/llama-3-8b-bnb-4bit