File size: 625 Bytes
0cfb56a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
base_model:
- wheattoast11/utopia-atomic
license: gemma
tags:
- bnb-my-repo
---
# wheattoast11/utopia-atomic (Quantized)
## Description
This model is a quantized version of the original model [`wheattoast11/utopia-atomic`](https://huggingface.co/wheattoast11/utopia-atomic).
It's quantized using the BitsAndBytes library to 4-bit using the [bnb-my-repo](https://huggingface.co/spaces/bnb-community/bnb-my-repo) space.
## Quantization Details
- **Quantization Type**: int4
- **bnb_4bit_quant_type**: fp4
- **bnb_4bit_use_double_quant**: True
- **bnb_4bit_compute_dtype**: bfloat16
- **bnb_4bit_quant_storage**: uint8
|