metadata
base_model:
- wheattoast11/utopia-atomic
license: gemma
tags:
- bnb-my-repo
wheattoast11/utopia-atomic (Quantized)
Description
This model is a quantized version of the original model wheattoast11/utopia-atomic.
It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.
Quantization Details
- Quantization Type: int4
- bnb_4bit_quant_type: fp4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
- bnb_4bit_quant_storage: uint8