GPTQ quantized falcon-rw-1b

Branch Bits GS Act Order Damp % GPTQ Dataset Seq Len Size ExLlama Desc
main 2048 -- No 8-bit, without Act Order and no grouop size.
Downloads last month
20
Safetensors
Model size
407M params
Tensor type
I32
·
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support