```
Base: shuttleai/shuttle-3.5
Model: 4-bit quantized AWQ model
Format: AWQ (AutoAWQForCausalLM)
Bit: 4
Group Size: 128
Zero Point: True
Version: GEMM
Source: Fine-tuned with LoRA, then merged and quantized
```