README.md

---
quantized_by: Doctor-Shotgun
license: apache-2.0
language:
- en
tags:
- music
- llama
base_model: m-a-p/YuE-s2-1B-general
pipeline_tag: text-generation
---

# YuE-s2-1B-general-exl2

[m-a-p/YuE-s2-1B-general](https://huggingface.co/m-a-p/YuE-s2-1B-general) quantized with Exllamav2. It appears to remain coherent using the default calibration data without adding audio tokens.

Intended to be used with the [WIP exl2 inference repository for YuE](https://github.com/sgsdxzy/YuE-exllamav2).

Links:
- [8.0bpw-h8](https://huggingface.co/Doctor-Shotgun/YuE-s2-1B-general-exl2/tree/8.0bpw-h8)