Doctor-Shotgun's picture
Create README.md
08e5e5b verified
---
quantized_by: Doctor-Shotgun
license: apache-2.0
language:
- en
tags:
- music
- llama
base_model: m-a-p/YuE-s2-1B-general
pipeline_tag: text-generation
---
# YuE-s2-1B-general-exl2
[m-a-p/YuE-s2-1B-general](https://huggingface.co/m-a-p/YuE-s2-1B-general) quantized with Exllamav2. It appears to remain coherent using the default calibration data without adding audio tokens.
Intended to be used with the [WIP exl2 inference repository for YuE](https://github.com/sgsdxzy/YuE-exllamav2).
Links:
- [8.0bpw-h8](https://huggingface.co/Doctor-Shotgun/YuE-s2-1B-general-exl2/tree/8.0bpw-h8)