Add notice about broken exl2 support
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ pipeline_tag: text-generation
|
|
| 7 |
library_name: transformers
|
| 8 |
---
|
| 9 |
|
|
|
|
|
|
|
| 10 |
# GLM-4-32B-0414
|
| 11 |
|
| 12 |
## Introduction
|
|
|
|
| 7 |
library_name: transformers
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# The exl2 support for GLM4 is [broken](https://github.com/turboderp-org/exllamav2/issues/772#issuecomment-2825374088), use the [exl3](https://huggingface.co/LatentWanderer/THUDM_GLM-4-32B-0414-6.5bpw-h8-exl3) instead
|
| 11 |
+
|
| 12 |
# GLM-4-32B-0414
|
| 13 |
|
| 14 |
## Introduction
|