ExllamaV2 version of the model created by Heralax!
Original Model https://huggingface.co/Heralax/Augmental-Unholy-13b
Requires ExllamaV2, which is being developed by turboderp https://github.com/turboderp/exllamav2 under an MIT license.
Main branch is 8bpw 8h
- Downloads last month
- -