gguf model

#2
by edwardDali - opened

Please add a gguf version...your models are fantastic! :)

few more sizes (and confirmed imatrix, not sure what crusoeai does) here:

https://huggingface.co/bartowski/openchat-3.6-8b-20240522-GGUF

exl2 here also for anyone who wants:

https://huggingface.co/bartowski/openchat-3.6-8b-20240522-exl2

Sign up or log in to comment