Hope this is converted into GGUF.
#1
by deleted - opened
I'm looking to test out a slerp clean of contamination so I hope someone like @TheBloke converts CatPPT to GGUF for us less advanced users.
Seems like nobody has bothered to do it for this model. Here's a Q8 GGUF. I had to ask a friend to quantize it for me since the python script wouldn't run properly on my computer, so there's no other smaller sizes. Hopefully helps out for you: JustData/CatPPT-7B-GGUF
No problem, enjoy!