PLLuM 8x7B chat - EXL3 request & questions about the future of the project
#1
by
Ziemniak9781
- opened
Hi, Just wondering if anyone is considering making an EXL3 quant of the models? I could really use 8x7b chat one but unfortunately don't have the resources to run the quantization myself.
Also, is PLLuM going to be an ongoing project? It performs really well, but the dialogue sometimes feels a bit stiff. Something with the attitude and flow of GPT-4o combined with PLLuM's would be amazing.