openbmb/MiniCPM4-8B
#1033
by
mingyi456
- opened
I believe they have fixed an error that prevented GGUF conversion, and other lesser-known quant makers have their GGUFs up already. Please quant the smaller versions as well (I believe the only other size is 0.5B?), although I guess imatrix will be unnecessary for such small sizes?
Indeed, it failed when we tried. Thanks for notifying us of the fix. We did the smaller one, too, which went OK. So let's try again :)
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#MiniCPM4-8B-GGUF for quants to appear.