openbmb

/

MiniCPM-V-4_5-gguf

like 26

Follow

OpenBMB 1.87k

gguf is the name of the format for storing weights used for inference using ggml.
ggml is the name of the library for computing operators using the gguf format.
See if this helps you.

@tc-mb I know what are gguf and ggml. The name of files is "ggml model Qxxx.gguf" but should be "MiniCPM V 4.5 Qxxx.gguf"

@light-and-ray OK, I understand what you mean.
For convenience, I can change the name of the model.
I'll take some time to complete it.

https://huggingface.co/openbmb/MiniCPM-V-4_5-gguf/blob/main/MiniCPM-V-4_5-Q4_0.gguf
@light-and-ray Could you please help me check if the name I uploaded can meet your needs?

@tc-mb yes, this naming looks good

@light-and-ray Thanks for testing it. I'm glad this works, so I'll modify the other versions according to this name and upload them one after another.

@light-and-ray Ok, I've uploaded all the renamed versions.
I'll keep the other ggml files for a while and delete them after this week.