GGUF llama.cpp quantized version of:

Recommended Prompt Format (ChatML)

<|im_start|>system 
Provide some context and/or instructions to the model.<|im_end|> 
<|im_start|>user 
The user’s message goes here<|im_end|> 
<|im_start|>assistant 
AI message goes here<|im_end|>

Quant Version: b3933 with imatrix

Downloads last month: 252

GGUF

Model size

7.61B params

Architecture

qwen2

2-bit

5-bit

8-bit

16-bit

32-bit

Inference Providers NEW

Image-Text-to-Text

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for AI-Engine/MiniCPM-V-2_6-GGUF

Base model

openbmb/MiniCPM-V-2_6

Quantized

(9)

this model