samgreen
/

Qwen2.5-VL-7B-Instruct-GGUF

Image-Text-to-Text

Model card Files Files and versions

samgreen commited on Apr 2

Commit

81e4294

·

verified ·

1 Parent(s): 38f79d1

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -18,6 +18,10 @@ No IMatrix.
 The fork is currently required to run inference and there's no guarantee these checkpoints will work with future builds. Temporary builds are available [here](https://github.com/green-s/llama.cpp.qwen2vl/releases). The latest tested build as of writing is `qwen25-vl-b4899-bc4163b`.
 [Original model](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct)
 ## Usage

 The fork is currently required to run inference and there's no guarantee these checkpoints will work with future builds. Temporary builds are available [here](https://github.com/green-s/llama.cpp.qwen2vl/releases). The latest tested build as of writing is `qwen25-vl-b4899-bc4163b`.
+Edit:
+As of 1-April-2025 inference support has been added to [koboldcpp](https://github.com/LostRuins/koboldcpp).
 [Original model](https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct)
 ## Usage