GGUF variant/ollama support
#2
by
ruddbanga7
- opened
Are there any plans to provide GGUF variants for this model so that it can be used with ollama/llama.cpp?
Hi
@ruddbanga7
! The implementation of ModernBert is a WIP in llama.cpp: https://github.com/ggml-org/llama.cpp/pull/15641. Once it's merged, we'll get GGUF versions posted to the Granite GGUF Models Collection