Ollama version

#53
by IrIA-EU - opened

Hi. I was wondering if you have any plans to officially upload a GGUF version of Mistral Small 3.1 for Ollama, as currently all the community uploaded models seem to have issues, probably due to the lack of official Ollama compatible templates. I know the recommendation is to use vLLM, but as a Mac user, that's quite complicated. Even if it's just a plain text-to-text model, it would be highly appreciated. Thanks!

IrIA-EU changed discussion status to closed

Sign up or log in to comment