Is that possible to use this model in Ollama?
#3
by
nick1984
- opened
I want to create a Model with below Moderfile:
FROM ./pubmedbert-base-embeddings
TEMPLATE """{{ .Prompt }}"""
But I got this Error, how to fix it
ollama create pubmedbert-embeddings -f ./Modelfile
gathering model components
copying file sha256:ec8e29d6dcb61b611b7d3fdd2982c4524e6ad985959fa7194eacfb655a8d0d51 100%
copying file sha256:b6d346be366a7d1d48332dbc9fdf3bf8960b5d879522b7799ddba59e76237ee3 100%
copying file sha256:d384b4ca85c7c1eb07767aa69479b722d255f8a40e4a484c6428982b8f18baca 100%
copying file sha256:9d715ae136f4582dfa3a1c475e93bddb316124fe25b247b2180c556ba00793f4 100%
copying file sha256:929ddc16369bb4ff6f8e92a6ee9f5e0748f2bef33989b5617533dd50beebe4ef 100%
copying file sha256:a37f83ada23e7887be6b88f4998927dbeac0038af301553c7cd5461413bf1a56 100%
copying file sha256:fb83ce924ed390dcdbc47883682193d233c782cd19d9610946c3e4e3c2e5ef38 100%
copying file sha256:691a5ce0135045c12b8410af8d472ff8de864094df40ac9af418d6c644c7588d 100%
copying file sha256:8f4b264b80206c830bebbdcae377e137925650a433b689343a63bdc9b3145460 100%
copying file sha256:6e046044df8a2fcedb10607075dca187cae61d806c0d80a96c5b81017edc90c9 100%
converting model
Error: open 1_Pooling/config.json: no such file or directory
nick1984
changed discussion title from
Is that possible to using this model in Ollama?
to Is that possible to use this model in Ollama?
I'm not familiar with creating Ollama models. But the missing file mentioned in the error does exist in the repo.
Thanks for your Reply!!! the file exist in the repo! the error is so wierd, I ask gemini for help, but could not get the correct answer!!!
Perhaps ask the Ollama team? I'm just not familiar with the Ollama stack but this is a standard sentence transformers model.
it's possible to convert the model to GGUF format?
Most likely. I'd just look up how to convert sentence transformers models to your target formats. This should be just like any other standard sentence transformers model.
Cool! Thanks a lot!!!!
davidmezzetti
changed discussion status to
closed