PierreMesure/sentence-bert-swedish-cased-gguf

This is a GGUF conversion of KBLab/sentence-bert-swedish-cased (F32).

I used llama.cpp's script (convert_hf_to_gguf.py):

python convert_hf_to_gguf.py --outtype f32 ./sentence-bert-swedish-cased --outfile ./sentence-bert-swedish-cased.F32.gguf

Usage

You can use this with any tool building on llama.cpp. I made this GGUF to import it in Ollama.

  1. Create a Modelfile:

    FROM ./sentence-bert-swedish-cased.F32.gguf
    

    Or in one command:

    git clone https://huggingface.co/PierreMesure/sentence-bert-swedish-cased-gguf
    cd sentence-bert-swedish-cased-gguf/
    echo 'FROM ./sentence-bert-swedish-cased.F32.gguf' > Modelfile
    
  2. Import with Ollama

    ollama create sentence-bert-swedish-cased
    
Downloads last month
31
GGUF
Model size
124M params
Architecture
bert

32-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for PierreMesure/sentence-bert-swedish-cased-gguf

Quantized
(1)
this model