Add exported openvino model 'openvino_model.xml'

#27
by tomaarsen HF staff - opened

Hello!

This pull request has been automatically generated from the Sentence Transformers backend-export Space.

Pull Request overview

  • Add exported OpenVINO model openvino_model.xml.

Tip:

Consider testing this pull request before merging by loading the model from this PR with the revision argument:

from sentence_transformers import SentenceTransformer

# TODO: Fill in the PR number
pr_number = 2
model = SentenceTransformer(
    "shibing624/text2vec-base-chinese",
    revision=f"refs/pr/{pr_number}",
    backend="openvino",
)

# Verify that everything works as expected
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
print(embeddings.shape)

similarities = model.similarity(embeddings, embeddings)
print(similarities)

效果损失太大,emb模型不建议量化。Quantization is not recommended for embedding models as it results in significant performance degradation.

shibing624 changed pull request status to closed
shibing624 changed pull request status to open
shibing624 changed pull request status to merged

Sign up or log in to comment