Add exported openvino model 'openvino_model.xml'
#27
by
tomaarsen
HF staff
- opened
Hello!
This pull request has been automatically generated from the Sentence Transformers backend-export Space.
Pull Request overview
- Add exported OpenVINO model
openvino_model.xml
.
Tip:
Consider testing this pull request before merging by loading the model from this PR with the revision
argument:
from sentence_transformers import SentenceTransformer
# TODO: Fill in the PR number
pr_number = 2
model = SentenceTransformer(
"shibing624/text2vec-base-chinese",
revision=f"refs/pr/{pr_number}",
backend="openvino",
)
# Verify that everything works as expected
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
print(embeddings.shape)
similarities = model.similarity(embeddings, embeddings)
print(similarities)
效果损失太大,emb模型不建议量化。Quantization is not recommended for embedding models as it results in significant performance degradation.
shibing624
changed pull request status to
closed
shibing624
changed pull request status to
open
shibing624
changed pull request status to
merged