sentence-transformers/static-similarity-mrl-multilingual-v1
Sentence Similarity
•
Updated
•
46
Dominik Weckmüller
do-me
AI & ML interests
Making AI more accessible. Working on semantic search, embeddings and Geospatial AI applications.
https://geo.rocks
Recent Activity
liked
a model
4 days ago
sentence-transformers/static-similarity-mrl-multilingual-v1
upvoted
an
article
15 days ago
Train 400x faster Static Embedding Models with Sentence Transformers
new activity
15 days ago
minishlab/README:Inferencing in Rust
Organizations
do-me's activity
liked
a
model
4 days ago
upvoted
an
article
15 days ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
•
128
Inferencing in Rust
5
#1 opened 17 days ago
by
do-me
updated
a
dataset
16 days ago
Keep new lines
#5 opened 16 days ago
by
do-me
updated
2
datasets
19 days ago
liked
a
model
20 days ago
reacted to
MoritzLaurer's
post with 🔥
22 days ago
Post
2208
🚀 Releasing a new zeroshot-classifier based on ModernBERT! Some key takeaways:
- ⚡ Speed & efficiency: It's multiple times faster and uses significantly less memory than DeBERTav3. You can use larger batch sizes and enabling bf16 (instead of fp16) gave me a ~2x speed boost as well
- 📉 Performance tradeoff: It performs slightly worse than DeBERTav3 on average across my zeroshot classification task collection
- 🧠 Use cases: I recommend using it for scenarios requiring speed and a larger context window (8k).
- 💡 What’s next? I’m preparing a newer version trained on better + longer synthetic data to fully leverage the 8k context window and improve upon the training mix of my older zeroshot-v2.0 models. I also hope that there will be a multilingual variant in the future.
Great work by https://huggingface.co/answerdotai !
If you’re looking for a high-speed zeroshot classifier, give it a try!
📄 Resources below: 👇
Base model: MoritzLaurer/ModernBERT-base-zeroshot-v2.0
Large model: MoritzLaurer/ModernBERT-large-zeroshot-v2.0
Updated zeroshot collection: MoritzLaurer/zeroshot-classifiers-6548b4ff407bb19ff5c3ad6f
ModernBERT collection with paper: answerdotai/modernbert-67627ad707a4acbf33c41deb
- ⚡ Speed & efficiency: It's multiple times faster and uses significantly less memory than DeBERTav3. You can use larger batch sizes and enabling bf16 (instead of fp16) gave me a ~2x speed boost as well
- 📉 Performance tradeoff: It performs slightly worse than DeBERTav3 on average across my zeroshot classification task collection
- 🧠 Use cases: I recommend using it for scenarios requiring speed and a larger context window (8k).
- 💡 What’s next? I’m preparing a newer version trained on better + longer synthetic data to fully leverage the 8k context window and improve upon the training mix of my older zeroshot-v2.0 models. I also hope that there will be a multilingual variant in the future.
Great work by https://huggingface.co/answerdotai !
If you’re looking for a high-speed zeroshot classifier, give it a try!
📄 Resources below: 👇
Base model: MoritzLaurer/ModernBERT-base-zeroshot-v2.0
Large model: MoritzLaurer/ModernBERT-large-zeroshot-v2.0
Updated zeroshot collection: MoritzLaurer/zeroshot-classifiers-6548b4ff407bb19ff5c3ad6f
ModernBERT collection with paper: answerdotai/modernbert-67627ad707a4acbf33c41deb
liked
a
model
about 1 month ago
liked
a
Space
about 1 month ago
upvoted
an
article
about 2 months ago
Article
EuroLLM-9B
By
•
•
106
liked
a
model
about 2 months ago
liked
a
Space
about 2 months ago
liked
a
Space
2 months ago
updated
a
dataset
3 months ago
posted
an
update
3 months ago
Post
3198
New app built based on https://huggingface.co/docs/transformers.js and
minishlab/potion-6721e0abd4ea41881417f062!
It uses the super performant CPU-only models to calculate semantic similarity fully client-side based on Excel or CSV tables.
- App: https://do-me.github.io/semantic-similarity-table/
- Code: https://github.com/do-me/semantic-similarity-table
It uses the super performant CPU-only models to calculate semantic similarity fully client-side based on Excel or CSV tables.
- App: https://do-me.github.io/semantic-similarity-table/
- Code: https://github.com/do-me/semantic-similarity-table
ONNX weights
5
#1 opened 3 months ago
by
do-me