A ModernBERT model (answerdotai/ModernBERT-base) fine-tuned on NLI and tabular classification datasets using sentence-transformers.

Currently, you need to install transformers from source to use ModernBERT: pip install git+https://github.com/huggingface/transformers.git. You might also want to install flash attention: pip install flash-attn.

Usage:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("clembi/ModernBERT-base-embed")

sentences = [
    "bi-directional embedding methods are cool",
    "I like playing Mario Kart",
    "They all got into the Mupalupux and drove south.",
]

embeddings = model.encode(sentences)
Downloads last month
37
Safetensors
Model size
149M params
Tensor type
F32
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for clembi/ModernBERT-base-embed

Finetuned
(181)
this model