Seq vs Seq: the Ettin Suite of Paired Encoders and Decoders
•
67
AI & ML interests
None defined yet.
Articles
This collection gather datasets for embeddings pre-training and fine-tuning.
Bringing BERT into modernity via both architecture changes and scaling
-
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 1.45M • 933 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 14.8k • • 139 -
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 2.91k • • 204 -
lightonai/modernbert-embed-large
Sentence Similarity • 0.4B • Updated • 2.48k • • 26
A suite of autoregressive generative models for protein sequences, with up to 1.2Bparameters, trained on over 280 million protein sequences.
900M models trained on 25BT to compare different data processing choices (filtering, sentence dedup, minhash, etc)
-
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 2.91k • • 204 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 14.8k • • 139 -
lightonai/answerai-colbert-small-v1
Sentence Similarity • 0.0B • Updated • 238 • 3 -
lightonai/colbertv2.0
Sentence Similarity • 0.1B • Updated • 4.34k • • 4
French language models. These model were trained in early 2021 following the then scaling laws and using the exact same training data as the CamemBERT
This collection gather datasets for embeddings pre-training and fine-tuning.
-
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 2.91k • • 204 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 14.8k • • 139 -
lightonai/answerai-colbert-small-v1
Sentence Similarity • 0.0B • Updated • 238 • 3 -
lightonai/colbertv2.0
Sentence Similarity • 0.1B • Updated • 4.34k • • 4
Bringing BERT into modernity via both architecture changes and scaling
-
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 1.45M • 933 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 14.8k • • 139 -
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 2.91k • • 204 -
lightonai/modernbert-embed-large
Sentence Similarity • 0.4B • Updated • 2.48k • • 26
French language models. These model were trained in early 2021 following the then scaling laws and using the exact same training data as the CamemBERT
A suite of autoregressive generative models for protein sequences, with up to 1.2Bparameters, trained on over 280 million protein sequences.
900M models trained on 25BT to compare different data processing choices (filtering, sentence dedup, minhash, etc)