bhavnicksm
/

red-beetle-base-v0

sentence-transformers

static-embeddings

Model card Files Files and versions

bhavnicksm commited on Jan 27

Commit

27af99a

·

1 Parent(s): 4f1fe5a

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -28,6 +28,8 @@ This model has been distilled from `mixedbread-ai/mxbai-embed-2d-large-v1`, with
 - **red-beetle-base-v0**: The original model, without using PCA or Zipf. The lack of PCA and Zipf also makes this a decent model for further training.
 - **red-beetle-base-v1**: The original model, with PCA at 1024 dimensions and (Zipf)^3 re-weighting.
 - **red-beetle-small-v1**: A smaller version of the original model, with PCA at 384 dimensions and (Zipf)^3 re-weighting.
 ## Installation

 - **red-beetle-base-v0**: The original model, without using PCA or Zipf. The lack of PCA and Zipf also makes this a decent model for further training.
 - **red-beetle-base-v1**: The original model, with PCA at 1024 dimensions and (Zipf)^3 re-weighting.
 - **red-beetle-small-v1**: A smaller version of the original model, with PCA at 384 dimensions and (Zipf)^3 re-weighting.
+- **red-beetle-base-v1.1**: The original model, with PCA at 1024 dimensions, Zipf and SIF re-weighting, learnt from a subset of the FineWeb-Edu sample-10BT dataset.
+- **red-beetle-small-v1.1**: A smaller version of the original model, with PCA at 384 dimensions, Zipf and SIF re-weighting, learnt from a subset of the FineWeb-Edu sample-10BT dataset.
 ## Installation