Update README.md
Browse files
README.md
CHANGED
@@ -14,6 +14,7 @@ library_name: sentence-transformers
|
|
14 |
pipeline_tag: text-ranking
|
15 |
---
|
16 |
|
|
|
17 |
# hotchpotch/japanese-reranker-tiny-v2
|
18 |
|
19 |
とても小さく速い日本語リランカーモデルシリーズ(v2)です。
|
@@ -22,6 +23,8 @@ pipeline_tag: text-ranking
|
|
22 |
| --- | --- | --- | --- | --- |
|
23 |
| [hotchpotch/japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 0.8138 | 2.1s |
|
24 |
| [hotchpotch/japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 0.8699 | 6.5s |
|
|
|
|
|
25 |
| [hotchpotch/japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 0.8131 | 20.5s |
|
26 |
| [hotchpotch/japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 0.8254 | 40.3s |
|
27 |
| [hotchpotch/japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 0.8484 | 96.8s |
|
@@ -157,12 +160,12 @@ print("Scores:", scores)
|
|
157 |
|
158 |
## 小型リランカーの特徴
|
159 |
|
160 |
-
japanese-reranker-tiny-v2
|
161 |
|
162 |
1. CPUやAppleシリコン環境でも実用的な速度で動作
|
163 |
2. 高価なGPUリソースなしでもRAGシステムの精度向上が可能
|
164 |
3. エッジデバイスでの展開や低レイテンシが要求される本番環境で活用可能
|
165 |
-
4. ModernBertベースの[ruri-v3-pt-30m](https://huggingface.co/cl-nagoya/ruri-v3-pt-30m)
|
166 |
|
167 |
|
168 |
## 評価結果
|
@@ -171,6 +174,8 @@ japanese-reranker-tiny-v2とjapanese-reranker-xsmall-v2は、以下の特徴を
|
|
171 |
|---------|-----|-------|--------|--------|--------|
|
172 |
| [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 0.8138 | 0.6455 | 0.9287 | 0.7201 | 0.9608 |
|
173 |
| [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 0.8699 | 0.7403 | 0.9409 | 0.8206 | 0.9776 |
|
|
|
|
|
174 |
| [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 0.8131 | 0.6136 | 0.9376 | 0.7411 | 0.9602 |
|
175 |
| [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 0.8254 | 0.6247 | 0.9390 | 0.7776 | 0.9604 |
|
176 |
| [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 0.8484 | 0.6711 | 0.9337 | 0.8180 | 0.9708 |
|
@@ -187,6 +192,8 @@ japanese-reranker-tiny-v2とjapanese-reranker-xsmall-v2は、以下の特徴を
|
|
187 |
|---------|------------|-------------|-----------|-----------|-----------|
|
188 |
| [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 2.1s | 82s | 702s |
|
189 |
| [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 6.5s | 303s | 2300s |
|
|
|
|
|
190 |
| [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 20.5s | | |
|
191 |
| [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 40.3s | | |
|
192 |
| [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 96.8s | | |
|
|
|
14 |
pipeline_tag: text-ranking
|
15 |
---
|
16 |
|
17 |
+
|
18 |
# hotchpotch/japanese-reranker-tiny-v2
|
19 |
|
20 |
とても小さく速い日本語リランカーモデルシリーズ(v2)です。
|
|
|
23 |
| --- | --- | --- | --- | --- |
|
24 |
| [hotchpotch/japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 0.8138 | 2.1s |
|
25 |
| [hotchpotch/japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 0.8699 | 6.5s |
|
26 |
+
| [hotchpotch/japanese-reranker-small-v2](https://huggingface.co/hotchpotch/japanese-reranker-small-v2) | 13 | 384 | 0.8998 | 15.2s |
|
27 |
+
| [hotchpotch/japanese-reranker-base-v2](https://huggingface.co/hotchpotch/japanese-reranker-base-v2) | 19 | 512 | 0.9114 | 32.5s |
|
28 |
| [hotchpotch/japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 0.8131 | 20.5s |
|
29 |
| [hotchpotch/japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 0.8254 | 40.3s |
|
30 |
| [hotchpotch/japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 0.8484 | 96.8s |
|
|
|
160 |
|
161 |
## 小型リランカーの特徴
|
162 |
|
163 |
+
japanese-reranker-tiny-v2、japanese-reranker-xsmall-v2、japanese-reranker-small-v2、japanese-reranker-base-v2は、以下の特徴を持つ小型リランカーモデルです:
|
164 |
|
165 |
1. CPUやAppleシリコン環境でも実用的な速度で動作
|
166 |
2. 高価なGPUリソースなしでもRAGシステムの精度向上が可能
|
167 |
3. エッジデバイスでの展開や低レイテンシが要求される本番環境で活用可能
|
168 |
+
4. ModernBertベースの[ruri-v3-pt-30m](https://huggingface.co/cl-nagoya/ruri-v3-pt-30m)(tiny/xsmall)、[ruri-v3-pt-70m](https://huggingface.co/cl-nagoya/ruri-v3-pt-70m)(small)、[ruri-v3-pt-130m](https://huggingface.co/cl-nagoya/ruri-v3-pt-130m)(base)を利用
|
169 |
|
170 |
|
171 |
## 評価結果
|
|
|
174 |
|---------|-----|-------|--------|--------|--------|
|
175 |
| [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 0.8138 | 0.6455 | 0.9287 | 0.7201 | 0.9608 |
|
176 |
| [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 0.8699 | 0.7403 | 0.9409 | 0.8206 | 0.9776 |
|
177 |
+
| [japanese-reranker-small-v2](https://huggingface.co/hotchpotch/japanese-reranker-small-v2) | 0.8998 | 0.7633 | 0.9586 | 0.8385 | 0.9821 |
|
178 |
+
| [japanese-reranker-base-v2](https://huggingface.co/hotchpotch/japanese-reranker-base-v2) | 0.9114 | 0.7845 | 0.9603 | 0.8425 | 0.9845 |
|
179 |
| [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 0.8131 | 0.6136 | 0.9376 | 0.7411 | 0.9602 |
|
180 |
| [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 0.8254 | 0.6247 | 0.9390 | 0.7776 | 0.9604 |
|
181 |
| [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 0.8484 | 0.6711 | 0.9337 | 0.8180 | 0.9708 |
|
|
|
192 |
|---------|------------|-------------|-----------|-----------|-----------|
|
193 |
| [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 2.1s | 82s | 702s |
|
194 |
| [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 6.5s | 303s | 2300s |
|
195 |
+
| [japanese-reranker-small-v2](https://huggingface.co/hotchpotch/japanese-reranker-small-v2) | 13 | 384 | 15.2s | | |
|
196 |
+
| [japanese-reranker-base-v2](https://huggingface.co/hotchpotch/japanese-reranker-base-v2) | 19 | 512 | 32.5s | | |
|
197 |
| [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 20.5s | | |
|
198 |
| [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 40.3s | | |
|
199 |
| [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 96.8s | | |
|