hotchpotch commited on
Commit
189f770
·
verified ·
1 Parent(s): a8b92ad

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -14,6 +14,7 @@ library_name: sentence-transformers
14
  pipeline_tag: text-ranking
15
  ---
16
 
 
17
  # hotchpotch/japanese-reranker-tiny-v2
18
 
19
  とても小さく速い日本語リランカーモデルシリーズ(v2)です。
@@ -22,6 +23,8 @@ pipeline_tag: text-ranking
22
  | --- | --- | --- | --- | --- |
23
  | [hotchpotch/japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 0.8138 | 2.1s |
24
  | [hotchpotch/japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 0.8699 | 6.5s |
 
 
25
  | [hotchpotch/japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 0.8131 | 20.5s |
26
  | [hotchpotch/japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 0.8254 | 40.3s |
27
  | [hotchpotch/japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 0.8484 | 96.8s |
@@ -157,12 +160,12 @@ print("Scores:", scores)
157
 
158
  ## 小型リランカーの特徴
159
 
160
- japanese-reranker-tiny-v2japanese-reranker-xsmall-v2は、以下の特徴を持つ小型リランカーモデルです:
161
 
162
  1. CPUやAppleシリコン環境でも実用的な速度で動作
163
  2. 高価なGPUリソースなしでもRAGシステムの精度向上が可能
164
  3. エッジデバイスでの展開や低レイテンシが要求される本番環境で活用可能
165
- 4. ModernBertベースの[ruri-v3-pt-30m](https://huggingface.co/cl-nagoya/ruri-v3-pt-30m)を利用
166
 
167
 
168
  ## 評価結果
@@ -171,6 +174,8 @@ japanese-reranker-tiny-v2とjapanese-reranker-xsmall-v2は、以下の特徴を
171
  |---------|-----|-------|--------|--------|--------|
172
  | [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 0.8138 | 0.6455 | 0.9287 | 0.7201 | 0.9608 |
173
  | [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 0.8699 | 0.7403 | 0.9409 | 0.8206 | 0.9776 |
 
 
174
  | [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 0.8131 | 0.6136 | 0.9376 | 0.7411 | 0.9602 |
175
  | [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 0.8254 | 0.6247 | 0.9390 | 0.7776 | 0.9604 |
176
  | [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 0.8484 | 0.6711 | 0.9337 | 0.8180 | 0.9708 |
@@ -187,6 +192,8 @@ japanese-reranker-tiny-v2とjapanese-reranker-xsmall-v2は、以下の特徴を
187
  |---------|------------|-------------|-----------|-----------|-----------|
188
  | [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 2.1s | 82s | 702s |
189
  | [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 6.5s | 303s | 2300s |
 
 
190
  | [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 20.5s | | |
191
  | [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 40.3s | | |
192
  | [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 96.8s | | |
 
14
  pipeline_tag: text-ranking
15
  ---
16
 
17
+
18
  # hotchpotch/japanese-reranker-tiny-v2
19
 
20
  とても小さく速い日本語リランカーモデルシリーズ(v2)です。
 
23
  | --- | --- | --- | --- | --- |
24
  | [hotchpotch/japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 0.8138 | 2.1s |
25
  | [hotchpotch/japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 0.8699 | 6.5s |
26
+ | [hotchpotch/japanese-reranker-small-v2](https://huggingface.co/hotchpotch/japanese-reranker-small-v2) | 13 | 384 | 0.8998 | 15.2s |
27
+ | [hotchpotch/japanese-reranker-base-v2](https://huggingface.co/hotchpotch/japanese-reranker-base-v2) | 19 | 512 | 0.9114 | 32.5s |
28
  | [hotchpotch/japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 0.8131 | 20.5s |
29
  | [hotchpotch/japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 0.8254 | 40.3s |
30
  | [hotchpotch/japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 0.8484 | 96.8s |
 
160
 
161
  ## 小型リランカーの特徴
162
 
163
+ japanese-reranker-tiny-v2japanese-reranker-xsmall-v2、japanese-reranker-small-v2、japanese-reranker-base-v2は、以下の特徴を持つ小型リランカーモデルです:
164
 
165
  1. CPUやAppleシリコン環境でも実用的な速度で動作
166
  2. 高価なGPUリソースなしでもRAGシステムの精度向上が可能
167
  3. エッジデバイスでの展開や低レイテンシが要求される本番環境で活用可能
168
+ 4. ModernBertベースの[ruri-v3-pt-30m](https://huggingface.co/cl-nagoya/ruri-v3-pt-30m)(tiny/xsmall)、[ruri-v3-pt-70m](https://huggingface.co/cl-nagoya/ruri-v3-pt-70m)(small)、[ruri-v3-pt-130m](https://huggingface.co/cl-nagoya/ruri-v3-pt-130m)(base)を利用
169
 
170
 
171
  ## 評価結果
 
174
  |---------|-----|-------|--------|--------|--------|
175
  | [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 0.8138 | 0.6455 | 0.9287 | 0.7201 | 0.9608 |
176
  | [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 0.8699 | 0.7403 | 0.9409 | 0.8206 | 0.9776 |
177
+ | [japanese-reranker-small-v2](https://huggingface.co/hotchpotch/japanese-reranker-small-v2) | 0.8998 | 0.7633 | 0.9586 | 0.8385 | 0.9821 |
178
+ | [japanese-reranker-base-v2](https://huggingface.co/hotchpotch/japanese-reranker-base-v2) | 0.9114 | 0.7845 | 0.9603 | 0.8425 | 0.9845 |
179
  | [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 0.8131 | 0.6136 | 0.9376 | 0.7411 | 0.9602 |
180
  | [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 0.8254 | 0.6247 | 0.9390 | 0.7776 | 0.9604 |
181
  | [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 0.8484 | 0.6711 | 0.9337 | 0.8180 | 0.9708 |
 
192
  |---------|------------|-------------|-----------|-----------|-----------|
193
  | [japanese-reranker-tiny-v2](https://huggingface.co/hotchpotch/japanese-reranker-tiny-v2) | 3 | 256 | 2.1s | 82s | 702s |
194
  | [japanese-reranker-xsmall-v2](https://huggingface.co/hotchpotch/japanese-reranker-xsmall-v2) | 10 | 256 | 6.5s | 303s | 2300s |
195
+ | [japanese-reranker-small-v2](https://huggingface.co/hotchpotch/japanese-reranker-small-v2) | 13 | 384 | 15.2s | | |
196
+ | [japanese-reranker-base-v2](https://huggingface.co/hotchpotch/japanese-reranker-base-v2) | 19 | 512 | 32.5s | | |
197
  | [japanese-reranker-cross-encoder-xsmall-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-xsmall-v1) | 6 | 384 | 20.5s | | |
198
  | [japanese-reranker-cross-encoder-small-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-small-v1) | 12 | 384 | 40.3s | | |
199
  | [japanese-reranker-cross-encoder-base-v1](https://huggingface.co/hotchpotch/japanese-reranker-cross-encoder-base-v1) | 12 | 768 | 96.8s | | |