FineWeb2 Edu Japanese: A high-quality, filtered Japanese dataset (120M texts, 89.3B tokens) for educational AI training.
Yuichi Tateno PRO
hotchpotch
AI & ML interests
Information Retrieval with LLMs
Recent Activity
upvoted
an
article
6 days ago
Introducing RTEB: A New Standard for Retrieval Evaluation
upvoted
an
article
15 days ago
Nemotron-Personas-Japan: Synthesized Data for Sovereign AI
liked
a dataset
16 days ago
nvidia/Nemotron-Personas-Japan
Organizations
日本語rerankerシリーズ
-
hotchpotch/japanese-reranker-tiny-v2
Text Ranking • 0.0B • Updated • 699 • 6 -
hotchpotch/japanese-reranker-xsmall-v2
Text Ranking • 0.0B • Updated • 53.2k • 2 -
hotchpotch/japanese-reranker-small-v2
Text Ranking • 0.1B • Updated • 484 • 2 -
hotchpotch/japanese-reranker-base-v2
Text Ranking • 0.1B • Updated • 418 • 3
FineWeb2 Edu Japanese: A high-quality, filtered Japanese dataset (120M texts, 89.3B tokens) for educational AI training.
日本語rerankerシリーズ
-
hotchpotch/japanese-reranker-tiny-v2
Text Ranking • 0.0B • Updated • 699 • 6 -
hotchpotch/japanese-reranker-xsmall-v2
Text Ranking • 0.0B • Updated • 53.2k • 2 -
hotchpotch/japanese-reranker-small-v2
Text Ranking • 0.1B • Updated • 484 • 2 -
hotchpotch/japanese-reranker-base-v2
Text Ranking • 0.1B • Updated • 418 • 3
spaces
4
Runtime error
3
Japanese Splade Demo Streamlit
📉
Convert text to SPLADE token scores
Sleeping
TokenViz: AutoTokenizer Visualization Tool
🔍
Visualize the results of AutoTokenizer
Sleeping
Secon Dev Site Search
🐨
Running
5
Wikipedia Japanese Rag Search
😻
Ask questions about Wikipedia articles in Japanese
models
35
hotchpotch/japanese-reranker-small-v2
Text Ranking
•
0.1B
•
Updated
•
484
•
2
hotchpotch/japanese-reranker-base-v2
Text Ranking
•
0.1B
•
Updated
•
418
•
3
hotchpotch/japanese-reranker-xsmall-v2
Text Ranking
•
0.0B
•
Updated
•
53.2k
•
2
hotchpotch/japanese-reranker-tiny-v2
Text Ranking
•
0.0B
•
Updated
•
699
•
6
hotchpotch/japanese-reranker-cross-encoder-small-v1
Text Ranking
•
0.1B
•
Updated
•
6.65k
•
3
hotchpotch/japanese-reranker-cross-encoder-base-v1
Text Ranking
•
0.1B
•
Updated
•
1.11k
•
1
hotchpotch/japanese-reranker-cross-encoder-large-v1
Text Ranking
•
0.3B
•
Updated
•
4.56k
•
16
hotchpotch/japanese-bge-reranker-v2-m3-v1
Text Ranking
•
0.6B
•
Updated
•
365
•
15
hotchpotch/japanese-reranker-cross-encoder-xsmall-v1
Text Ranking
•
0.1B
•
Updated
•
3.72k
•
7
hotchpotch/query-crafter-japanese-Qwen3-1.7B
2B
•
Updated
•
10
•
11
datasets
24
hotchpotch/miracl-hf-unified
Viewer
•
Updated
•
106M
•
685
hotchpotch/JFWIR
Viewer
•
Updated
•
128M
•
194
•
4
hotchpotch/fineweb-2-edu-japanese
Viewer
•
Updated
•
262M
•
1.67k
•
20
hotchpotch/japanese-query-crafter-reasoning-80k
Viewer
•
Updated
•
83.3k
•
23
•
3
hotchpotch/tmp-5M-qa-small-tokens-cleaned
Viewer
•
Updated
•
5M
•
27
hotchpotch/japanese-qa-reasoning-100k
Viewer
•
Updated
•
106k
•
31
•
1
hotchpotch/fineweb-2-edu-japanese-noise-detect-raw
Viewer
•
Updated
•
64.2M
•
92
hotchpotch/fineweb-2-japanese-noise-spans
Viewer
•
Updated
•
344k
•
11
hotchpotch/fineweb-2-edu-japanese-scores
Viewer
•
Updated
•
313k
•
22
•
1
hotchpotch/sentence_transformer_japanese
Viewer
•
Updated
•
13.2M
•
80
•
5