AI & ML interests
None defined yet.
Recent Activity
View all activity
Organization Card
Swallow LLM
Research and development of large language models conducted by the members mainly in Okazaki Laboratory and Yokota Laboratory at Institute of Science Tokyo (formerly known as Tokyo Institute of Technology)
- From Okazaki Laboratory, Institute of Science Tokyo, the following members:
- Naoaki Okazaki
- Sakae Mizuki
- Youmi Ma
- Sangwhan Moon
- Koki Maeda
- Masanari Ohi
- Hinari Shimada
- Taihei Shiotani
- Koshiro Saito
- Tatsuya Ichinose
- Naoya Matsushita
- Sora Miyamoto
- Nguyen Tien Dung
- Yuta Katayama
- From YOKOTA Laboratory, Institute of Science Tokyo, the following members:
- Rio Yokota
- Kazuki Fujii
- Taishi Nakamura
- Takumi Okamoto
- Ishida Shigeki
- Masaki Kawamura
- Yukito Tajima
- From Artificial Intelligence Research Center, AIST, Japan, the following members:
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
tokyotech-llm/swallow-math
Viewer • Updated • 4.33M • 753 • 26 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 2 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 2 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 2
Rewriting Pre-Training Data Boosts LLM Performance in Math and Code
-
tokyotech-llm/swallow-math
Viewer • Updated • 4.33M • 753 • 26 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0002500
8B • Updated • 2 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0005000
8B • Updated • 2 -
tokyotech-llm/Llama-3.1-8B-math-ablation-exp2-LR2.5e-5-WD0.1-iter0007500
8B • Updated • 2
models
116

tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B
•
Updated
•
22
•
1

tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B
•
Updated
•
22

tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B
•
Updated
•
27

tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B
•
Updated
•
22

tokyotech-llm/Llama-3.1-8B-code-ablation-exp3-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B
•
Updated
•
26

tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0012500
8B
•
Updated
•
23

tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0010000
8B
•
Updated
•
26

tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0007500
8B
•
Updated
•
24

tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0005000
8B
•
Updated
•
38

tokyotech-llm/Llama-3.1-8B-code-ablation-exp2-LR2.5e-5-MINLR2.5E-6-WD0.1-iter0002500
8B
•
Updated
•
37
datasets
8
tokyotech-llm/swallow-code
Viewer
•
Updated
•
129M
•
2.3k
•
43
tokyotech-llm/lmsys-chat-1m-synth
Updated
•
499
•
12
tokyotech-llm/dclm-baseline
Preview
•
Updated
•
98
tokyotech-llm/swallow-math
Viewer
•
Updated
•
4.33M
•
753
•
26
tokyotech-llm/swallow-magpie-ultra-v0.1
Viewer
•
Updated
•
85.1k
•
93
•
3
tokyotech-llm/swallow-gemma-magpie-v0.1
Viewer
•
Updated
•
132k
•
46
•
1
tokyotech-llm/swallow-code-v0.1
Updated
•
29
•
1
tokyotech-llm/Swallow-Instruct-v0.1
Viewer
•
Updated
•
47.5k
•
50
•
10