Hugging Face's logo

Aratako
/
Japanese-Novel-Reward-llmjp-3-980m

Text Classification
Transformers
Safetensors
Japanese
llama
Generated from Trainer
text-generation-inference
Inference Endpoints
Model card Files Community
Aratako commited on
Commit
a44f7db
·
verified ·
1 Parent(s): 6038a0e

Aratako/reward-test-llmjp-3-980m

Browse files
Files changed (7) hide show
  1. README.md +180 -0
  2. config.json +38 -0
  3. model.safetensors +3 -0
  4. special_tokens_map.json +51 -0
  5. tokenizer.json +0 -0
  6. tokenizer_config.json +84 -0
  7. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,180 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: llm-jp/llm-jp-3-980m
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - pearsonr
9
+ - spearmanr
10
+ model-index:
11
+ - name: test-clf-llmjp-3-980m
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # test-clf-llmjp-3-980m
19
+
20
+ This model is a fine-tuned version of [llm-jp/llm-jp-3-980m](https://huggingface.co/llm-jp/llm-jp-3-980m) on an unknown dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 1.1710
23
+ - Mae: 0.8143
24
+ - R2: 0.3539
25
+ - Pearsonr: 0.6009
26
+ - Spearmanr: 0.5755
27
+
28
+ ## Model description
29
+
30
+ More information needed
31
+
32
+ ## Intended uses & limitations
33
+
34
+ More information needed
35
+
36
+ ## Training and evaluation data
37
+
38
+ More information needed
39
+
40
+ ## Training procedure
41
+
42
+ ### Training hyperparameters
43
+
44
+ The following hyperparameters were used during training:
45
+ - learning_rate: 1e-05
46
+ - train_batch_size: 4
47
+ - eval_batch_size: 8
48
+ - seed: 42
49
+ - gradient_accumulation_steps: 4
50
+ - total_train_batch_size: 16
51
+ - optimizer: Use OptimizerNames.PAGED_ADAMW_8BIT with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
+ - lr_scheduler_type: cosine_with_min_lr
53
+ - lr_scheduler_warmup_ratio: 0.1
54
+ - num_epochs: 5
55
+
56
+ ### Training results
57
+
58
+ | Training Loss | Epoch | Step | Validation Loss | Mae | R2 | Pearsonr | Spearmanr |
59
+ |:-------------:|:------:|:----:|:---------------:|:------:|:--------:|:--------:|:---------:|
60
+ | 44.1118 | 0.0440 | 30 | 46.6401 | 5.8971 | -21.8363 | 0.1228 | 0.0899 |
61
+ | 43.235 | 0.0880 | 60 | 21.8052 | 3.6603 | -9.6764 | 0.1249 | 0.0845 |
62
+ | 3.8206 | 0.1320 | 90 | 11.8998 | 2.6198 | -4.8265 | 0.1291 | 0.0886 |
63
+ | 11.7449 | 0.1760 | 120 | 9.4187 | 2.3386 | -3.6117 | 0.1570 | 0.1296 |
64
+ | 5.1594 | 0.2200 | 150 | 7.2971 | 2.0766 | -2.5729 | 0.1731 | 0.1461 |
65
+ | 6.3107 | 0.2640 | 180 | 6.1076 | 1.9337 | -1.9905 | 0.2106 | 0.1819 |
66
+ | 7.0637 | 0.3080 | 210 | 4.8372 | 1.7065 | -1.3684 | 0.2561 | 0.2333 |
67
+ | 4.7498 | 0.3520 | 240 | 4.0016 | 1.5642 | -0.9593 | 0.2810 | 0.2730 |
68
+ | 7.3632 | 0.3960 | 270 | 3.0568 | 1.3644 | -0.4967 | 0.3262 | 0.3077 |
69
+ | 5.7759 | 0.4400 | 300 | 3.1656 | 1.3512 | -0.5500 | 0.3947 | 0.3930 |
70
+ | 1.3742 | 0.4840 | 330 | 2.0588 | 1.0905 | -0.0080 | 0.4158 | 0.4099 |
71
+ | 3.1093 | 0.5281 | 360 | 1.9904 | 1.0511 | 0.0254 | 0.5000 | 0.4967 |
72
+ | 1.9506 | 0.5721 | 390 | 2.2252 | 1.1879 | -0.0895 | 0.5219 | 0.5206 |
73
+ | 3.1117 | 0.6161 | 420 | 1.6225 | 0.9328 | 0.2056 | 0.5380 | 0.5304 |
74
+ | 2.4403 | 0.6601 | 450 | 2.3637 | 1.2531 | -0.1573 | 0.5619 | 0.5414 |
75
+ | 2.1617 | 0.7041 | 480 | 2.1045 | 1.2097 | -0.0304 | 0.5288 | 0.5240 |
76
+ | 6.0588 | 0.7481 | 510 | 1.5354 | 0.9569 | 0.2482 | 0.5579 | 0.5511 |
77
+ | 2.0358 | 0.7921 | 540 | 1.4982 | 0.9508 | 0.2664 | 0.5784 | 0.5647 |
78
+ | 1.5471 | 0.8361 | 570 | 2.0376 | 1.1840 | 0.0024 | 0.5538 | 0.5412 |
79
+ | 1.5559 | 0.8801 | 600 | 2.6357 | 1.3886 | -0.2905 | 0.5737 | 0.5531 |
80
+ | 1.8196 | 0.9241 | 630 | 1.8472 | 1.1097 | 0.0956 | 0.5873 | 0.5634 |
81
+ | 1.0851 | 0.9681 | 660 | 1.4402 | 0.9175 | 0.2948 | 0.5996 | 0.5731 |
82
+ | 1.5997 | 1.0117 | 690 | 1.4298 | 0.9257 | 0.2999 | 0.5969 | 0.5685 |
83
+ | 1.5961 | 1.0557 | 720 | 1.8276 | 1.1035 | 0.1052 | 0.6039 | 0.5875 |
84
+ | 0.9495 | 1.0997 | 750 | 1.6158 | 0.9774 | 0.2088 | 0.5748 | 0.5590 |
85
+ | 2.3505 | 1.1437 | 780 | 1.5580 | 0.9526 | 0.2372 | 0.5907 | 0.5585 |
86
+ | 1.6515 | 1.1878 | 810 | 1.8688 | 1.1110 | 0.0850 | 0.6029 | 0.5773 |
87
+ | 1.1556 | 1.2318 | 840 | 1.4833 | 0.9430 | 0.2738 | 0.5963 | 0.5739 |
88
+ | 1.5017 | 1.2758 | 870 | 1.5191 | 0.9692 | 0.2562 | 0.5976 | 0.5840 |
89
+ | 2.093 | 1.3198 | 900 | 1.3644 | 0.8792 | 0.3319 | 0.5843 | 0.5560 |
90
+ | 4.0141 | 1.3638 | 930 | 2.1305 | 1.2324 | -0.0432 | 0.6005 | 0.5759 |
91
+ | 0.5372 | 1.4078 | 960 | 1.6925 | 1.0607 | 0.1713 | 0.6044 | 0.5783 |
92
+ | 2.323 | 1.4518 | 990 | 1.3414 | 0.8611 | 0.3432 | 0.6176 | 0.5909 |
93
+ | 1.5667 | 1.4958 | 1020 | 1.4301 | 0.8668 | 0.2998 | 0.6032 | 0.5820 |
94
+ | 1.9411 | 1.5398 | 1050 | 2.0096 | 1.1491 | 0.0161 | 0.5987 | 0.5782 |
95
+ | 1.41 | 1.5838 | 1080 | 1.8418 | 1.1023 | 0.0982 | 0.5928 | 0.5691 |
96
+ | 2.4874 | 1.6278 | 1110 | 2.2494 | 1.2566 | -0.1014 | 0.5850 | 0.5632 |
97
+ | 3.1658 | 1.6718 | 1140 | 1.3968 | 0.8846 | 0.3161 | 0.6022 | 0.5786 |
98
+ | 1.7046 | 1.7158 | 1170 | 1.8109 | 1.0952 | 0.1133 | 0.5969 | 0.5697 |
99
+ | 1.9176 | 1.7598 | 1200 | 1.8079 | 1.0744 | 0.1148 | 0.6095 | 0.5894 |
100
+ | 0.7023 | 1.8038 | 1230 | 1.5335 | 0.9617 | 0.2492 | 0.6062 | 0.5820 |
101
+ | 1.0205 | 1.8478 | 1260 | 1.3603 | 0.8865 | 0.3339 | 0.6102 | 0.5945 |
102
+ | 0.7925 | 1.8918 | 1290 | 1.3145 | 0.8424 | 0.3564 | 0.6006 | 0.5737 |
103
+ | 1.2387 | 1.9358 | 1320 | 1.8253 | 1.1023 | 0.1063 | 0.5887 | 0.5595 |
104
+ | 0.8718 | 1.9798 | 1350 | 1.4751 | 0.9363 | 0.2778 | 0.6151 | 0.5927 |
105
+ | 1.7094 | 2.0235 | 1380 | 1.8856 | 1.1387 | 0.0767 | 0.6224 | 0.6071 |
106
+ | 0.6946 | 2.0675 | 1410 | 1.5007 | 0.9453 | 0.2652 | 0.6161 | 0.6020 |
107
+ | 1.1491 | 2.1115 | 1440 | 1.4112 | 0.8885 | 0.3091 | 0.5785 | 0.5457 |
108
+ | 1.4742 | 2.1555 | 1470 | 1.7782 | 1.0633 | 0.1294 | 0.5919 | 0.5668 |
109
+ | 0.9973 | 2.1995 | 1500 | 1.6547 | 1.0113 | 0.1898 | 0.6131 | 0.5965 |
110
+ | 1.2785 | 2.2435 | 1530 | 2.2080 | 1.1998 | -0.0811 | 0.5944 | 0.5708 |
111
+ | 0.8125 | 2.2875 | 1560 | 1.5098 | 0.9436 | 0.2608 | 0.6091 | 0.5876 |
112
+ | 1.6619 | 2.3315 | 1590 | 1.6899 | 1.0217 | 0.1726 | 0.6195 | 0.5952 |
113
+ | 1.5561 | 2.3755 | 1620 | 1.5072 | 0.9476 | 0.2620 | 0.6231 | 0.5937 |
114
+ | 1.0289 | 2.4195 | 1650 | 1.6926 | 1.0361 | 0.1713 | 0.6185 | 0.5920 |
115
+ | 1.1938 | 2.4635 | 1680 | 1.5188 | 0.9521 | 0.2564 | 0.6252 | 0.6066 |
116
+ | 1.3557 | 2.5075 | 1710 | 1.7646 | 1.0587 | 0.1360 | 0.6139 | 0.5918 |
117
+ | 1.0829 | 2.5515 | 1740 | 1.7303 | 1.0258 | 0.1528 | 0.6104 | 0.5876 |
118
+ | 1.9501 | 2.5955 | 1770 | 1.8902 | 1.1013 | 0.0745 | 0.6211 | 0.6023 |
119
+ | 1.9783 | 2.6395 | 1800 | 1.3999 | 0.8914 | 0.3146 | 0.5896 | 0.5555 |
120
+ | 1.1647 | 2.6835 | 1830 | 1.7894 | 1.0602 | 0.1239 | 0.6220 | 0.5948 |
121
+ | 0.9804 | 2.7275 | 1860 | 1.9891 | 1.1388 | 0.0261 | 0.6130 | 0.5860 |
122
+ | 0.92 | 2.7715 | 1890 | 1.7052 | 1.0385 | 0.1651 | 0.6084 | 0.5829 |
123
+ | 1.5063 | 2.8155 | 1920 | 1.3403 | 0.8604 | 0.3437 | 0.6199 | 0.5947 |
124
+ | 0.9447 | 2.8596 | 1950 | 1.8071 | 1.0726 | 0.1152 | 0.6195 | 0.5970 |
125
+ | 0.9394 | 2.9036 | 1980 | 1.3305 | 0.8526 | 0.3486 | 0.6249 | 0.6037 |
126
+ | 0.4709 | 2.9476 | 2010 | 1.3270 | 0.8504 | 0.3503 | 0.6188 | 0.5985 |
127
+ | 0.9477 | 2.9916 | 2040 | 1.6468 | 0.9981 | 0.1937 | 0.6059 | 0.5850 |
128
+ | 0.6142 | 3.0352 | 2070 | 1.5528 | 0.9506 | 0.2397 | 0.6104 | 0.5944 |
129
+ | 1.0394 | 3.0792 | 2100 | 1.5512 | 0.9533 | 0.2405 | 0.6032 | 0.5827 |
130
+ | 1.25 | 3.1232 | 2130 | 2.0191 | 1.1438 | 0.0114 | 0.6002 | 0.5824 |
131
+ | 0.5141 | 3.1672 | 2160 | 1.6223 | 0.9800 | 0.2057 | 0.6015 | 0.5776 |
132
+ | 2.1708 | 3.2112 | 2190 | 1.4456 | 0.9039 | 0.2922 | 0.6054 | 0.5832 |
133
+ | 1.1109 | 3.2552 | 2220 | 1.6046 | 0.9682 | 0.2144 | 0.6059 | 0.5864 |
134
+ | 0.607 | 3.2992 | 2250 | 1.5450 | 0.9426 | 0.2435 | 0.5970 | 0.5742 |
135
+ | 1.0724 | 3.3432 | 2280 | 1.4691 | 0.9084 | 0.2807 | 0.5960 | 0.5708 |
136
+ | 0.5642 | 3.3872 | 2310 | 1.7023 | 1.0127 | 0.1665 | 0.5980 | 0.5791 |
137
+ | 0.4881 | 3.4312 | 2340 | 1.5857 | 0.9638 | 0.2236 | 0.5977 | 0.5816 |
138
+ | 0.8876 | 3.4752 | 2370 | 1.6372 | 0.9859 | 0.1984 | 0.6030 | 0.5879 |
139
+ | 1.1095 | 3.5193 | 2400 | 1.4974 | 0.9205 | 0.2668 | 0.6028 | 0.5876 |
140
+ | 0.5819 | 3.5633 | 2430 | 1.5205 | 0.9346 | 0.2555 | 0.5971 | 0.5808 |
141
+ | 0.7854 | 3.6073 | 2460 | 1.4857 | 0.9120 | 0.2726 | 0.6030 | 0.5855 |
142
+ | 0.64 | 3.6513 | 2490 | 1.6351 | 0.9872 | 0.1994 | 0.5993 | 0.5830 |
143
+ | 1.5401 | 3.6953 | 2520 | 1.6130 | 0.9745 | 0.2102 | 0.6017 | 0.5857 |
144
+ | 0.7181 | 3.7393 | 2550 | 1.4704 | 0.9074 | 0.2801 | 0.6028 | 0.5863 |
145
+ | 1.7268 | 3.7833 | 2580 | 1.6834 | 1.0074 | 0.1758 | 0.6037 | 0.5892 |
146
+ | 1.0214 | 3.8273 | 2610 | 1.4407 | 0.8954 | 0.2946 | 0.6019 | 0.5849 |
147
+ | 1.0332 | 3.8713 | 2640 | 1.5078 | 0.9270 | 0.2617 | 0.5963 | 0.5783 |
148
+ | 0.4252 | 3.9153 | 2670 | 1.4975 | 0.9216 | 0.2668 | 0.5974 | 0.5795 |
149
+ | 1.1324 | 3.9593 | 2700 | 1.6843 | 1.0022 | 0.1753 | 0.5969 | 0.5800 |
150
+ | 0.8752 | 4.0029 | 2730 | 1.6440 | 0.9857 | 0.1950 | 0.6010 | 0.5835 |
151
+ | 0.6905 | 4.0469 | 2760 | 1.6794 | 1.0029 | 0.1777 | 0.6021 | 0.5857 |
152
+ | 0.8041 | 4.0909 | 2790 | 1.5858 | 0.9637 | 0.2235 | 0.5985 | 0.5822 |
153
+ | 0.6954 | 4.1349 | 2820 | 1.5675 | 0.9542 | 0.2325 | 0.5982 | 0.5819 |
154
+ | 0.6122 | 4.1790 | 2850 | 1.7340 | 1.0261 | 0.1510 | 0.5972 | 0.5823 |
155
+ | 1.1452 | 4.2230 | 2880 | 1.6143 | 0.9746 | 0.2096 | 0.5982 | 0.5821 |
156
+ | 0.4101 | 4.2670 | 2910 | 1.5893 | 0.9627 | 0.2218 | 0.5979 | 0.5808 |
157
+ | 0.675 | 4.3110 | 2940 | 1.5930 | 0.9630 | 0.2200 | 0.5980 | 0.5819 |
158
+ | 1.0434 | 4.3550 | 2970 | 1.6112 | 0.9700 | 0.2111 | 0.6000 | 0.5830 |
159
+ | 0.2733 | 4.3990 | 3000 | 1.6545 | 0.9889 | 0.1899 | 0.6000 | 0.5835 |
160
+ | 0.3886 | 4.4430 | 3030 | 1.6859 | 1.0016 | 0.1746 | 0.5993 | 0.5839 |
161
+ | 0.9832 | 4.4870 | 3060 | 1.5578 | 0.9451 | 0.2373 | 0.5987 | 0.5823 |
162
+ | 0.7789 | 4.5310 | 3090 | 1.6800 | 0.9982 | 0.1774 | 0.5983 | 0.5822 |
163
+ | 0.1763 | 4.5750 | 3120 | 1.6446 | 0.9825 | 0.1948 | 0.5970 | 0.5807 |
164
+ | 0.7873 | 4.6190 | 3150 | 1.6240 | 0.9738 | 0.2049 | 0.5967 | 0.5805 |
165
+ | 0.4972 | 4.6630 | 3180 | 1.6198 | 0.9726 | 0.2069 | 0.5961 | 0.5794 |
166
+ | 0.6607 | 4.7070 | 3210 | 1.6309 | 0.9772 | 0.2015 | 0.5968 | 0.5809 |
167
+ | 0.6623 | 4.7510 | 3240 | 1.6114 | 0.9691 | 0.2110 | 0.5969 | 0.5804 |
168
+ | 1.0014 | 4.7950 | 3270 | 1.6317 | 0.9767 | 0.2011 | 0.5954 | 0.5787 |
169
+ | 0.5253 | 4.8390 | 3300 | 1.6482 | 0.9848 | 0.1930 | 0.5952 | 0.5785 |
170
+ | 0.7298 | 4.8830 | 3330 | 1.6470 | 0.9845 | 0.1936 | 0.5974 | 0.5812 |
171
+ | 0.5712 | 4.9270 | 3360 | 1.6489 | 0.9845 | 0.1927 | 0.5961 | 0.5796 |
172
+ | 0.63 | 4.9710 | 3390 | 1.6791 | 0.9960 | 0.1779 | 0.5960 | 0.5799 |
173
+
174
+
175
+ ### Framework versions
176
+
177
+ - Transformers 4.49.0
178
+ - Pytorch 2.4.1+cu124
179
+ - Datasets 3.3.2
180
+ - Tokenizers 0.21.0
config.json ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "llm-jp/llm-jp-3-980m",
3
+ "architectures": [
4
+ "LlamaForSequenceClassification"
5
+ ],
6
+ "attention_bias": false,
7
+ "attention_dropout": 0.0,
8
+ "bos_token_id": 1,
9
+ "eos_token_id": 2,
10
+ "head_dim": 192,
11
+ "hidden_act": "silu",
12
+ "hidden_size": 1536,
13
+ "id2label": {
14
+ "0": "LABEL_0"
15
+ },
16
+ "initializer_range": 0.02,
17
+ "intermediate_size": 5376,
18
+ "label2id": {
19
+ "LABEL_0": 0
20
+ },
21
+ "max_position_embeddings": 4096,
22
+ "mlp_bias": false,
23
+ "model_type": "llama",
24
+ "num_attention_heads": 8,
25
+ "num_hidden_layers": 20,
26
+ "num_key_value_heads": 8,
27
+ "pad_token_id": 4,
28
+ "pretraining_tp": 1,
29
+ "problem_type": "regression",
30
+ "rms_norm_eps": 1e-05,
31
+ "rope_scaling": null,
32
+ "rope_theta": 10000,
33
+ "tie_word_embeddings": false,
34
+ "torch_dtype": "bfloat16",
35
+ "transformers_version": "4.49.0",
36
+ "use_cache": true,
37
+ "vocab_size": 99584
38
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35309e39ee10338cd2aba19a49d59095939d575b9adb520f0c5900cc986ecf7e
3
+ size 1674463760
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<CLS|LLM-jp>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<MASK|LLM-jp>",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<PAD|LLM-jp>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "<SEP|LLM-jp>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "added_tokens_decoder": {
5
+ "0": {
6
+ "content": "<unk>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "1": {
14
+ "content": "<s>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "2": {
22
+ "content": "</s>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "3": {
30
+ "content": "<MASK|LLM-jp>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "4": {
38
+ "content": "<PAD|LLM-jp>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "5": {
46
+ "content": "<CLS|LLM-jp>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "6": {
54
+ "content": "<SEP|LLM-jp>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "7": {
62
+ "content": "<EOD|LLM-jp>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ }
69
+ },
70
+ "bos_token": "<s>",
71
+ "clean_up_tokenization_spaces": false,
72
+ "cls_token": "<CLS|LLM-jp>",
73
+ "eod_token": "</s>",
74
+ "eos_token": "</s>",
75
+ "extra_ids": 0,
76
+ "extra_special_tokens": {},
77
+ "mask_token": "<MASK|LLM-jp>",
78
+ "model_max_length": 8192,
79
+ "pad_token": "<PAD|LLM-jp>",
80
+ "sep_token": "<SEP|LLM-jp>",
81
+ "sp_model_kwargs": {},
82
+ "tokenizer_class": "PreTrainedTokenizer",
83
+ "unk_token": "<unk>"
84
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abf0c1c15fae708eef4a7fbe85a3144f47d2f4c29fca45f4e02a876203bd2a71
3
+ size 5368