Model save

README.md

@@ -0,0 +1,121 @@
+---
+library_name: transformers
+tags:
+- generated_from_trainer
+metrics:
+- wer
+model-index:
+- name: outputs
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# outputs
+
+This model was trained from scratch on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 551.5420
+- Wer: 0.5423
+- Cer: 0.1998
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0005
+- train_batch_size: 16
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.25
+- num_epochs: 60.0
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Wer    | Cer    |
+|:-------------:|:-----:|:-----:|:---------------:|:------:|:------:|
+| 3985.5875     | 1.0   | 1080  | 283.6873        | 0.5933 | 0.1666 |
+| 665.3671      | 2.0   | 2160  | 223.1731        | 0.3818 | 0.1186 |
+| 481.9958      | 3.0   | 3240  | 223.3375        | 0.4375 | 0.1354 |
+| 442.5208      | 4.0   | 4320  | 236.0903        | 0.4233 | 0.1444 |
+| 421.2154      | 5.0   | 5400  | 304.9387        | 0.4626 | 0.1564 |
+| 431.8639      | 6.0   | 6480  | 298.5758        | 0.5199 | 0.1793 |
+| 444.0917      | 7.0   | 7560  | 347.2079        | 0.5570 | 0.1988 |
+| 451.4575      | 8.0   | 8640  | 375.0053        | 0.5731 | 0.2092 |
+| 445.6943      | 9.0   | 9720  | 360.6095        | 0.6165 | 0.2406 |
+| 457.5267      | 10.0  | 10800 | 413.6321        | 0.6510 | 0.2522 |
+| 468.0921      | 11.0  | 11880 | 405.5587        | 0.6422 | 0.2447 |
+| 469.1014      | 12.0  | 12960 | 423.7671        | 0.6370 | 0.2496 |
+| 472.7028      | 13.0  | 14040 | 476.4250        | 0.6583 | 0.2521 |
+| 477.4817      | 14.0  | 15120 | 431.7321        | 0.6496 | 0.2523 |
+| 476.1046      | 15.0  | 16200 | 456.8628        | 0.6735 | 0.2686 |
+| 478.12        | 16.0  | 17280 | 477.7070        | 0.6667 | 0.2542 |
+| 439.3815      | 17.0  | 18360 | 441.1053        | 0.6577 | 0.2600 |
+| 406.8238      | 18.0  | 19440 | 417.4709        | 0.6793 | 0.2496 |
+| 381.221       | 19.0  | 20520 | 385.2146        | 0.6340 | 0.2346 |
+| 349.7026      | 20.0  | 21600 | 417.8041        | 0.6319 | 0.2451 |
+| 336.5142      | 21.0  | 22680 | 446.5249        | 0.6700 | 0.2432 |
+| 316.0003      | 22.0  | 23760 | 414.9000        | 0.6574 | 0.2296 |
+| 301.4025      | 23.0  | 24840 | 435.7232        | 0.6242 | 0.2294 |
+| 276.272       | 24.0  | 25920 | 447.3780        | 0.6108 | 0.2273 |
+| 267.6378      | 25.0  | 27000 | 412.0445        | 0.6068 | 0.2430 |
+| 249.7945      | 26.0  | 28080 | 411.8222        | 0.6144 | 0.2386 |
+| 238.2421      | 27.0  | 29160 | 403.0204        | 0.6283 | 0.2365 |
+| 226.9799      | 28.0  | 30240 | 399.3009        | 0.6117 | 0.2249 |
+| 209.7066      | 29.0  | 31320 | 418.8339        | 0.5925 | 0.2297 |
+| 200.3202      | 30.0  | 32400 | 411.5076        | 0.6037 | 0.2221 |
+| 193.5312      | 31.0  | 33480 | 421.6948        | 0.5925 | 0.2199 |
+| 186.5759      | 32.0  | 34560 | 403.4677        | 0.5838 | 0.2202 |
+| 176.4434      | 33.0  | 35640 | 449.6694        | 0.5985 | 0.2256 |
+| 164.8203      | 34.0  | 36720 | 373.5114        | 0.5936 | 0.2238 |
+| 153.8149      | 35.0  | 37800 | 387.5101        | 0.5713 | 0.2196 |
+| 148.2955      | 36.0  | 38880 | 422.5177        | 0.5836 | 0.2219 |
+| 139.206       | 37.0  | 39960 | 424.9959        | 0.5836 | 0.2233 |
+| 137.3851      | 38.0  | 41040 | 428.6248        | 0.5863 | 0.2188 |
+| 128.706       | 39.0  | 42120 | 420.8113        | 0.5759 | 0.2173 |
+| 122.1991      | 40.0  | 43200 | 449.3417        | 0.5792 | 0.2218 |
+| 114.7006      | 41.0  | 44280 | 472.1264        | 0.5743 | 0.2232 |
+| 112.9208      | 42.0  | 45360 | 484.6367        | 0.5870 | 0.2134 |
+| 104.3684      | 43.0  | 46440 | 475.1778        | 0.5617 | 0.2078 |
+| 101.3417      | 44.0  | 47520 | 438.1502        | 0.5639 | 0.2081 |
+| 93.9768       | 45.0  | 48600 | 450.4065        | 0.5582 | 0.2067 |
+| 95.7108       | 46.0  | 49680 | 471.1706        | 0.5646 | 0.2114 |
+| 85.0469       | 47.0  | 50760 | 466.9779        | 0.5614 | 0.2078 |
+| 86.9859       | 48.0  | 51840 | 457.3221        | 0.5639 | 0.2069 |
+| 82.6203       | 49.0  | 52920 | 467.1034        | 0.5559 | 0.2060 |
+| 76.6465       | 50.0  | 54000 | 488.0355        | 0.5606 | 0.2075 |
+| 72.2897       | 51.0  | 55080 | 506.8006        | 0.5529 | 0.2017 |
+| 66.3217       | 52.0  | 56160 | 513.1782        | 0.5503 | 0.2066 |
+| 63.3613       | 53.0  | 57240 | 509.8887        | 0.5571 | 0.2055 |
+| 63.2432       | 54.0  | 58320 | 532.0458        | 0.5603 | 0.2093 |
+| 58.8891       | 55.0  | 59400 | 529.6933        | 0.5526 | 0.2062 |
+| 64.8119       | 56.0  | 60480 | 530.6396        | 0.5466 | 0.2025 |
+| 53.2317       | 57.0  | 61560 | 548.7179        | 0.5415 | 0.1994 |
+| 52.8465       | 58.0  | 62640 | 547.5447        | 0.5399 | 0.2007 |
+| 50.4224       | 59.0  | 63720 | 545.9059        | 0.5426 | 0.2007 |
+| 50.2867       | 60.0  | 64800 | 551.5420        | 0.5423 | 0.1998 |
+
+
+### Framework versions
+
+- Transformers 4.48.3
+- Pytorch 2.5.1
+- Datasets 3.2.0
+- Tokenizers 0.21.0

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ddcb4e54d006f81ed74676e2e8be77d2d8489c0d80922604474d27346d024d2
+oid sha256:4a92e673f720166b6a55433f4c5ec70b7d4d5dd8d7e567c6e59a406f9294525f
 size 1261996080