BSC-LT
/

mRoBERTa

🇪🇺 Region: EU

Model card Files Files and versions Community

dtamayo commited on about 1 month ago

Commit

68f4206

·

verified ·

1 Parent(s): b9e3671

Fix typo

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -68,7 +68,7 @@ Training Hyperparemeters
 | Hyperparameter                | Value                             |
 |-------------------------      |:--------------                    |
 | Pretraining  Objective        | Masked Language Modeling          |
-| Learning Rate                 | 7E-05                             |
 | Learning Rate Scheduler       | Cosine                            |
 | Warmup                        | 10k                               |
 | Optimizer                     | AdamW                             |

 | Hyperparameter                | Value                             |
 |-------------------------      |:--------------                    |
 | Pretraining  Objective        | Masked Language Modeling          |
+| Learning Rate                 | 7E-04                             |
 | Learning Rate Scheduler       | Cosine                            |
 | Warmup                        | 10k                               |
 | Optimizer                     | AdamW                             |