p-tuning-roberta-large-with-mrpc
Browse files- README.md +24 -6
- adapter_model.safetensors +1 -1
- training_args.bin +1 -1
README.md
CHANGED
|
@@ -19,9 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 19 |
|
| 20 |
This model is a fine-tuned version of [roberta-large](https://huggingface.co/roberta-large) on an unknown dataset.
|
| 21 |
It achieves the following results on the evaluation set:
|
| 22 |
-
- Loss: 0.
|
| 23 |
-
- Accuracy: 0.
|
| 24 |
-
- F1: 0.
|
| 25 |
|
| 26 |
## Model description
|
| 27 |
|
|
@@ -46,14 +46,32 @@ The following hyperparameters were used during training:
|
|
| 46 |
- seed: 42
|
| 47 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 48 |
- lr_scheduler_type: linear
|
| 49 |
-
- num_epochs:
|
| 50 |
|
| 51 |
### Training results
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
|
| 54 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
|
| 55 |
-
| No log | 1.0 | 58 | 0.
|
| 56 |
-
| No log | 2.0 | 116 | 0.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
|
| 59 |
### Framework versions
|
|
|
|
| 19 |
|
| 20 |
This model is a fine-tuned version of [roberta-large](https://huggingface.co/roberta-large) on an unknown dataset.
|
| 21 |
It achieves the following results on the evaluation set:
|
| 22 |
+
- Loss: 0.5925
|
| 23 |
+
- Accuracy: 0.6957
|
| 24 |
+
- F1: 0.7992
|
| 25 |
|
| 26 |
## Model description
|
| 27 |
|
|
|
|
| 46 |
- seed: 42
|
| 47 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 48 |
- lr_scheduler_type: linear
|
| 49 |
+
- num_epochs: 20
|
| 50 |
|
| 51 |
### Training results
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 |
|
| 54 |
|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|
|
| 55 |
+
| No log | 1.0 | 58 | 0.6199 | 0.6754 | 0.8003 |
|
| 56 |
+
| No log | 2.0 | 116 | 0.6082 | 0.6939 | 0.8066 |
|
| 57 |
+
| No log | 3.0 | 174 | 0.6217 | 0.6725 | 0.8013 |
|
| 58 |
+
| No log | 4.0 | 232 | 0.6317 | 0.6667 | 0.7993 |
|
| 59 |
+
| No log | 5.0 | 290 | 0.6402 | 0.6499 | 0.7703 |
|
| 60 |
+
| No log | 6.0 | 348 | 0.6219 | 0.6678 | 0.7994 |
|
| 61 |
+
| No log | 7.0 | 406 | 0.6287 | 0.6684 | 0.7556 |
|
| 62 |
+
| No log | 8.0 | 464 | 0.5914 | 0.6991 | 0.8051 |
|
| 63 |
+
| 0.6347 | 9.0 | 522 | 0.5826 | 0.6875 | 0.8022 |
|
| 64 |
+
| 0.6347 | 10.0 | 580 | 0.6129 | 0.6875 | 0.7764 |
|
| 65 |
+
| 0.6347 | 11.0 | 638 | 0.5942 | 0.6922 | 0.8036 |
|
| 66 |
+
| 0.6347 | 12.0 | 696 | 0.5975 | 0.6887 | 0.7822 |
|
| 67 |
+
| 0.6347 | 13.0 | 754 | 0.5943 | 0.6899 | 0.7963 |
|
| 68 |
+
| 0.6347 | 14.0 | 812 | 0.5863 | 0.6968 | 0.8039 |
|
| 69 |
+
| 0.6347 | 15.0 | 870 | 0.5880 | 0.6945 | 0.7998 |
|
| 70 |
+
| 0.6347 | 16.0 | 928 | 0.5967 | 0.6858 | 0.7982 |
|
| 71 |
+
| 0.6347 | 17.0 | 986 | 0.5951 | 0.6968 | 0.8020 |
|
| 72 |
+
| 0.5717 | 18.0 | 1044 | 0.5931 | 0.7043 | 0.7981 |
|
| 73 |
+
| 0.5717 | 19.0 | 1102 | 0.5936 | 0.6974 | 0.8006 |
|
| 74 |
+
| 0.5717 | 20.0 | 1160 | 0.5925 | 0.6957 | 0.7992 |
|
| 75 |
|
| 76 |
|
| 77 |
### Framework versions
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4289048
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9c46495cca57c8511384f1b9f22fc54cc3b7bf70773a57dfc9ee3d59d47ecabd
|
| 3 |
size 4289048
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4347
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cfd8ddab58fbc2cdb408ce365e4904eb914841ff2f9bc20ee2340eee50b4d387
|
| 3 |
size 4347
|