ryantaw commited on
Commit
2b3d9df
·
1 Parent(s): ce143b0

End of training

Browse files
README.md CHANGED
@@ -17,9 +17,9 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [ryantaw/bert-small-finetuned](https://huggingface.co/ryantaw/bert-small-finetuned) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.8577
21
- - Accuracy: 0.6846
22
- - F1 Score: 0.6854
23
 
24
  ## Model description
25
 
@@ -39,27 +39,37 @@ More information needed
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 2e-05
42
- - train_batch_size: 8
43
- - eval_batch_size: 8
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
- - num_epochs: 10
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Score |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
53
- | No log | 1.0 | 186 | 0.8402 | 0.6577 | 0.6553 |
54
- | No log | 2.0 | 372 | 0.8577 | 0.6846 | 0.6854 |
55
- | 0.7061 | 3.0 | 558 | 0.9049 | 0.6415 | 0.6367 |
56
- | 0.7061 | 4.0 | 744 | 0.9252 | 0.6631 | 0.6625 |
57
- | 0.7061 | 5.0 | 930 | 1.0010 | 0.6685 | 0.6670 |
58
- | 0.3613 | 6.0 | 1116 | 1.1754 | 0.6199 | 0.6130 |
59
- | 0.3613 | 7.0 | 1302 | 1.2138 | 0.6604 | 0.6592 |
60
- | 0.3613 | 8.0 | 1488 | 1.3055 | 0.6604 | 0.6583 |
61
- | 0.1426 | 9.0 | 1674 | 1.3710 | 0.6523 | 0.6495 |
62
- | 0.1426 | 10.0 | 1860 | 1.3899 | 0.6550 | 0.6529 |
 
 
 
 
 
 
 
 
 
 
63
 
64
 
65
  ### Framework versions
 
17
 
18
  This model is a fine-tuned version of [ryantaw/bert-small-finetuned](https://huggingface.co/ryantaw/bert-small-finetuned) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.6962
21
+ - Accuracy: 0.7358
22
+ - F1 Score: 0.7334
23
 
24
  ## Model description
25
 
 
39
 
40
  The following hyperparameters were used during training:
41
  - learning_rate: 2e-05
42
+ - train_batch_size: 86
43
+ - eval_batch_size: 86
44
  - seed: 42
45
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
  - lr_scheduler_type: linear
47
+ - num_epochs: 20
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Score |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
53
+ | No log | 1.0 | 18 | 0.6962 | 0.7358 | 0.7334 |
54
+ | No log | 2.0 | 36 | 0.7131 | 0.7197 | 0.7187 |
55
+ | No log | 3.0 | 54 | 0.7094 | 0.7170 | 0.7171 |
56
+ | No log | 4.0 | 72 | 0.7098 | 0.7170 | 0.7160 |
57
+ | No log | 5.0 | 90 | 0.7446 | 0.7143 | 0.7120 |
58
+ | No log | 6.0 | 108 | 0.7464 | 0.7008 | 0.6986 |
59
+ | No log | 7.0 | 126 | 0.7771 | 0.6981 | 0.6912 |
60
+ | No log | 8.0 | 144 | 0.7748 | 0.7008 | 0.7005 |
61
+ | No log | 9.0 | 162 | 0.7806 | 0.7197 | 0.7209 |
62
+ | No log | 10.0 | 180 | 0.7835 | 0.7089 | 0.7061 |
63
+ | No log | 11.0 | 198 | 0.8341 | 0.7035 | 0.6970 |
64
+ | No log | 12.0 | 216 | 0.8166 | 0.7116 | 0.7122 |
65
+ | No log | 13.0 | 234 | 0.8369 | 0.7062 | 0.7053 |
66
+ | No log | 14.0 | 252 | 0.8367 | 0.7008 | 0.6982 |
67
+ | No log | 15.0 | 270 | 0.9065 | 0.6846 | 0.6783 |
68
+ | No log | 16.0 | 288 | 0.8928 | 0.6873 | 0.6851 |
69
+ | No log | 17.0 | 306 | 0.8936 | 0.6900 | 0.6870 |
70
+ | No log | 18.0 | 324 | 0.8881 | 0.6981 | 0.6960 |
71
+ | No log | 19.0 | 342 | 0.8974 | 0.6819 | 0.6789 |
72
+ | No log | 20.0 | 360 | 0.8964 | 0.6819 | 0.6784 |
73
 
74
 
75
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ac7e0565f43543830e21950c0e6ab45cd4530a98b99f8076a5ed702995230595
3
  size 115071152
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:05edfb29eef1248ad24b11addeb537a45ade9020759e548962e17d1d0132471f
3
  size 115071152
runs/Nov09_09-10-32_6665d88e9b9d/events.out.tfevents.1699521032.6665d88e9b9d.586.2 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5cb736b88efd11ebe962614a09654a711327f9bdbf235bfcede770058a6d9fb6
3
- size 11584
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d8119c2f17667bcceae7630800aa6d5df76b8cc77b9442f6a28deb8eb2c78ec
3
+ size 12313
runs/Nov09_09-10-32_6665d88e9b9d/events.out.tfevents.1699521601.6665d88e9b9d.586.3 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a1ff3570b1d15771d3a8f6c349c9b72d7b0d4757f523e4038f4f54476d000c9
3
+ size 463