BaselMousi commited on
Commit
14e87ea
·
verified ·
1 Parent(s): f094ff2

End of training

Browse files
README.md ADDED
@@ -0,0 +1,96 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: bert-base-cased
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - wnut_17
9
+ metrics:
10
+ - precision
11
+ - recall
12
+ - f1
13
+ - accuracy
14
+ model-index:
15
+ - name: bert_wnut_model
16
+ results:
17
+ - task:
18
+ name: Token Classification
19
+ type: token-classification
20
+ dataset:
21
+ name: wnut_17
22
+ type: wnut_17
23
+ config: wnut_17
24
+ split: test
25
+ args: wnut_17
26
+ metrics:
27
+ - name: Precision
28
+ type: precision
29
+ value: 0.5291073738680466
30
+ - name: Recall
31
+ type: recall
32
+ value: 0.3790546802594995
33
+ - name: F1
34
+ type: f1
35
+ value: 0.44168466522678185
36
+ - name: Accuracy
37
+ type: accuracy
38
+ value: 0.9476788920235958
39
+ ---
40
+
41
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
42
+ should probably proofread and complete it, then remove this comment. -->
43
+
44
+ # bert_wnut_model
45
+
46
+ This model is a fine-tuned version of [bert-base-cased](https://huggingface.co/bert-base-cased) on the wnut_17 dataset.
47
+ It achieves the following results on the evaluation set:
48
+ - Loss: 0.3346
49
+ - Precision: 0.5291
50
+ - Recall: 0.3791
51
+ - F1: 0.4417
52
+ - Accuracy: 0.9477
53
+
54
+ ## Model description
55
+
56
+ More information needed
57
+
58
+ ## Intended uses & limitations
59
+
60
+ More information needed
61
+
62
+ ## Training and evaluation data
63
+
64
+ More information needed
65
+
66
+ ## Training procedure
67
+
68
+ ### Training hyperparameters
69
+
70
+ The following hyperparameters were used during training:
71
+ - learning_rate: 2e-05
72
+ - train_batch_size: 16
73
+ - eval_batch_size: 16
74
+ - seed: 42
75
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
76
+ - lr_scheduler_type: linear
77
+ - num_epochs: 6
78
+
79
+ ### Training results
80
+
81
+ | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
82
+ |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
83
+ | No log | 1.0 | 213 | 0.2607 | 0.5443 | 0.2901 | 0.3785 | 0.9411 |
84
+ | No log | 2.0 | 426 | 0.2689 | 0.5474 | 0.3318 | 0.4132 | 0.9453 |
85
+ | 0.1554 | 3.0 | 639 | 0.2896 | 0.5253 | 0.3753 | 0.4378 | 0.9475 |
86
+ | 0.1554 | 4.0 | 852 | 0.3009 | 0.5079 | 0.3865 | 0.4389 | 0.9474 |
87
+ | 0.0349 | 5.0 | 1065 | 0.3195 | 0.5109 | 0.3920 | 0.4436 | 0.9486 |
88
+ | 0.0349 | 6.0 | 1278 | 0.3346 | 0.5291 | 0.3791 | 0.4417 | 0.9477 |
89
+
90
+
91
+ ### Framework versions
92
+
93
+ - Transformers 4.49.0
94
+ - Pytorch 2.6.0+cu124
95
+ - Datasets 3.4.1
96
+ - Tokenizers 0.21.1
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:707ea67d41e247dbcb3d9d5fc965223bb33e511ea444eac37ca6c37141b83b54
3
  size 430942044
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf6c3793e375079fecef6092a18497a832083c0a67c157d8d9219080e7d49f6e
3
  size 430942044
runs/Mar24_09-23-26_fcff85287d81/events.out.tfevents.1742808216.fcff85287d81.1694.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3189abe5f630e23a449bad431a90bf4a3b7818c84a013ea3c425df01c34e95e5
3
- size 8464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aff590ca33d08e4b8c06a118a05021d692fbb1202f54d8e6c4f4ade7b48c039
3
+ size 9290