Hugging Face's logo

Amala3
/
bertweet-base_ordinal_7_seed42_EN-NL

Safetensors
roberta
Generated from Trainer
Model card Files Community
Amala3 commited on
Commit
ba7967b
·
verified ·
1 Parent(s): 8f0fa71

End of training

Browse files
Files changed (4) hide show
  1. README.md +104 -0
  2. config.json +48 -0
  3. model.safetensors +3 -0
  4. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,104 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: vinai/bertweet-base
4
+ tags:
5
+ - generated_from_trainer
6
+ metrics:
7
+ - f1
8
+ - precision
9
+ - recall
10
+ - accuracy
11
+ model-index:
12
+ - name: bertweet-base_ordinal_7_seed42_EN-NL
13
+ results: []
14
+ ---
15
+
16
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
+ should probably proofread and complete it, then remove this comment. -->
18
+
19
+ # bertweet-base_ordinal_7_seed42_EN-NL
20
+
21
+ This model is a fine-tuned version of [vinai/bertweet-base](https://huggingface.co/vinai/bertweet-base) on an unknown dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 3.9585
24
+ - Mse: 6.1125
25
+ - Rmse: 2.4723
26
+ - Mae: 1.5109
27
+ - R2: 0.1525
28
+ - F1: 0.7447
29
+ - Precision: 0.7446
30
+ - Recall: 0.7479
31
+ - Accuracy: 0.7479
32
+
33
+ ## Model description
34
+
35
+ More information needed
36
+
37
+ ## Intended uses & limitations
38
+
39
+ More information needed
40
+
41
+ ## Training and evaluation data
42
+
43
+ More information needed
44
+
45
+ ## Training procedure
46
+
47
+ ### Training hyperparameters
48
+
49
+ The following hyperparameters were used during training:
50
+ - learning_rate: 5e-06
51
+ - train_batch_size: 16
52
+ - eval_batch_size: 16
53
+ - seed: 42
54
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
55
+ - lr_scheduler_type: linear
56
+ - lr_scheduler_warmup_steps: 200
57
+ - num_epochs: 10
58
+
59
+ ### Training results
60
+
61
+ | Training Loss | Epoch | Step | Validation Loss | Mse | Rmse | Mae | R2 | F1 | Precision | Recall | Accuracy |
62
+ |:-------------:|:------:|:----:|:---------------:|:------:|:------:|:------:|:-------:|:------:|:---------:|:------:|:--------:|
63
+ | 5.7557 | 0.2141 | 100 | 5.6476 | 7.6297 | 2.7622 | 2.6574 | -0.0806 | 0.4761 | 0.3859 | 0.6212 | 0.6212 |
64
+ | 5.2388 | 0.4283 | 200 | 5.2492 | 7.1086 | 2.6662 | 2.4741 | -0.0068 | 0.4761 | 0.3859 | 0.6212 | 0.6212 |
65
+ | 4.9773 | 0.6424 | 300 | 5.0558 | 6.8733 | 2.6217 | 2.3016 | 0.0266 | 0.4761 | 0.3859 | 0.6212 | 0.6212 |
66
+ | 4.7427 | 0.8565 | 400 | 4.8666 | 6.6212 | 2.5732 | 2.1990 | 0.0623 | 0.4761 | 0.3859 | 0.6212 | 0.6212 |
67
+ | 4.6378 | 1.0707 | 500 | 4.6806 | 6.0772 | 2.4652 | 2.0941 | 0.1393 | 0.6773 | 0.6795 | 0.6888 | 0.6888 |
68
+ | 4.3851 | 1.2848 | 600 | 4.6153 | 6.2799 | 2.5060 | 1.9928 | 0.1106 | 0.6915 | 0.6964 | 0.6888 | 0.6888 |
69
+ | 4.3077 | 1.4989 | 700 | 4.5016 | 6.2147 | 2.4929 | 1.9276 | 0.1198 | 0.6882 | 0.6928 | 0.7008 | 0.7008 |
70
+ | 4.2337 | 1.7131 | 800 | 4.2877 | 5.5862 | 2.3635 | 1.8854 | 0.2088 | 0.7183 | 0.7218 | 0.7274 | 0.7274 |
71
+ | 4.2273 | 1.9272 | 900 | 4.3769 | 5.9397 | 2.4371 | 1.8601 | 0.1588 | 0.6994 | 0.6991 | 0.6996 | 0.6996 |
72
+ | 4.0563 | 2.1413 | 1000 | 4.2168 | 6.1013 | 2.4701 | 1.7033 | 0.1359 | 0.7088 | 0.7203 | 0.7238 | 0.7238 |
73
+ | 3.7778 | 2.3555 | 1100 | 4.1356 | 6.1098 | 2.4718 | 1.6562 | 0.1347 | 0.7260 | 0.7269 | 0.7322 | 0.7322 |
74
+ | 3.7206 | 2.5696 | 1200 | 4.2222 | 6.1062 | 2.4711 | 1.7394 | 0.1352 | 0.7245 | 0.7326 | 0.7214 | 0.7214 |
75
+ | 3.7175 | 2.7837 | 1300 | 4.0073 | 5.7021 | 2.3879 | 1.6224 | 0.1924 | 0.7277 | 0.7345 | 0.7382 | 0.7382 |
76
+ | 3.8003 | 2.9979 | 1400 | 4.1116 | 5.8166 | 2.4118 | 1.7346 | 0.1762 | 0.7258 | 0.7268 | 0.7250 | 0.7250 |
77
+ | 3.6247 | 3.2120 | 1500 | 4.1286 | 6.0663 | 2.4630 | 1.6876 | 0.1409 | 0.7309 | 0.7355 | 0.7286 | 0.7286 |
78
+ | 3.4364 | 3.4261 | 1600 | 4.2100 | 6.3353 | 2.5170 | 1.7467 | 0.1028 | 0.7235 | 0.7329 | 0.7201 | 0.7201 |
79
+ | 3.3301 | 3.6403 | 1700 | 4.0403 | 6.0483 | 2.4593 | 1.6357 | 0.1434 | 0.7436 | 0.7442 | 0.7431 | 0.7431 |
80
+ | 3.3634 | 3.8544 | 1800 | 3.9496 | 5.5790 | 2.3620 | 1.6297 | 0.2099 | 0.7259 | 0.7282 | 0.7334 | 0.7334 |
81
+ | 3.4602 | 4.0685 | 1900 | 3.8729 | 5.7334 | 2.3945 | 1.5597 | 0.1880 | 0.7402 | 0.7410 | 0.7455 | 0.7455 |
82
+ | 3.1223 | 4.2827 | 2000 | 4.0417 | 6.3812 | 2.5261 | 1.5875 | 0.0963 | 0.7144 | 0.7394 | 0.7346 | 0.7346 |
83
+ | 3.1337 | 4.4968 | 2100 | 4.0039 | 5.9493 | 2.4391 | 1.6285 | 0.1574 | 0.7389 | 0.7421 | 0.7370 | 0.7370 |
84
+ | 3.1321 | 4.7109 | 2200 | 3.9092 | 5.8926 | 2.4275 | 1.5742 | 0.1655 | 0.7347 | 0.7339 | 0.7358 | 0.7358 |
85
+ | 3.1927 | 4.9251 | 2300 | 4.0312 | 5.9928 | 2.4480 | 1.6140 | 0.1513 | 0.7459 | 0.7540 | 0.7431 | 0.7431 |
86
+ | 2.9806 | 5.1392 | 2400 | 3.9638 | 6.0145 | 2.4524 | 1.5633 | 0.1482 | 0.7524 | 0.7536 | 0.7515 | 0.7515 |
87
+ | 2.9582 | 5.3533 | 2500 | 3.9413 | 5.9409 | 2.4374 | 1.5549 | 0.1586 | 0.7539 | 0.7539 | 0.7539 | 0.7539 |
88
+ | 2.7418 | 5.5675 | 2600 | 3.9578 | 5.9843 | 2.4463 | 1.5525 | 0.1525 | 0.7456 | 0.7476 | 0.7443 | 0.7443 |
89
+ | 2.9866 | 5.7816 | 2700 | 3.8793 | 5.8070 | 2.4098 | 1.5416 | 0.1776 | 0.7426 | 0.7425 | 0.7467 | 0.7467 |
90
+ | 2.8627 | 5.9957 | 2800 | 3.8625 | 5.7805 | 2.4043 | 1.5103 | 0.1813 | 0.7615 | 0.7609 | 0.7624 | 0.7624 |
91
+ | 2.8191 | 6.2099 | 2900 | 3.9342 | 5.9964 | 2.4488 | 1.5211 | 0.1508 | 0.7628 | 0.7622 | 0.7636 | 0.7636 |
92
+ | 2.6259 | 6.4240 | 3000 | 3.9203 | 6.0893 | 2.4676 | 1.5006 | 0.1376 | 0.7487 | 0.7478 | 0.7503 | 0.7503 |
93
+ | 2.8785 | 6.6381 | 3100 | 3.8633 | 5.8444 | 2.4175 | 1.4946 | 0.1723 | 0.7600 | 0.7601 | 0.7600 | 0.7600 |
94
+ | 2.6016 | 6.8522 | 3200 | 4.0736 | 6.2654 | 2.5031 | 1.5923 | 0.1127 | 0.7456 | 0.7518 | 0.7431 | 0.7431 |
95
+ | 2.5155 | 7.0664 | 3300 | 3.9459 | 6.0688 | 2.4635 | 1.5211 | 0.1405 | 0.7584 | 0.7597 | 0.7575 | 0.7575 |
96
+ | 2.6918 | 7.2805 | 3400 | 3.9312 | 6.0072 | 2.4510 | 1.5271 | 0.1492 | 0.7541 | 0.7534 | 0.7551 | 0.7551 |
97
+
98
+
99
+ ### Framework versions
100
+
101
+ - Transformers 4.40.2
102
+ - Pytorch 2.1.2
103
+ - Datasets 2.18.0
104
+ - Tokenizers 0.19.1
config.json ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "vinai/bertweet-base",
3
+ "architectures": [
4
+ "RobertaForSequenceClassification"
5
+ ],
6
+ "attention_probs_dropout_prob": 0.1,
7
+ "bos_token_id": 0,
8
+ "classifier_dropout": null,
9
+ "eos_token_id": 2,
10
+ "gradient_checkpointing": false,
11
+ "hidden_act": "gelu",
12
+ "hidden_dropout_prob": 0.1,
13
+ "hidden_size": 768,
14
+ "id2label": {
15
+ "0": "LABEL_0",
16
+ "1": "LABEL_1",
17
+ "2": "LABEL_2",
18
+ "3": "LABEL_3",
19
+ "4": "LABEL_4",
20
+ "5": "LABEL_5",
21
+ "6": "LABEL_6"
22
+ },
23
+ "initializer_range": 0.02,
24
+ "intermediate_size": 3072,
25
+ "label2id": {
26
+ "LABEL_0": 0,
27
+ "LABEL_1": 1,
28
+ "LABEL_2": 2,
29
+ "LABEL_3": 3,
30
+ "LABEL_4": 4,
31
+ "LABEL_5": 5,
32
+ "LABEL_6": 6
33
+ },
34
+ "layer_norm_eps": 1e-05,
35
+ "max_position_embeddings": 130,
36
+ "model_type": "roberta",
37
+ "num_attention_heads": 12,
38
+ "num_hidden_layers": 12,
39
+ "pad_token_id": 1,
40
+ "position_embedding_type": "absolute",
41
+ "problem_type": "single_label_classification",
42
+ "tokenizer_class": "BertweetTokenizer",
43
+ "torch_dtype": "float32",
44
+ "transformers_version": "4.40.2",
45
+ "type_vocab_size": 1,
46
+ "use_cache": true,
47
+ "vocab_size": 64001
48
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0eb20fded9748332a7dc60a7251b07e8a37ff876b1d82fd2a54c44c71194d04
3
+ size 539645548
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aea3601c3c0661213b3e070bf2b0e29729b5d06b0874ca85fbc4a0926afef78b
3
+ size 4984