gokulsrinivasagan commited on
Commit
2627cb4
·
verified ·
1 Parent(s): 3cfe8d0

Model save

Browse files
README.md CHANGED
@@ -1,32 +1,14 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - en
5
  base_model: gokulsrinivasagan/bert_tiny_lda_100_v1
6
  tags:
7
  - generated_from_trainer
8
- datasets:
9
- - glue
10
  metrics:
11
  - accuracy
12
  - f1
13
  model-index:
14
  - name: bert_tiny_lda_100_v1_mrpc
15
- results:
16
- - task:
17
- name: Text Classification
18
- type: text-classification
19
- dataset:
20
- name: GLUE MRPC
21
- type: glue
22
- args: mrpc
23
- metrics:
24
- - name: Accuracy
25
- type: accuracy
26
- value: 0.6838235294117647
27
- - name: F1
28
- type: f1
29
- value: 0.8122270742358079
30
  ---
31
 
32
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -34,12 +16,12 @@ should probably proofread and complete it, then remove this comment. -->
34
 
35
  # bert_tiny_lda_100_v1_mrpc
36
 
37
- This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1) on the GLUE MRPC dataset.
38
  It achieves the following results on the evaluation set:
39
- - Loss: 0.6237
40
- - Accuracy: 0.6838
41
- - F1: 0.8122
42
- - Combined Score: 0.7480
43
 
44
  ## Model description
45
 
@@ -58,7 +40,7 @@ More information needed
58
  ### Training hyperparameters
59
 
60
  The following hyperparameters were used during training:
61
- - learning_rate: 0.001
62
  - train_batch_size: 256
63
  - eval_batch_size: 256
64
  - seed: 10
@@ -70,13 +52,13 @@ The following hyperparameters were used during training:
70
 
71
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
72
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:--------------:|
73
- | 0.7449 | 1.0 | 15 | 0.6298 | 0.6838 | 0.8122 | 0.7480 |
74
- | 0.6364 | 2.0 | 30 | 0.6237 | 0.6838 | 0.8122 | 0.7480 |
75
- | 0.6276 | 3.0 | 45 | 0.6311 | 0.6838 | 0.8122 | 0.7480 |
76
- | 0.6363 | 4.0 | 60 | 0.6257 | 0.6838 | 0.8122 | 0.7480 |
77
- | 0.6345 | 5.0 | 75 | 0.6274 | 0.6838 | 0.8122 | 0.7480 |
78
- | 0.6332 | 6.0 | 90 | 0.6252 | 0.6838 | 0.8122 | 0.7480 |
79
- | 0.6318 | 7.0 | 105 | 0.6242 | 0.6838 | 0.8122 | 0.7480 |
80
 
81
 
82
  ### Framework versions
 
1
  ---
2
  library_name: transformers
 
 
3
  base_model: gokulsrinivasagan/bert_tiny_lda_100_v1
4
  tags:
5
  - generated_from_trainer
 
 
6
  metrics:
7
  - accuracy
8
  - f1
9
  model-index:
10
  - name: bert_tiny_lda_100_v1_mrpc
11
+ results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
16
 
17
  # bert_tiny_lda_100_v1_mrpc
18
 
19
+ This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.8055
22
+ - Accuracy: 0.6299
23
+ - F1: 0.7318
24
+ - Combined Score: 0.6808
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 5e-05
44
  - train_batch_size: 256
45
  - eval_batch_size: 256
46
  - seed: 10
 
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:--------------:|
55
+ | 0.631 | 1.0 | 15 | 0.5996 | 0.6961 | 0.8171 | 0.7566 |
56
+ | 0.5947 | 2.0 | 30 | 0.5925 | 0.6814 | 0.7917 | 0.7365 |
57
+ | 0.5708 | 3.0 | 45 | 0.5934 | 0.7010 | 0.8135 | 0.7572 |
58
+ | 0.5419 | 4.0 | 60 | 0.5990 | 0.6912 | 0.7961 | 0.7436 |
59
+ | 0.4984 | 5.0 | 75 | 0.6380 | 0.6789 | 0.7950 | 0.7370 |
60
+ | 0.4277 | 6.0 | 90 | 0.7020 | 0.6495 | 0.7386 | 0.6940 |
61
+ | 0.3467 | 7.0 | 105 | 0.8055 | 0.6299 | 0.7318 | 0.6808 |
62
 
63
 
64
  ### Framework versions
logs/events.out.tfevents.1733324010.ki-g0008.1208741.20 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aefe243673d5960cab3325e9f20b8fed42e3f905db63fb0bfc0d4e8e6d764cfa
3
+ size 9821
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4b797582acd53f62b44a7c2d58b03a24cc6b38200bb03c67a0d121b202010272
3
  size 131856744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0890d122769ab0aa56ecf5f787482aa01e2e812fe450cad0b835866f8bee99e3
3
  size 131856744
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a53930ac8ba6cd4861045557e33996b353b73e64517c3075e76bb5e68275d31f
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d459cb4247071f1c55b72decba2da6cf5d1fd6e1cbe6486fca32611bd1a0e926
3
  size 5304