gokulsrinivasagan commited on
Commit
6175228
·
verified ·
1 Parent(s): 48b2207

Model save

Browse files
README.md CHANGED
@@ -1,32 +1,14 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - en
5
  base_model: gokulsrinivasagan/bert_tiny_lda_100_v1
6
  tags:
7
  - generated_from_trainer
8
- datasets:
9
- - glue
10
  metrics:
11
  - accuracy
12
  - f1
13
  model-index:
14
  - name: bert_tiny_lda_100_v1_qqp
15
- results:
16
- - task:
17
- name: Text Classification
18
- type: text-classification
19
- dataset:
20
- name: GLUE QQP
21
- type: glue
22
- args: qqp
23
- metrics:
24
- - name: Accuracy
25
- type: accuracy
26
- value: 0.6318327974276527
27
- - name: F1
28
- type: f1
29
- value: 0.0
30
  ---
31
 
32
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -34,12 +16,12 @@ should probably proofread and complete it, then remove this comment. -->
34
 
35
  # bert_tiny_lda_100_v1_qqp
36
 
37
- This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1) on the GLUE QQP dataset.
38
  It achieves the following results on the evaluation set:
39
- - Loss: 0.6569
40
- - Accuracy: 0.6318
41
- - F1: 0.0
42
- - Combined Score: 0.3159
43
 
44
  ## Model description
45
 
@@ -58,7 +40,7 @@ More information needed
58
  ### Training hyperparameters
59
 
60
  The following hyperparameters were used during training:
61
- - learning_rate: 0.001
62
  - train_batch_size: 256
63
  - eval_batch_size: 256
64
  - seed: 10
@@ -68,16 +50,19 @@ The following hyperparameters were used during training:
68
 
69
  ### Training results
70
 
71
- | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
72
- |:-------------:|:-----:|:-----:|:---------------:|:--------:|:---:|:--------------:|
73
- | 0.6613 | 1.0 | 1422 | 0.6580 | 0.6318 | 0.0 | 0.3159 |
74
- | 0.6591 | 2.0 | 2844 | 0.6584 | 0.6318 | 0.0 | 0.3159 |
75
- | 0.6587 | 3.0 | 4266 | 0.6569 | 0.6318 | 0.0 | 0.3159 |
76
- | 0.6585 | 4.0 | 5688 | 0.6574 | 0.6318 | 0.0 | 0.3159 |
77
- | 0.6585 | 5.0 | 7110 | 0.6574 | 0.6318 | 0.0 | 0.3159 |
78
- | 0.6585 | 6.0 | 8532 | 0.6580 | 0.6318 | 0.0 | 0.3159 |
79
- | 0.6585 | 7.0 | 9954 | 0.6573 | 0.6318 | 0.0 | 0.3159 |
80
- | 0.6585 | 8.0 | 11376 | 0.6573 | 0.6318 | 0.0 | 0.3159 |
 
 
 
81
 
82
 
83
  ### Framework versions
 
1
  ---
2
  library_name: transformers
 
 
3
  base_model: gokulsrinivasagan/bert_tiny_lda_100_v1
4
  tags:
5
  - generated_from_trainer
 
 
6
  metrics:
7
  - accuracy
8
  - f1
9
  model-index:
10
  - name: bert_tiny_lda_100_v1_qqp
11
+ results: []
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
16
 
17
  # bert_tiny_lda_100_v1_qqp
18
 
19
+ This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.4678
22
+ - Accuracy: 0.8567
23
+ - F1: 0.8093
24
+ - Combined Score: 0.8330
25
 
26
  ## Model description
27
 
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - learning_rate: 5e-05
44
  - train_batch_size: 256
45
  - eval_batch_size: 256
46
  - seed: 10
 
50
 
51
  ### Training results
52
 
53
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Combined Score |
54
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:--------------:|
55
+ | 0.4874 | 1.0 | 1422 | 0.4274 | 0.7980 | 0.7125 | 0.7553 |
56
+ | 0.388 | 2.0 | 2844 | 0.3786 | 0.8224 | 0.7726 | 0.7975 |
57
+ | 0.3354 | 3.0 | 4266 | 0.3613 | 0.8372 | 0.7899 | 0.8136 |
58
+ | 0.2928 | 4.0 | 5688 | 0.3564 | 0.8447 | 0.7830 | 0.8139 |
59
+ | 0.2583 | 5.0 | 7110 | 0.3614 | 0.8509 | 0.7997 | 0.8253 |
60
+ | 0.2277 | 6.0 | 8532 | 0.3551 | 0.8543 | 0.8063 | 0.8303 |
61
+ | 0.2014 | 7.0 | 9954 | 0.3854 | 0.8552 | 0.8093 | 0.8322 |
62
+ | 0.1784 | 8.0 | 11376 | 0.3979 | 0.8545 | 0.8064 | 0.8305 |
63
+ | 0.1578 | 9.0 | 12798 | 0.4261 | 0.8558 | 0.8102 | 0.8330 |
64
+ | 0.1403 | 10.0 | 14220 | 0.4443 | 0.8588 | 0.8108 | 0.8348 |
65
+ | 0.1246 | 11.0 | 15642 | 0.4678 | 0.8567 | 0.8093 | 0.8330 |
66
 
67
 
68
  ### Framework versions
logs/events.out.tfevents.1733324663.ki-g0008.1208741.24 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ef3f785292eac34d4298ea7f2877cee33002cb56c85d9310db9899f966b5b959
3
- size 11464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:014f3d1006765a8877b710f20b220968e07fbce2106d91a7ff514fd759212752
3
+ size 12456
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6138a62fb631534e5707ea35d8605788ae580ef7a8384e7f841240b6c7a711a6
3
  size 131856744
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd75e29416cccd525648851c56db672ed65ae09436c050b8ce14c9634d7058fc
3
  size 131856744