Hugging Face's logo

gokulsrinivasagan
/
bert_tiny_lda_100_v1_stsb

Text Classification
Transformers
TensorBoard
Safetensors
English
distilbert
Generated from Trainer
Eval Results
Model card Files Metrics Community
gokulsrinivasagan commited on
Commit
070a4fe
·
verified ·
1 Parent(s): e3cdd93

Model save

Browse files
Files changed (3) hide show
  1. README.md +18 -36
  2. logs/events.out.tfevents.1733327310.ki-g0008.1208741.30 +2 -2
  3. model.safetensors +1 -1
README.md CHANGED
@@ -1,28 +1,13 @@
1
  ---
2
  library_name: transformers
3
- language:
4
- - en
5
  base_model: gokulsrinivasagan/bert_tiny_lda_100_v1
6
  tags:
7
  - generated_from_trainer
8
- datasets:
9
- - glue
10
  metrics:
11
  - spearmanr
12
  model-index:
13
  - name: bert_tiny_lda_100_v1_stsb
14
- results:
15
- - task:
16
- name: Text Classification
17
- type: text-classification
18
- dataset:
19
- name: GLUE STSB
20
- type: glue
21
- args: stsb
22
- metrics:
23
- - name: Spearmanr
24
- type: spearmanr
25
- value: .nan
26
  ---
27
 
28
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -30,12 +15,12 @@ should probably proofread and complete it, then remove this comment. -->
30
 
31
  # bert_tiny_lda_100_v1_stsb
32
 
33
- This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1) on the GLUE STSB dataset.
34
  It achieves the following results on the evaluation set:
35
- - Loss: 2.3547
36
- - Pearson: nan
37
- - Spearmanr: nan
38
- - Combined Score: nan
39
 
40
  ## Model description
41
 
@@ -54,7 +39,7 @@ More information needed
54
  ### Training hyperparameters
55
 
56
  The following hyperparameters were used during training:
57
- - learning_rate: 0.001
58
  - train_batch_size: 256
59
  - eval_batch_size: 256
60
  - seed: 10
@@ -66,20 +51,17 @@ The following hyperparameters were used during training:
66
 
67
  | Training Loss | Epoch | Step | Validation Loss | Pearson | Spearmanr | Combined Score |
68
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:---------:|:--------------:|
69
- | 4.3798 | 1.0 | 23 | 3.4026 | nan | nan | nan |
70
- | 2.2683 | 2.0 | 46 | 2.7380 | nan | nan | nan |
71
- | 2.2687 | 3.0 | 69 | 2.7826 | nan | nan | nan |
72
- | 2.1923 | 4.0 | 92 | 2.6349 | nan | nan | nan |
73
- | 2.2028 | 5.0 | 115 | 2.6328 | -0.0113 | -0.0109 | -0.0111 |
74
- | 2.1848 | 6.0 | 138 | 2.3805 | -0.0246 | -0.0228 | -0.0237 |
75
- | 2.194 | 7.0 | 161 | 2.8532 | nan | nan | nan |
76
- | 2.1835 | 8.0 | 184 | 2.5613 | nan | nan | nan |
77
- | 2.1788 | 9.0 | 207 | 2.3547 | nan | nan | nan |
78
- | 2.1688 | 10.0 | 230 | 2.4241 | nan | nan | nan |
79
- | 2.1963 | 11.0 | 253 | 2.6747 | nan | nan | nan |
80
- | 2.186 | 12.0 | 276 | 2.4512 | nan | nan | nan |
81
- | 2.186 | 13.0 | 299 | 2.4655 | nan | nan | nan |
82
- | 2.2089 | 14.0 | 322 | 2.7380 | nan | nan | nan |
83
 
84
 
85
  ### Framework versions
 
1
  ---
2
  library_name: transformers
 
 
3
  base_model: gokulsrinivasagan/bert_tiny_lda_100_v1
4
  tags:
5
  - generated_from_trainer
 
 
6
  metrics:
7
  - spearmanr
8
  model-index:
9
  - name: bert_tiny_lda_100_v1_stsb
10
+ results: []
 
 
 
 
 
 
 
 
 
 
 
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
15
 
16
  # bert_tiny_lda_100_v1_stsb
17
 
18
+ This model is a fine-tuned version of [gokulsrinivasagan/bert_tiny_lda_100_v1](https://huggingface.co/gokulsrinivasagan/bert_tiny_lda_100_v1) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 2.7520
21
+ - Pearson: 0.3013
22
+ - Spearmanr: 0.2887
23
+ - Combined Score: 0.2950
24
 
25
  ## Model description
26
 
 
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
+ - learning_rate: 5e-05
43
  - train_batch_size: 256
44
  - eval_batch_size: 256
45
  - seed: 10
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Pearson | Spearmanr | Combined Score |
53
  |:-------------:|:-----:|:----:|:---------------:|:-------:|:---------:|:--------------:|
54
+ | 2.8077 | 1.0 | 23 | 2.3850 | 0.0667 | 0.0654 | 0.0661 |
55
+ | 2.042 | 2.0 | 46 | 2.6089 | 0.0834 | 0.0848 | 0.0841 |
56
+ | 1.9254 | 3.0 | 69 | 2.3926 | 0.1539 | 0.1394 | 0.1466 |
57
+ | 1.8381 | 4.0 | 92 | 2.5560 | 0.1744 | 0.1720 | 0.1732 |
58
+ | 1.6974 | 5.0 | 115 | 3.0257 | 0.1812 | 0.1757 | 0.1784 |
59
+ | 1.5776 | 6.0 | 138 | 2.3632 | 0.2350 | 0.2288 | 0.2319 |
60
+ | 1.2951 | 7.0 | 161 | 2.4535 | 0.2594 | 0.2573 | 0.2584 |
61
+ | 1.0896 | 8.0 | 184 | 2.5246 | 0.2652 | 0.2622 | 0.2637 |
62
+ | 0.9372 | 9.0 | 207 | 2.9827 | 0.2716 | 0.2570 | 0.2643 |
63
+ | 0.7915 | 10.0 | 230 | 2.6918 | 0.3056 | 0.2926 | 0.2991 |
64
+ | 0.673 | 11.0 | 253 | 2.7520 | 0.3013 | 0.2887 | 0.2950 |
 
 
 
65
 
66
 
67
  ### Framework versions
logs/events.out.tfevents.1733327310.ki-g0008.1208741.30 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0c8f02e0d60c72445747a8096b1979563aa40fab56781f2d144d1095931f5e5f
3
- size 10839
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e42e9c55add6eaf2117140ea6892fba25d59488bfa15c62451a78f5718b2c8e
3
+ size 12481
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:10db9716e505ee0cccad36199f98143cd47f68d94331e46a8626a58fa4fb8214
3
  size 131854692
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae139780e7f3735ef732e566cf5d5b58cee1ee8582b88690196ab17710c5cee9
3
  size 131854692