devcnn5 commited on
Commit
6fa778a
·
verified ·
1 Parent(s): b88eb00

devcnn5/t5-large

Browse files
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co/google/flan-t5-large) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.0209
20
 
21
  ## Model description
22
 
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 0.0005
39
  - train_batch_size: 16
40
  - eval_batch_size: 16
41
  - seed: 42
@@ -47,16 +47,16 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 0.0419 | 0.2 | 500 | 0.0315 |
51
- | 0.0344 | 0.4 | 1000 | 0.0267 |
52
- | 0.0313 | 0.6 | 1500 | 0.0245 |
53
- | 0.0269 | 0.8 | 2000 | 0.0230 |
54
- | 0.026 | 1.0 | 2500 | 0.0219 |
55
- | 0.0192 | 1.2 | 3000 | 0.0218 |
56
- | 0.0233 | 1.4 | 3500 | 0.0213 |
57
- | 0.0223 | 1.6 | 4000 | 0.0210 |
58
- | 0.0214 | 1.8 | 4500 | 0.0210 |
59
- | 0.0233 | 2.0 | 5000 | 0.0209 |
60
 
61
 
62
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co/google/flan-t5-large) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0427
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 0.0001
39
  - train_batch_size: 16
40
  - eval_batch_size: 16
41
  - seed: 42
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.0725 | 0.2 | 500 | 0.1335 |
51
+ | 0.0884 | 0.4 | 1000 | 0.0830 |
52
+ | 0.0535 | 0.6 | 1500 | 0.0643 |
53
+ | 0.0713 | 0.8 | 2000 | 0.0449 |
54
+ | 0.0486 | 1.0 | 2500 | 0.0437 |
55
+ | 0.041 | 1.2 | 3000 | 0.0433 |
56
+ | 0.0478 | 1.4 | 3500 | 0.0430 |
57
+ | 0.0472 | 1.6 | 4000 | 0.0428 |
58
+ | 0.0461 | 1.8 | 4500 | 0.0427 |
59
+ | 0.0667 | 2.0 | 5000 | 0.0427 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:352ea5b4a57825824d6cdc04d9f661c1441bdf339b3bc17c34742ac8bade161d
3
  size 1566368768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:753d35b41e3f464c685bea5b94574f70210229ae0ceff1f880070cc7d480f7d5
3
  size 1566368768
runs/Jan03_14-43-09_AZJAIVISIONA100G07M02/events.out.tfevents.1735915389.AZJAIVISIONA100G07M02.433764.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a27dd50e913d0a1f3c3d94a973a45509b4aec62525ad994b501dc8cd34c1b413
3
+ size 29389
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21a04d45859f45fd56ef8fed5a1c1901c98704b31e668e87b7e7621d44a5b5df
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:52ba0a4ee339df243aaa5c9c2c0e3e3fa68da4a33dc66908a647e46e5cd44400
3
  size 5304