Hugging Face's logo

devcnn5
/
t5-large-fft

Text2Text Generation
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Model card Files Metrics Community
devcnn5 commited on
Commit
b88eb00
·
verified ·
1 Parent(s): 2013657

devcnn5/t5-large

Browse files
Files changed (6) hide show
  1. README.md +12 -7
  2. model.safetensors +1 -1
  3. runs/Jan03_11-26-06_AZJAIVISIONA100G07M02/events.out.tfevents.1735903566.AZJAIVISIONA100G07M02.237067.0 +3 -0
  4. runs/Jan03_11-38-11_AZJAIVISIONA100G07M02/events.out.tfevents.1735904291.AZJAIVISIONA100G07M02.237790.0 +3 -0
  5. runs/Jan03_11-59-47_AZJAIVISIONA100G07M02/events.out.tfevents.1735905587.AZJAIVISIONA100G07M02.239058.0 +3 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co/google/flan-t5-large) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.3132
20
 
21
  ## Model description
22
 
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 0.05
39
  - train_batch_size: 16
40
  - eval_batch_size: 16
41
  - seed: 42
@@ -47,11 +47,16 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 0.4448 | 0.4 | 500 | 0.3952 |
51
- | 0.4259 | 0.8 | 1000 | 0.7448 |
52
- | 0.3674 | 1.2 | 1500 | 0.3346 |
53
- | 0.3665 | 1.6 | 2000 | 0.3294 |
54
- | 0.3597 | 2.0 | 2500 | 0.3132 |
 
 
 
 
 
55
 
56
 
57
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [google/flan-t5-large](https://huggingface.co/google/flan-t5-large) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.0209
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 0.0005
39
  - train_batch_size: 16
40
  - eval_batch_size: 16
41
  - seed: 42
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.0419 | 0.2 | 500 | 0.0315 |
51
+ | 0.0344 | 0.4 | 1000 | 0.0267 |
52
+ | 0.0313 | 0.6 | 1500 | 0.0245 |
53
+ | 0.0269 | 0.8 | 2000 | 0.0230 |
54
+ | 0.026 | 1.0 | 2500 | 0.0219 |
55
+ | 0.0192 | 1.2 | 3000 | 0.0218 |
56
+ | 0.0233 | 1.4 | 3500 | 0.0213 |
57
+ | 0.0223 | 1.6 | 4000 | 0.0210 |
58
+ | 0.0214 | 1.8 | 4500 | 0.0210 |
59
+ | 0.0233 | 2.0 | 5000 | 0.0209 |
60
 
61
 
62
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cbecf27138e608109343a180f73c6e5f178d543caffb00aea0a33cd8ca2780ab
3
  size 1566368768
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:352ea5b4a57825824d6cdc04d9f661c1441bdf339b3bc17c34742ac8bade161d
3
  size 1566368768
runs/Jan03_11-26-06_AZJAIVISIONA100G07M02/events.out.tfevents.1735903566.AZJAIVISIONA100G07M02.237067.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b0c743fa0158b4001c1e5a08991ddb4fc125e07e41824f2fad92a1a3267272e
3
+ size 7604
runs/Jan03_11-38-11_AZJAIVISIONA100G07M02/events.out.tfevents.1735904291.AZJAIVISIONA100G07M02.237790.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2472bd40e48e6b209e8a5e6e2f4c22e246059cf65ca7fb348a99179fa13b85c1
3
+ size 10196
runs/Jan03_11-59-47_AZJAIVISIONA100G07M02/events.out.tfevents.1735905587.AZJAIVISIONA100G07M02.239058.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc0ee62b48b66beba1141f857c6b61b9b9ba8f67699976c0215d54df13e24417
3
+ size 29389
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fecc2c2a945486a576cdc0a5d3187395c8963885d9b3fcf191224004aa27d63
3
  size 5304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21a04d45859f45fd56ef8fed5a1c1901c98704b31e668e87b7e7621d44a5b5df
3
  size 5304