LennyBijan commited on
Commit
cee63b0
1 Parent(s): 98417db

Model save

Browse files
README.md CHANGED
@@ -1,10 +1,8 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: openai/whisper-large-v2
6
- metrics:
7
- - wer
8
  model-index:
9
  - name: BA_Model_V3
10
  results: []
@@ -16,10 +14,6 @@ should probably proofread and complete it, then remove this comment. -->
16
  # BA_Model_V3
17
 
18
  This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on an unknown dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 0.6517
21
- - Wer: 30.2798
22
- - Cer: 16.8330
23
 
24
  ## Model description
25
 
@@ -38,34 +32,18 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 5e-05
42
  - train_batch_size: 8
43
  - eval_batch_size: 8
44
  - seed: 42
45
  - gradient_accumulation_steps: 2
46
  - total_train_batch_size: 16
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
- - lr_scheduler_type: cosine
49
- - lr_scheduler_warmup_ratio: 0.1
50
- - num_epochs: 10
51
  - mixed_precision_training: Native AMP
52
 
53
- ### Training results
54
-
55
- | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
56
- |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
57
- | 0.3941 | 1.0 | 278 | 0.5114 | 33.8716 | 18.9383 |
58
- | 0.3497 | 2.0 | 556 | 0.5683 | 35.4898 | 19.7814 |
59
- | 0.2096 | 3.0 | 834 | 0.6234 | 36.9584 | 19.3400 |
60
- | 0.1189 | 4.0 | 1112 | 0.6315 | 33.4596 | 17.0659 |
61
- | 0.0715 | 5.0 | 1390 | 0.6617 | 34.9349 | 18.4059 |
62
- | 0.0359 | 6.0 | 1668 | 0.6752 | 33.8384 | 18.5525 |
63
- | 0.0141 | 7.0 | 1946 | 0.6479 | 31.8215 | 16.5859 |
64
- | 0.0047 | 8.0 | 2224 | 0.6384 | 31.2699 | 17.4014 |
65
- | 0.0013 | 9.0 | 2502 | 0.6498 | 30.2532 | 16.7700 |
66
- | 0.0016 | 10.0 | 2780 | 0.6517 | 30.2798 | 16.8330 |
67
-
68
-
69
  ### Framework versions
70
 
71
  - Transformers 4.38.2
 
1
  ---
2
  license: apache-2.0
3
+ base_model: openai/whisper-large-v2
4
  tags:
5
  - generated_from_trainer
 
 
 
6
  model-index:
7
  - name: BA_Model_V3
8
  results: []
 
14
  # BA_Model_V3
15
 
16
  This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on an unknown dataset.
 
 
 
 
17
 
18
  ## Model description
19
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 1e-06
36
  - train_batch_size: 8
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - gradient_accumulation_steps: 2
40
  - total_train_batch_size: 16
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
+ - lr_scheduler_type: cosine_with_restarts
43
+ - lr_scheduler_warmup_ratio: 0.2
44
+ - num_epochs: 8
45
  - mixed_precision_training: Native AMP
46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
  ### Framework versions
48
 
49
  - Transformers 4.38.2
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc21efc062cfd67bbab45c823975f1772368c63aa78fd33dba50e489894ab9c3
3
  size 4992706480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:787be19c9124e16edff2523a784c73e50669cf070f1a0fdb350971c1746ded2d
3
  size 4992706480
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f4dd7da5de3b303468ed502b588a616a5680ffb42069bf2e4f61ac6a56fb3708
3
  size 1180663192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c53791d8c2915f8c4c40b337407bc6ca118ead3f6cb2a88d48cf195c2b1cd9e
3
  size 1180663192
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d30201432c5bcf76ef2197af3070c7e4e7058f52ecf03498e6252ab59c5c6a20
3
- size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e1640b2dce348e90b06d9d280df25b32c7c69c1cb0d6883d3a2dd66cd585fbc
3
+ size 5112