miosipof commited on
Commit
8c288ef
·
verified ·
1 Parent(s): 909c754

End of training

Browse files
Files changed (1) hide show
  1. README.md +85 -0
README.md ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: openai/whisper-tiny
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - balbus-classifier
9
+ metrics:
10
+ - accuracy
11
+ model-index:
12
+ - name: miosipof/whisper-tiny-ft-balbus-sep28k-v1
13
+ results:
14
+ - task:
15
+ name: Audio Classification
16
+ type: audio-classification
17
+ dataset:
18
+ name: Apple dataset
19
+ type: balbus-classifier
20
+ config: default
21
+ split: train
22
+ args: default
23
+ metrics:
24
+ - name: Accuracy
25
+ type: accuracy
26
+ value: 0.7508617988091507
27
+ ---
28
+
29
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
30
+ should probably proofread and complete it, then remove this comment. -->
31
+
32
+ # miosipof/whisper-tiny-ft-balbus-sep28k-v1
33
+
34
+ This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on the Apple dataset dataset.
35
+ It achieves the following results on the evaluation set:
36
+ - Loss: 0.5255
37
+ - Accuracy: 0.7509
38
+
39
+ ## Model description
40
+
41
+ More information needed
42
+
43
+ ## Intended uses & limitations
44
+
45
+ More information needed
46
+
47
+ ## Training and evaluation data
48
+
49
+ More information needed
50
+
51
+ ## Training procedure
52
+
53
+ ### Training hyperparameters
54
+
55
+ The following hyperparameters were used during training:
56
+ - learning_rate: 4e-05
57
+ - train_batch_size: 64
58
+ - eval_batch_size: 32
59
+ - seed: 42
60
+ - gradient_accumulation_steps: 2
61
+ - total_train_batch_size: 128
62
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
63
+ - lr_scheduler_type: linear
64
+ - lr_scheduler_warmup_ratio: 0.5
65
+ - training_steps: 600
66
+ - mixed_precision_training: Native AMP
67
+
68
+ ### Training results
69
+
70
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy |
71
+ |:-------------:|:------:|:----:|:---------------:|:--------:|
72
+ | 0.6685 | 0.5013 | 100 | 0.6430 | 0.6371 |
73
+ | 0.5858 | 1.0 | 200 | 0.5736 | 0.7068 |
74
+ | 0.5284 | 1.5013 | 300 | 0.5422 | 0.7333 |
75
+ | 0.5125 | 2.0 | 400 | 0.5359 | 0.7361 |
76
+ | 0.4163 | 2.5013 | 500 | 0.5517 | 0.7369 |
77
+ | 0.4113 | 3.0 | 600 | 0.5255 | 0.7509 |
78
+
79
+
80
+ ### Framework versions
81
+
82
+ - Transformers 4.48.0
83
+ - Pytorch 2.2.0
84
+ - Datasets 3.2.0
85
+ - Tokenizers 0.21.0