Update README.md
Browse files
README.md
CHANGED
@@ -290,7 +290,7 @@ Current version: parakeet-tdt-0.6b-v2. Previous versions can be [accessed](https
|
|
290 |
|
291 |
This model was trained using the NeMo toolkit [3], following the strategies below:
|
292 |
|
293 |
-
- Initialized from a FastConformer SSL checkpoint that was pretrained with a
|
294 |
- Trained for 150,000 steps on 64 A100 GPUs.
|
295 |
- Dataset corpora were balanced using a temperature sampling value of 0.5.
|
296 |
- Stage 2 fine-tuning was performed for 2,500 steps on 4 A100 GPUs using approximately 500 hours of high-quality, human-transcribed data of NeMo ASR Set 3.0.
|
|
|
290 |
|
291 |
This model was trained using the NeMo toolkit [3], following the strategies below:
|
292 |
|
293 |
+
- Initialized from a FastConformer SSL checkpoint that was pretrained with a wav2vec method on the LibriLight dataset[7].
|
294 |
- Trained for 150,000 steps on 64 A100 GPUs.
|
295 |
- Dataset corpora were balanced using a temperature sampling value of 0.5.
|
296 |
- Stage 2 fine-tuning was performed for 2,500 steps on 4 A100 GPUs using approximately 500 hours of high-quality, human-transcribed data of NeMo ASR Set 3.0.
|