Update README.md
Browse filesUpdate wording and fix GPU count.
README.md
CHANGED
@@ -290,8 +290,8 @@ Current version: parakeet-tdt-0.6b-v2. Previous versions can be [accessed](https
|
|
290 |
|
291 |
This model was trained using the NeMo toolkit [3], following the strategies below:
|
292 |
|
293 |
-
- Initialized from a
|
294 |
-
- Trained for 150,000 steps on
|
295 |
- Dataset corpora were balanced using a temperature sampling value of 0.5.
|
296 |
- Stage 2 fine-tuning was performed for 2,500 steps on 4 A100 GPUs using approximately 500 hours of high-quality, human-transcribed data of NeMo ASR Set 3.0.
|
297 |
|
|
|
290 |
|
291 |
This model was trained using the NeMo toolkit [3], following the strategies below:
|
292 |
|
293 |
+
- Initialized from a FastConformer SSL checkpoint that was pretrained with a wav2vev method on the LibriLight dataset[7].
|
294 |
+
- Trained for 150,000 steps on 64 A100 GPUs.
|
295 |
- Dataset corpora were balanced using a temperature sampling value of 0.5.
|
296 |
- Stage 2 fine-tuning was performed for 2,500 steps on 4 A100 GPUs using approximately 500 hours of high-quality, human-transcribed data of NeMo ASR Set 3.0.
|
297 |
|