wandb: Currently logged in as: priyanshi-pal (priyanshipal). Use `wandb login --relogin` to force relogin wandb: wandb version 0.17.7 is available! To upgrade, please run: wandb: $ pip install wandb --upgrade wandb: Tracking run with wandb version 0.17.6 wandb: Run data is saved locally in /scratch/elec/t405-puhe/p/palp3/MUCS/wandb/run-20240822_144249-be92xk0e wandb: Run `wandb offline` to turn off syncing. wandb: Syncing run eval_pd2000_s300_shuff100_hindi wandb: ⭐️ View project at https://wandb.ai/priyanshipal/huggingface wandb: 🚀 View run at https://wandb.ai/priyanshipal/huggingface/runs/be92xk0e /scratch/work/palp3/myenv/lib/python3.11/site-packages/transformers/training_args.py:1525: FutureWarning: `evaluation_strategy` is deprecated and will be removed in version 4.46 of 🤗 Transformers. Use `eval_strategy` instead warnings.warn( Generating train split: 0 examples [00:00, ? examples/s] Generating train split: 0 examples [00:00, ? examples/s] Traceback (most recent call last): File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/builder.py", line 1997, in _prepare_split_single for _, table in generator: File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/packaged_modules/json/json.py", line 98, in _generate_tables dataset = dataset[self.config.field] ~~~~~~~^^^^^^^^^^^^^^^^^^^ KeyError: 'test' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/scratch/elec/puhe/p/palp3/MUCS/eval_script_indicwav2vec.py", line 790, in main() File "/scratch/elec/puhe/p/palp3/MUCS/eval_script_indicwav2vec.py", line 427, in main raw_datasets["eval"] = load_dataset( ^^^^^^^^^^^^^ File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/load.py", line 2616, in load_dataset builder_instance.download_and_prepare( File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/builder.py", line 1029, in download_and_prepare self._download_and_prepare( File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/builder.py", line 1124, in _download_and_prepare self._prepare_split(split_generator, **prepare_split_kwargs) File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/builder.py", line 1884, in _prepare_split for job_id, done, content in self._prepare_split_single( File "/scratch/work/palp3/myenv/lib/python3.11/site-packages/datasets/builder.py", line 2040, in _prepare_split_single raise DatasetGenerationError("An error occurred while generating the dataset") from e datasets.exceptions.DatasetGenerationError: An error occurred while generating the dataset wandb: - 0.005 MB of 0.005 MB uploaded wandb: \ 0.005 MB of 0.018 MB uploaded wandb: | 0.018 MB of 0.018 MB uploaded wandb: 🚀 View run eval_pd2000_s300_shuff100_hindi at: https://wandb.ai/priyanshipal/huggingface/runs/be92xk0e wandb: ⭐️ View project at: https://wandb.ai/priyanshipal/huggingface wandb: Synced 6 W&B file(s), 0 media file(s), 0 artifact file(s) and 0 other file(s) wandb: Find logs at: ./wandb/run-20240822_144249-be92xk0e/logs wandb: WARNING The new W&B backend becomes opt-out in version 0.18.0; try it out with `wandb.require("core")`! See https://wandb.me/wandb-core for more information.