runtime error

Exit code: 1. Reason: οΏ½β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 663/663 [00:00<00:00, 6.29MB/s] merges.txt: 0%| | 0.00/1.67M [00:00<?, ?B/s] merges.txt: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1.67M/1.67M [00:00<00:00, 51.2MB/s] model.safetensors.index.json: 0%| | 0.00/123k [00:00<?, ?B/s] model.safetensors.index.json: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 123k/123k [00:00<00:00, 68.9MB/s] tokenizer.json: 0%| | 0.00/7.03M [00:00<?, ?B/s] tokenizer.json: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 7.03M/7.03M [00:00<00:00, 70.8MB/s] tokenizer_config.json: 0%| | 0.00/7.30k [00:00<?, ?B/s] tokenizer_config.json: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 7.30k/7.30k [00:00<00:00, 37.6MB/s] vit_config.json: 0%| | 0.00/205 [00:00<?, ?B/s] vit_config.json: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 205/205 [00:00<00:00, 1.59MB/s] vocab.json: 0%| | 0.00/2.78M [00:00<?, ?B/s] vocab.json: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 2.78M/2.78M [00:00<00:00, 25.2MB/s] The safetensors archive passed at ./model_weights/ema.safetensors does not contain metadata. Make sure to save your model with the `save_pretrained` method. Defaulting to 'pt' metadata. Traceback (most recent call last): File "/home/user/app/app.py", line 110, in <module> model = load_checkpoint_and_dispatch( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 628, in load_checkpoint_and_dispatch load_checkpoint_in_model( File "/usr/local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 1955, in load_checkpoint_in_model loaded_checkpoint = load_state_dict(checkpoint_file, device_map=device_map) File "/usr/local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 1658, in load_state_dict return safe_load_file(checkpoint_file, device=target_device) File "/usr/local/lib/python3.10/site-packages/safetensors/torch.py", line 313, in load_file with safe_open(filename, framework="pt", device=device) as f: safetensors_rust.SafetensorError: device disk is invalid

Container logs:

Fetching error logs...