runtime error
Exit code: 1. Reason: [A pytorch_model-00002-of-00002.bin: 56%|█████▌ | 1.96G/3.50G [00:09<00:04, 352MB/s][A pytorch_model-00002-of-00002.bin: 77%|███████▋ | 2.70G/3.50G [00:10<00:01, 449MB/s][A pytorch_model-00002-of-00002.bin: 100%|██████████| 3.50G/3.50G [00:11<00:00, 546MB/s][A pytorch_model-00002-of-00002.bin: 100%|██████████| 3.50G/3.50G [00:11<00:00, 306MB/s] Downloading shards: 100%|██████████| 2/2 [00:41<00:00, 19.30s/it][A Downloading shards: 100%|██████████| 2/2 [00:41<00:00, 20.98s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 12, in <module> base_model = LlamaForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4014, in from_pretrained ) = cls._load_pretrained_model( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4148, in _load_pretrained_model raise ValueError( ValueError: The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the weights in this format. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/user/app/app.py", line 24, in <module> raise ValueError(f"Model loading failed: {e}. Check base model and LoRA weights.") ValueError: Model loading failed: The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the weights in this format.. Check base model and LoRA weights. Loading error: The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the weights in this format.
Container logs:
Fetching error logs...