runtime error
Exit code: 1. Reason: n( generation_config.json: 0%| | 0.00/188 [00:00<?, ?B/s][A generation_config.json: 100%|ββββββββββ| 188/188 [00:00<00:00, 1.29MB/s] Some parameters are on the meta device because they were offloaded to the cpu and disk. adapter_config.json: 0%| | 0.00/528 [00:00<?, ?B/s][A adapter_config.json: 100%|ββββββββββ| 528/528 [00:00<00:00, 1.65MB/s] adapter_model.safetensors: 0%| | 0.00/40.0M [00:00<?, ?B/s][A adapter_model.safetensors: 100%|ββββββββββ| 40.0M/40.0M [00:00<00:00, 54.7MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 29, in <module> model = PeftModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 278, in from_pretrained model.load_adapter(model_id, adapter_name, is_trainable=is_trainable, **kwargs) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 587, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 499, in dispatch_model model.to(device) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1145, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 797, in _apply module._apply(fn) [Previous line repeated 6 more times] File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 820, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1143, in convert return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking) NotImplementedError: Cannot copy out of meta tensor; no data!
Container logs:
Fetching error logs...