runtime error
Exit code: 1. Reason: ing key in the module instead of copying them in place?) warnings.warn( /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2397: UserWarning: for base_model.model.model.layers.31.mlp.up_proj.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn( /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2397: UserWarning: for base_model.model.model.layers.31.mlp.down_proj.lora_A.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn( /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2397: UserWarning: for base_model.model.model.layers.31.mlp.down_proj.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn( Traceback (most recent call last): File "/home/user/app/app.py", line 31, in <module> model = PeftModel.from_pretrained(model, peft_model_id) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 581, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1290, in load_adapter self._update_offload(offload_index, adapters_weights) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1121, in _update_offload safe_module = dict(self.named_modules())[extended_prefix] KeyError: 'base_model.model.model.model.embed_tokens'
Container logs:
Fetching error logs...