runtime error
Exit code: 1. Reason: ( File "/usr/local/lib/python3.10/site-packages/flash_attn/flash_attn_interface.py", line 15, in <module> import flash_attn_2_cuda as flash_attn_gpu ModuleNotFoundError: No module named 'flash_attn_2_cuda' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/user/app/app.py", line 28, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 551, in from_pretrained model_class = get_class_from_dynamic_module( File "/usr/local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 514, in get_class_from_dynamic_module return get_class_in_module(class_name, final_module) File "/usr/local/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 212, in get_class_in_module module_spec.loader.exec_module(module) File "<frozen importlib._bootstrap_external>", line 883, in exec_module File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/home/user/.cache/huggingface/modules/transformers_modules/microsoft/Phi-3.5-vision-instruct/4a0d683eba9f1d0cbfb6151705d1ee73c25a80ca/modeling_phi3_v.py", line 59, in <module> from transformers import CLIPVisionConfig, CLIPVisionModel, PretrainedConfig File "<frozen importlib._bootstrap>", line 1075, in _handle_fromlist File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1577, in __getattr__ value = getattr(module, name) File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1576, in __getattr__ module = self._get_module(self._class_to_module[name]) File "/usr/local/lib/python3.10/site-packages/transformers/utils/import_utils.py", line 1588, in _get_module raise RuntimeError( RuntimeError: Failed to import transformers.models.clip.modeling_clip because of the following error (look up to see its traceback): No module named 'flash_attn_2_cuda'
Container logs:
Fetching error logs...