runtime error
Exit code: 1. Reason: ex)[0] File "/usr/local/lib/python3.10/site-packages/torch/cuda/memory.py", line 836, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 449, in cudart _lazy_init() File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 372, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.10/site-packages/transformers/pipelines/base.py", line 310, in infer_framework_load_model model = model_class.from_pretrained(model, **fp32_kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 311, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4833, in from_pretrained ) = cls._load_pretrained_model( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 5254, in _load_pretrained_model caching_allocator_warmup(model_to_load, expanded_device_map, hf_quantizer) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 5855, in caching_allocator_warmup device_memory = torch.cuda.mem_get_info(index)[0] File "/usr/local/lib/python3.10/site-packages/torch/cuda/memory.py", line 836, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 449, in cudart _lazy_init() File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 372, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...