example code 실행이 안 됩니다.
#8
by
ljm9667
- opened
RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with TORCH_USE_CUDA_DSA
to enable device-side assertions.
/pytorch/aten/src/ATen/native/cuda/TensorCompare.cu:110: _assert_async_cuda_kernel: block: [0,0,0], thread: [0,0,0] Assertion probability tensor contains either
inf,
nan or element < 0
failed.
이런 오류가 나는데 원인이 뭘까요?
최신 transformers 패키지와 머신에 맞는 torch버젼을 설치하신 뒤 실행해보시길 바랍니다.
pip install -U transformers
https://pytorch.org/get-started/previous-versions/
버전 requirements 알 수 있을까요?
requirements은 따로 없고 최신버전으로 사용해보시길 바랍니다.
아래는 정상작동하는 저희의 pip list입니다
Package Version
------------------------ ------------
accelerate 1.6.0
certifi 2025.1.31
charset-normalizer 3.4.1
filelock 3.13.1
fsspec 2024.6.1
huggingface-hub 0.30.2
idna 3.10
Jinja2 3.1.4
MarkupSafe 2.1.5
mpmath 1.3.0
networkx 3.3
numpy 2.1.2
nvidia-cublas-cu12 12.4.5.8
nvidia-cuda-cupti-cu12 12.4.127
nvidia-cuda-nvrtc-cu12 12.4.127
nvidia-cuda-runtime-cu12 12.4.127
nvidia-cudnn-cu12 9.1.0.70
nvidia-cufft-cu12 11.2.1.3
nvidia-curand-cu12 10.3.5.147
nvidia-cusolver-cu12 11.6.1.9
nvidia-cusparse-cu12 12.3.1.170
nvidia-cusparselt-cu12 0.6.2
nvidia-nccl-cu12 2.21.5
nvidia-nvjitlink-cu12 12.4.127
nvidia-nvtx-cu12 12.4.127
packaging 24.2
pillow 11.0.0
pip 22.0.2
psutil 7.0.0
PyYAML 6.0.2
regex 2024.11.6
requests 2.32.3
safetensors 0.5.3
setuptools 59.6.0
sympy 1.13.1
tokenizers 0.21.1
torch 2.6.0+cu124
torchaudio 2.6.0+cu124
torchvision 0.21.0+cu124
tqdm 4.67.1
transformers 4.51.3
triton 3.2.0
typing_extensions 4.12.2
urllib3 2.4.0
This comment has been hidden (marked as Resolved)