example code 실행이 안 됩니다.

#8
by ljm9667 - opened

RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider passing CUDA_LAUNCH_BLOCKING=1
Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

/pytorch/aten/src/ATen/native/cuda/TensorCompare.cu:110: _assert_async_cuda_kernel: block: [0,0,0], thread: [0,0,0] Assertion probability tensor contains either inf, nan or element < 0 failed.

이런 오류가 나는데 원인이 뭘까요?

Bllossom org

최신 transformers 패키지와 머신에 맞는 torch버젼을 설치하신 뒤 실행해보시길 바랍니다.

pip install -U transformers
https://pytorch.org/get-started/previous-versions/

버전 requirements 알 수 있을까요?

Bllossom org

requirements은 따로 없고 최신버전으로 사용해보시길 바랍니다.
아래는 정상작동하는 저희의 pip list입니다

Package                  Version
------------------------ ------------
accelerate               1.6.0
certifi                  2025.1.31
charset-normalizer       3.4.1
filelock                 3.13.1
fsspec                   2024.6.1
huggingface-hub          0.30.2
idna                     3.10
Jinja2                   3.1.4
MarkupSafe               2.1.5
mpmath                   1.3.0
networkx                 3.3
numpy                    2.1.2
nvidia-cublas-cu12       12.4.5.8
nvidia-cuda-cupti-cu12   12.4.127
nvidia-cuda-nvrtc-cu12   12.4.127
nvidia-cuda-runtime-cu12 12.4.127
nvidia-cudnn-cu12        9.1.0.70
nvidia-cufft-cu12        11.2.1.3
nvidia-curand-cu12       10.3.5.147
nvidia-cusolver-cu12     11.6.1.9
nvidia-cusparse-cu12     12.3.1.170
nvidia-cusparselt-cu12   0.6.2
nvidia-nccl-cu12         2.21.5
nvidia-nvjitlink-cu12    12.4.127
nvidia-nvtx-cu12         12.4.127
packaging                24.2
pillow                   11.0.0
pip                      22.0.2
psutil                   7.0.0
PyYAML                   6.0.2
regex                    2024.11.6
requests                 2.32.3
safetensors              0.5.3
setuptools               59.6.0
sympy                    1.13.1
tokenizers               0.21.1
torch                    2.6.0+cu124
torchaudio               2.6.0+cu124
torchvision              0.21.0+cu124
tqdm                     4.67.1
transformers             4.51.3
triton                   3.2.0
typing_extensions        4.12.2
urllib3                  2.4.0
This comment has been hidden (marked as Resolved)

Sign up or log in to comment