How can i fix ModuleNotFoundError: No module named 'vllm._C'

#18

by JayGeeUnreal - opened 16 days ago

16 days ago

I get ModuleNotFoundError: No module named 'vllm._C' when trying to run
python vllm_streaming_inference.py

Installed in a conda env using pip3

JayGeeUnreal changed discussion title from How con i fix ModuleNotFoundError: No module named 'vllm._C' to How can i fix ModuleNotFoundError: No module named 'vllm._C' 16 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment