Encounter error while running mlx-community/Kimi-VL-A3B-Thinking-4bit

#2
by wolfofbackstreet - opened

Hello, when I run this command I always get such error:

File "", line 30, in isfile
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

'''
python -m mlx_vlm.generate --model mlx-community/Kimi-VL-A3B-Thinking-4bit --max-tokens 100 --temperature 0.0 --prompt "How can I go from Fanling to Sheung Wan?" --image mtr.png
'''

mlx_vlm: 0.1.23

Thank you in advance.

Hi !

I also found the same error, and looks like the issue is the tiktoken.model file found in this folder is not downloaded.

I downloaded it, copied it to the blobs folder, and referenced it from the code folder, but it complains about a missing dependency, 'blobfile', so I run pip install blobfile and then the error did not happen .

Hope it helps !

MLX Community org

Fixed βœ…

pip install -U mlx-vlm

image.png

prince-canuma changed discussion status to closed

Sign up or log in to comment