Error when loading in LM Studio
#1
by
palmersaccount
- opened
Hello!
I downloaded this model as I saw it was compatible with LM Studio, but encountered this error when trying to load it:
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: The repository /Volumes/External/Models/ssweens/Kimi-VL-A3B-Thinking-2506-mlx-4bit contains custom code which must be executed to correctly load the model. You can inspect the repository content at /Volumes/External/Models/ssweens/Kimi-VL-A3B-Thinking-2506-mlx-4bit .
You can inspect the repository content at https://hf.co//Volumes/External/Models/ssweens/Kimi-VL-A3B-Thinking-2506-mlx-4bit.
Please pass the argument `trust_remote_code=True` to allow custom code to be run.
Looks like LMStudio doesn't have a way to enable the --trust-remote-code flag in mlx_lm, which Kimi requires.
https://github.com/lmstudio-ai/mlx-engine/issues/29
You could check in their Discord channel about any updates, or just use mlx_lm directly. Good luck.