🥲 Failed to load the model
#1
by
desmond108
- opened
Using LMStudio on M1 Mac Mini:
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: Model type Dream not supported.
You have to wait for the new MLX-LM update and that LM Studio adapts it into the new version too.
Thanks mate. Am currently running 0.3.17.
Hi I`ve tried to use https://github.com/ml-explore/mlx-lm/pull/270 and had an error with shape:
970 # Prepare max length
--> 971 input_length = prompt.shape[1]
972 if generation_config.max_new_tokens is not None:
973 generation_config.max_length = generation_config.max_new_tokens + input_length
- when i fix the hape to [1] the responce was empty.
@sdfgtr455yytrers thanks for trying my PR, ill continue optmimizing the inference, its currently really slow. you would have to use the "python -m generate_diffusion" command and eddit the prompt inside the file too, once i get this running nice, ill add it into generate itself.