`ValueError: Model type llada not supported.`, anyone knows what I need to do?
#1
by
very-cooluser
- opened
The whole message is below, anyone knows if I'm missing something?
File "./lib/python3.11/site-packages/mlx_lm/utils.py", line 148, in _get_classes
arch = importlib.import_module(f"mlx_lm.models.{model_type}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen importlib._bootstrap>", line 1206, in _gcd_import
File "<frozen importlib._bootstrap>", line 1178, in _find_and_load
File "<frozen importlib._bootstrap>", line 1142, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'mlx_lm.models.llada'
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "./inf.py", line 3, in <module>
model, tokenizer = load("mlx-community/LLaDA-8B-Instruct-mlx-4bit")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./lib/python3.11/site-packages/mlx_lm/utils.py", line 785, in load
model, config = load_model(model_path, lazy)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./lib/python3.11/site-packages/mlx_lm/utils.py", line 720, in load_model
model_class, model_args_class = get_model_classes(config=config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "./lib/python3.11/site-packages/mlx_lm/utils.py", line 152, in _get_classes
raise ValueError(msg)
ValueError: Model type llada not supported.
Same here on M4 Mac Mini, with both the 4bit and 8bit variants.
🥲 Failed to load the model
Failed to load model
Error when loading model: ValueError: Model type llada not supported.