LM Studio doesn't load this model
#4
by
wishinet
- opened
It seems the latest version of LM Studio doesn't load this GGUF model.
Version: 0.3.15-5
OS: Windows 11 Pro
Error: see below
🥲 Failed to load the model
Failed to load model
error loading model: llama_model_loader: failed to load model from C:\Users\mariu\.lmstudio\models\microsoft\bitnet-b1.58-2B-4T-gguf\ggml-model-i2_s.gguf
Not sure how to load it. Do we need to use special parameters?
Ok, can't delete the post. This model cannot be used as it is. At least not directly, without effort.
wishinet
changed discussion status to
closed
Yes, I am also having trouble and getting the same error when trying to load the model into LMStudio:
🥲 Failed to load the model
Failed to load model
error loading model: llama_model_loader: failed to load model from C:\Users\amesm\.lmstudio\models\microsoft\bitnet-b1.58-2B-4T-gguf\ggml-model-i2_s.gguf
This comment has been hidden (marked as Resolved)