could not run in LM studio error

#1
by aleksey-6 - opened
🥲 Не удалось загрузить модель

Failed to load model

error loading model: missing tensor 'blk.9.ffn_norm.weight'

that's... very curious..

It's possible we need a version update to get it to work

lm studio - 0.3.16(buuild 1) + CUDA llama.cpp (Windows) v 1.29.0+ nvidia_Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L , does not work, if someone works, write what configuration.

@aleksey-6 beta engine v1.30.0 should have just added support if you can give that a try!

lm studio - 0.3.16(buuild 1) + CUDA llama.cpp (Windows) v 1.30.0+ nvidia_Llama-3_1-Nemotron-Ultra-253B-v1-Q2_K_L -----
started Thank you

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment