Are the new loras (pdmd, dmad) pruned model compatible?

#55
by Phodira - opened

My tests with pdmd on the int8 pruned model showed substandard quality and generated some visual artifacts. So i guess they are for the unpruned model?

What's a good technical way to inspect the lora to answer this question?

dmad works well with the pruned model, and it's looking great too.

Neither has any weights touching the unpruned weights, so technically it should work the same with pruned model.

Sign up or log in to comment