Any way to apply your fine-tune on top of original weights?

#2
by Whatever76474758585 - opened

Can you provide a way to just adjust the original weights without downloading the whole model? Like lora or something? It was quite a big download of the base model, and if I want to test a few different fine-tunes both my HDD and ISP will explode...

Yeah, the LoRA/QLoRA would help a lot - all these massive models dropping in the last week and having to download 250GB+ just to try them :/

Sign up or log in to comment