Is it possible to train it on a single 3090 using LoRA on PEFT?

#66

by boskx - opened 2 days ago

2 days ago

I want to train Phi3 Vision on my 3090 ti gpu, but configuring PEFT training with LoRA it goes in out of memory. Has anyone achieved to train on a single 3090 gpu?

Thanks

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment