VRAM?

#11
by Loyallyon - opened

How much VRAM do I need?

How much VRAM do I need?

my 5090 with 32gb is not enough without optimizations. it using 31.5gb vram and around 4-5gb RAM. in this case generation take about 3h lol. but with cpu offloading or fp8/quantization i think 20 gb vram should be enough. maybe even less

Sign up or log in to comment