bad motion

#5
by dan5 - opened

Thanks for this release but the new lightning lora kills the motion and is worse than than the one from wan 2.1.

Original, without lora (50 steps):

With lora (8 steps):

dan5 changed discussion title from bad quality to bad motion

Have the same issue. On the high noise I can use wan 2.1 lightx2v version and it gives so much better motion and understanding of the scene overall.. Using the new 2.2 on the high noise is just totally broken. Maybe we are missing something. Like a sampler setting.. I don't know. he :D

Did u generate T2V or I2V?

try 0.125 for the intensity of the lora

I found a temporary fix β€” use the new WAN 2.2 lightx2v LoRA model, set the lora strength to around 0.6–0.8 on high model and 1 on low model, CFG to about 2–3.5 on high model, cfg 1 on low model. Use 8 steps (4 high + 4 low). This setup gives noticeably better motion.

Hi, we have updated README for the T2V-4step model, https://huggingface.co/lightx2v/Wan2.2-Lightning/blob/main/Wan2.2-T2V-A14B-4steps-lora-rank64-Seko-V1/README.md.

Please use Euler scheduler with shift = 5, and inference with CFG=1, steps=4.

If you have 80GB-GPU, please try to follow https://github.com/ModelTC/Wan2.2-Lightning to reproduce the results in the demo.

new lora models give me blurry not finished output. shift =5, strength on both loras =1 , euler and 4 steps each sampler. cfgs = 1. the result is very blurry

Is there any documentation on the settings in ComfyUI

@SDuser23487 Please try the ComfyUI workflow provided in https://github.com/ModelTC/Wan2.2-Lightning/issues/3

I did some testing. It just ignores most motions, it is almost like a "live wallpaper" ... cool if you want to maake one, not if you want motion XD

For T2V old lightxv2 covers motion better also prompt inherence and realism. Set 0.65-0.8 for high and 1.0 for low using dpmpp_2m simple

Thanks for this release but the new lightning lora kills the motion and is worse than than the one from wan 2.1.

Original, without lora (50 steps):

With lora (8 steps):

cool video, can you get a prompt?

Thanks for this release but the new lightning lora kills the motion and is worse than than the one from wan 2.1.

Original, without lora (50 steps):

With lora (8 steps):

3 sampler is the solution, pls check!! https://huggingface.co/lightx2v/Wan2.2-Lightning/discussions/20#6897529022ebf7a1e53df7c7

Sign up or log in to comment