Wan 2.2 Fun Questions

#9
by Grizly - opened

Hey Kijai, first off just want to say thinks for all your work for the community! :)
I just wanted to ask about the setup for Wan2.2 Fun...Since there are two KSamplers, high and low, I am not certain as to how to hook up a depth map into the mix. I tried a Wan Fun Control to Video node but it did not seem to work unless I turned up the strength...but doing that messed up the output.
Can you point me in the right direction or if there are any workflow examples for this?
Thanks very much!
(Here is my testing workflow for this)
image.png

+1 on this! As far as I can tell, no workflows have been uploaded anywhere for this.

I haven't tried it in native yet, the code needed changed to make it work in the wrapper and there is an example there at least.

Ahhh, found it! Thanks Kijai, will give it a try!

Here is the location for anyone else looking for it:
https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_Fun_2_2_control_example_01.json

I'm getting errors trying to run that workflow:

File "C:\ComfyUI\ComfyUI_cu128_50XX\ComfyUI\custom_nodes\ComfyUI-WanVideoWrapper\nodes_model_loading.py", line 866, in loadmodel
log.info(f"Model type: {model_type}, num_heads: {num_heads}, num_layers: {num_layers}")
^^^^^^^^^^
UnboundLocalError: cannot access local variable 'model_type' where it is not associated with a value

Any ideas?

I'm getting errors trying to run that workflow:

File "C:\ComfyUI\ComfyUI_cu128_50XX\ComfyUI\custom_nodes\ComfyUI-WanVideoWrapper\nodes_model_loading.py", line 866, in loadmodel
log.info(f"Model type: {model_type}, num_heads: {num_heads}, num_layers: {num_layers}")
^^^^^^^^^^
UnboundLocalError: cannot access local variable 'model_type' where it is not associated with a value

Any ideas?

The wrapper nodes need updating to allow loading it, that's the exact error you'd get with version before I added the support.

I'm getting some weird behaviour from it. I keep getting an OOM on the 2nd sampler. The 1st sampler runs just fine, but can't get past the 2nd. Seems weird to me, I assumed they should have the same memory usage. Is something not being unloaded correctly after the first one is done? I've tried the 'WanVideo VRAM Management' node as well, which I saw you recommend in another thread. Also no effect.

Regarding the quantization of Control-Camera, is it stored somewhere else or what is the situation?

Regarding the quantization of Control-Camera, is it stored somewhere else or what is the situation?

It is added now.

Regarding the quantization of Control-Camera, is it stored somewhere else or what is the situation?

It is added now.

Thank you~

Sign up or log in to comment