alibaba-pai

/

Wan2.2-VACE-Fun-A14B

like 81

Follow

Alibaba-PAI 1.04k

So for 2.2 VACE When can we expect a estimated release?
As Vace dont play good with multiple controlnets. request would be to do develop properly so it can highly be useable. Most production demand a 1080p or 1440p.

VACE have potential to take things to next level AI .

Multiple reference for larger smoother workflow is a long time request. atleast in steps to accomplish lot more with AI.
For just 1 image in a story of a scene which need to be super detailed high quality 1440p, 

here are the workflow i am thinking that if you can explore and discover solutions.

T & I workflow to VIdeo.

1. Take character ref [1,2](king character sheet & fighter character sheet), put them in an scene ref [3] (arena)
2. they are located at a certain position in the space ( inpaint inside arena). Blend it well.
3. both have a specific pose reference [4,5] ( king is in attacking position, fighter is blocking position)
4. while they both holding few things according to story ref [6,7] ( king have a specific sword he won , Fighter have specific shield)

5. While they are giving a facial expression of ref [vid 8, vid 9], (king is angry, fighter is inner turmoil to not fight king himself]
6. They are given Specific Movement reference full body ( Video ref 10)
7. they are given specific Acting video , emotion facial reference. Dialogues & lip sync ( Video ref 11)
8. They are given Video Ref Camera movement in the scene ( Vid ref 12) or text to Camera movement. 

to capture whole scene at once in multiple angle.
9. Reprocess final for face for clarity on going distance from camera, and high speed motion, blurry face and motion. Match Eyes lines when moving, looking and other. No dead expression.

references: Acting expression, movement Pre-possesor, Cloth details, Position details, 

instead of 2d based , make 3d based pre-processors which can object tracks multiple perfectly and inject data.
blending: Lights when all are migrated to scene, scene with physics of water, air, VACE black and white for specific object animation tagging would be great but also multiple targeted inject will speed things up . 

All need to blend perfectly. . this is help all the other Ai vid and fimmakers folks a lot. it will be less wastage and more Eco friendly & faster precise output ,time saved using AI.