drnighthan's picture
Update README.md
93c49f3 verified
metadata
base_model:
  - Wan-AI/Wan2.2-I2V-A14B
tags:
  - Image-to-Video
  - lora
widget:
  - text: >-
      "Product Consistency. Used the product in the first frame, generate a
      commercial-quality video of the product. The product is a bottled
      drink.The product is floating and silghtly rotating in the air in the warm
      green background and the forest. Surrounding the product is many tea
      leaves."
    output:
      url: >-
        assets/wan22-tool3-ProductConsistency-16-8-NoH-000080.safetensors_00031.mp4
  - text: >-
      "Product Consistency. Used the product in the first frame, generate a
      commercial-quality video of the product. The product is a canned drink.The
      product is floating in the air in the dark with some neon green light
      shineing. Suddenly the product is grabed by a huge monster hand. The
      overall atomsphere is dark and cyberpunk."
    output:
      url: >-
        assets/wan22-tool3-ProductConsistency-16-8-NoH-000080.safetensors_00022.mp4
  - text: >-
      "Product Consistency. Used the product in the first frame, generate a
      commercial-quality video of the product. The product is a box of
      chocolate.The product is emerging from a brown creamy liquid chocolate
      river."
    output:
      url: >-
        assets/wan22-tool3-ProductConsistency-16-8-NoH-000080.safetensors_00033.mp4

ProductConsistency-Wan2.2-I2V

Prompt
"Product Consistency. Used the product in the first frame, generate a commercial-quality video of the product. The product is a bottled drink.The product is floating and silghtly rotating in the air in the warm green background and the forest. Surrounding the product is many tea leaves."
Prompt
"Product Consistency. Used the product in the first frame, generate a commercial-quality video of the product. The product is a canned drink.The product is floating in the air in the dark with some neon green light shineing. Suddenly the product is grabed by a huge monster hand. The overall atomsphere is dark and cyberpunk."
Prompt
"Product Consistency. Used the product in the first frame, generate a commercial-quality video of the product. The product is a box of chocolate.The product is emerging from a brown creamy liquid chocolate river."

Description:

"ProductConsistency is the third model in this series. The model is designed to generate product videos directly from a product image with a white background, using a text prompt.From my personal testing (recommended strength: high 0.9, low 0.9, lightning low: 1.0), the performance of ProductConsistency is quite good when using a well-written prompt and accelerating with the 'lightning low' LoRA.However, compared to the two Consistency models I previously released, CarConsistency and ClothConsistency, its ability to follow prompts for advertising scenarios is just average. This might be due to less training data in Wan2.2. A certain degree of Prompt Engineering is required to achieve better results. It's also worth noting that it's not recommended to write prompts about the product subject itself (as this can easily cause subject consistency issues). Instead, in the examples, I will specify the product's category (which helps the T5 model better understand the product's actual shape and generate more vivid results), for instance: "The product is a canned drink/a box of chocolate/a bottle of perfume..."Another thing is that because there is no human in the training dataset, so it is not sure for generating the product video with human.A Sample Prompt,for more,please check the info of the video: "Product Consistency. Used the product in the first frame, generate a commercial-quality video of the product. The product is a canned drink.The product is floating in the air in the dark with some neon green light shineing. Suddenly the product is grabed by a huge monster hand. The overall atomsphere is dark and cyberpunk."