gdhe17/Self-Forcing & Wan-AI/Wan2.1-VACE-1.3B Scopes Addon Experiment


โš ๏ธ Notice:
This project is intended for experimental use only.

CausVid/Self-Forcing is not natively supported in ComfyUI, proper sampling is not implemented.


This is an addon experiment of gdhe17/Self-Forcing and Wan-AI/Wan2.1-VACE-1.3B scopes.

The process involved extracting VACE scopes and injecting into the target models, using scripts provided by wsbagnsv1.

The FP16 model weights were then quantized to specific FP8 formats (E4M3FN and E5M2) using ComfyUI custom node ComfyUI-ModelQuantizer by lum3on.

LoRA extraction was done by subtracting and saving the weight differences using the ModelMergeSubtract node and the Extract and Save LoRA node in ComfyUI.

Usage

The model files can be used in ComfyUI with the WanVaceToVideo node. Place the required model(s) in the following folders:

Type Name Location Download
Main Model Wan2.1-T2V-1.3B-Self-Forcing-VACE ComfyUI/models/diffusion_models Safetensors (this repo)
Text Encoder umt5-xxl-encoder ComfyUI/models/text_encoders Safetensors / GGUF
VAE Wan2_1_VAE_bf16 ComfyUI/models/vae Safetensors

ComfyUI example workflow

Notes

All original licenses and restrictions from the base models still apply.

Reference

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support