Nap's picture
Update README.md
af608a9 verified

Qwen2VL-Flux was released a while ago. It comes with a standalone ControlNet model that works with Flux Dev. Fully compatible with ComfyUI.

I works well with Depth and Canny and kinda works with Tile and Realistic Lineart. You can also combine Depth and Canny.

Usually works well with strength 0.6-0.8 depending on the image. You might need to run Flux at FP8 to avoid OOM.

There's a sample workflow in this repo that you can try on ComfyUI.

The original project can be found here:

https://huggingface.co/Djrango/Qwen2vl-Flux

The model in my repo is simply the weights from https://huggingface.co/Djrango/Qwen2vl-Flux/tree/main/controlnet

All credit belongs to the original creator of the model Pengqi Lu.


license: other license_name: flux-1-dev-non-commercial-license license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md