Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,94 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model:
|
| 4 |
+
- black-forest-labs/FLUX.1-Kontext-dev
|
| 5 |
+
pipeline_tag: text-to-image
|
| 6 |
+
tags:
|
| 7 |
+
- flux
|
| 8 |
+
- kontext
|
| 9 |
+
- img2img
|
| 10 |
+
- controlnet
|
| 11 |
+
- flux-kontext
|
| 12 |
+
- image
|
| 13 |
+
- editing
|
| 14 |
+
- lora
|
| 15 |
+
---
|
| 16 |
+
license: apache-2.0
|
| 17 |
+
base_model:
|
| 18 |
+
- black-forest-labs/FLUX.1-Kontext-dev
|
| 19 |
+
pipeline_tag: image-to-image
|
| 20 |
+
---
|
| 21 |
+
|
| 22 |
+
# RefControl Flux Kontext β Reference Pose LoRA
|
| 23 |
+
|
| 24 |
+
## π Short description
|
| 25 |
+
A LoRA for **Flux Kontext Dev** that fuses a **reference image** (left) with a **pose control map** (right).
|
| 26 |
+
It preserves **identity and style** from the reference while following the **pose and body structure** from the control.
|
| 27 |
+
|
| 28 |
+
**Trigger word:** `refcontrolpose`
|
| 29 |
+
---
|
| 30 |
+
## π₯ Demo Video
|
| 31 |
+
|
| 32 |
+
[Demo Video] https://youtu.be/8eTjC7InE44
|
| 33 |
+
---
|
| 34 |
+
## π Examples
|
| 35 |
+
|
| 36 |
+
| Input | Oupttut |
|
| 37 |
+
|-----------|--------|
|
| 38 |
+
|  |  |
|
| 39 |
+
|  |  |
|
| 40 |
+
|  |  |
|
| 41 |
+
|  |  |
|
| 42 |
+
|  |  |
|
| 43 |
+
|
| 44 |
+
---
|
| 45 |
+
|
| 46 |
+
## π Extended description
|
| 47 |
+
This LoRA was primarily trained on **humans**, but it can also be applied to stylized characters and some objects.
|
| 48 |
+
Its main goal is to **transfer identity** β facial features, hairstyle, clothing, or object details β from the **reference image**, while adapting them to the **pose and skeleton structure** defined by the control map.
|
| 49 |
+
|
| 50 |
+
---
|
| 51 |
+
|
| 52 |
+
## βοΈ How to use
|
| 53 |
+
1. Concatenate two images side by side:
|
| 54 |
+
- **Left:** reference image (character, person, or object).
|
| 55 |
+
- **Right:** pose control map (skeleton, keypoints).
|
| 56 |
+
2. Add the trigger word `refcontrolpose` in your prompt.
|
| 57 |
+
3. Adjust LoRA weight (recommended **0.8β1.0**) depending on how strongly you want to preserve identity.
|
| 58 |
+
|
| 59 |
+
|
| 60 |
+
Worklow:
|
| 61 |
+
|
| 62 |
+
for workflow you need to install in ComfyUI:
|
| 63 |
+
[comfyui_controlnet_aux](https://github.com/Fannovel16/comfyui_controlnet_aux)
|
| 64 |
+
[comfyui-kjnodes] (https://github.com/kijai/ComfyUI-KJNodes)
|
| 65 |
+
|
| 66 |
+
|
| 67 |
+
### β
Example prompt
|
| 68 |
+
|
| 69 |
+
refcontrolpose change pose to photo with reference from left side
|
| 70 |
+
|
| 71 |
+
---
|
| 72 |
+
|
| 73 |
+
## π― What it does
|
| 74 |
+
- Preserves **character identity** across generations.
|
| 75 |
+
- Adapts the subject to a **new pose or action**.
|
| 76 |
+
- Works well for **character consistency** in sequential generations.
|
| 77 |
+
|
| 78 |
+
---
|
| 79 |
+
|
| 80 |
+
## β‘ Tips
|
| 81 |
+
- Best results when the pose map has **similar proportions** to the reference image.
|
| 82 |
+
- Combine with **text prompts** to refine background or mood.
|
| 83 |
+
- Can be chained with other RefControl LoRAs (depth, lineart, canny) for **multi-constraint generation**.
|
| 84 |
+
|
| 85 |
+
---
|
| 86 |
+
|
| 87 |
+
## π Use cases
|
| 88 |
+
- Character posing for illustrations, comics, or storyboards.
|
| 89 |
+
- Consistent **character design** across different poses.
|
| 90 |
+
- Re-posing **stylized characters** while keeping their identity.
|
| 91 |
+
- Creating **animation keyframes** from static references.
|
| 92 |
+
|
| 93 |
+
---
|
| 94 |
+
|