File size: 2,965 Bytes
98c9eb6
 
 
 
 
 
bda45f9
98c9eb6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3858c2d
8bc9ab8
 
 
 
 
 
 
 
 
98c9eb6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
---
tags:
- text-to-image
- lora
- diffusers
- template:diffusion-lora

base_model: black-forest-labs/FLUX.1-Kontext-dev
instance_prompt: null
license: apache-2.0
---

## Model description 

license: apache-2.0
base_model:
- black-forest-labs/FLUX.1-Kontext-dev
pipeline_tag: image-to-image
---

# RefControl Flux Kontext – Reference Lineart LoRA

## πŸ“ Short description
A LoRA for **Flux Kontext Dev** that fuses a **reference image** (left) with a **lineart map** (right).  
It preserves **identity and style** from the reference while following the **lines and contours** from the control.

**Trigger word:** `refcontrollineart`

[Demo video](https://www.youtube.com/watch?v=M-aCCbmt93I)

| Reference | Result |
|-----------|--------|
| ![ref1](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/resolve/main/examples/1a.png) | ![res1](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/resolve/main/examples/1b.png) |
| ![ref2](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/resolve/main/examples/2a.png) | ![res2](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/resolve/main/examples/2b.png) |
| ![ref3](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/resolve/main/examples/3a.png) | ![res3](https://huggingface.co/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/resolve/main/examples/3b.png) |

---

## πŸ“– Extended description
This LoRA was primarily trained on **human characters and objects**, but it works well with stylized art too.  
The main goal is to **preserve identity** β€” facial features, clothing, or style β€” from the **reference image**, while adapting them to the **structure given by the lineart map**.

---

## βš™οΈ How to use
1. Concatenate two images side by side:  
   - **Left:** reference image (person, character, or object).  
   - **Right:** lineart map (black & white contour drawing).  
2. Add the trigger word `refcontrollineart` in your prompt.  
3. Adjust LoRA weight (recommended **0.7–1.0**).  

### βœ… Example prompt
refcontrolcanny, change ineart to photo with reference from left

---

## 🎯 What it does
- Preserves **identity and style** of the reference.  
- Uses **lineart** to control outlines, proportions, and composition.  
- Works for both **realistic** and **stylized** generations.  

---

## ⚑ Tips
- Best results when the lineart map is **clear and clean** (minimal shading).  
---

## πŸ“Œ Use cases
- Converting sketches to full artworks while keeping reference identity.  
- Character redraws in different art styles.  
- Consistent character design across multiple illustrations.  
- Turning **lineart drafts** into photorealistic or stylized renders.  

---


## Download model


[Download](/thedeoxen/refcontrol-flux-kontext-reference-lineart-lora/tree/main) them in the Files & versions tab.