Commit
·
3e8fc08
verified
·
0
Parent(s):
initial commit
Browse files- .gitattributes +55 -0
- README.md +105 -0
.gitattributes
ADDED
@@ -0,0 +1,55 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.lz4 filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
26 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
27 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
36 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
37 |
+
# Audio files - uncompressed
|
38 |
+
*.pcm filter=lfs diff=lfs merge=lfs -text
|
39 |
+
*.sam filter=lfs diff=lfs merge=lfs -text
|
40 |
+
*.raw filter=lfs diff=lfs merge=lfs -text
|
41 |
+
# Audio files - compressed
|
42 |
+
*.aac filter=lfs diff=lfs merge=lfs -text
|
43 |
+
*.flac filter=lfs diff=lfs merge=lfs -text
|
44 |
+
*.mp3 filter=lfs diff=lfs merge=lfs -text
|
45 |
+
*.ogg filter=lfs diff=lfs merge=lfs -text
|
46 |
+
*.wav filter=lfs diff=lfs merge=lfs -text
|
47 |
+
# Image files - uncompressed
|
48 |
+
*.bmp filter=lfs diff=lfs merge=lfs -text
|
49 |
+
*.gif filter=lfs diff=lfs merge=lfs -text
|
50 |
+
*.png filter=lfs diff=lfs merge=lfs -text
|
51 |
+
*.tiff filter=lfs diff=lfs merge=lfs -text
|
52 |
+
# Image files - compressed
|
53 |
+
*.jpg filter=lfs diff=lfs merge=lfs -text
|
54 |
+
*.jpeg filter=lfs diff=lfs merge=lfs -text
|
55 |
+
*.webp filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,105 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- text-to-image
|
4 |
+
- lora
|
5 |
+
- diffusers
|
6 |
+
- template:diffusion-lora
|
7 |
+
widget:
|
8 |
+
- text: '-'
|
9 |
+
output:
|
10 |
+
url: images/Coloring_Book_00001_.png
|
11 |
+
- text: '-'
|
12 |
+
output:
|
13 |
+
url: images/Coloring_Book_00002_.png
|
14 |
+
- text: '-'
|
15 |
+
output:
|
16 |
+
url: images/Coloring_Book_00004_.png
|
17 |
+
- text: '-'
|
18 |
+
output:
|
19 |
+
url: images/Coloring_Book_00011_.png
|
20 |
+
- text: '-'
|
21 |
+
output:
|
22 |
+
url: images/Coloring_Book_00013_.png
|
23 |
+
- text: '-'
|
24 |
+
output:
|
25 |
+
url: images/Coloring_Book_00026_.png
|
26 |
+
- text: '-'
|
27 |
+
output:
|
28 |
+
url: images/Coloring_Book_00028_.png
|
29 |
+
- text: '-'
|
30 |
+
output:
|
31 |
+
url: images/Coloring_Book_00032_.png
|
32 |
+
- text: '-'
|
33 |
+
output:
|
34 |
+
url: images/Coloring_Book_00036_.png
|
35 |
+
- text: '-'
|
36 |
+
output:
|
37 |
+
url: images/Coloring_Book_00045_.png
|
38 |
+
- text: '-'
|
39 |
+
output:
|
40 |
+
url: images/Coloring_Book_00046_.png
|
41 |
+
- text: '-'
|
42 |
+
output:
|
43 |
+
url: images/Coloring_Book_00049_.png
|
44 |
+
- text: '-'
|
45 |
+
output:
|
46 |
+
url: images/Coloring_Book_00055_.png
|
47 |
+
- text: '-'
|
48 |
+
output:
|
49 |
+
url: images/Coloring_Book_00058_.png
|
50 |
+
- text: '-'
|
51 |
+
output:
|
52 |
+
url: images/Coloring_Book_00079_.png
|
53 |
+
- text: '-'
|
54 |
+
output:
|
55 |
+
url: images/Coloring_Book_00084_.png
|
56 |
+
- text: '-'
|
57 |
+
output:
|
58 |
+
url: images/Coloring_Book_00098_.png
|
59 |
+
- text: '-'
|
60 |
+
output:
|
61 |
+
url: images/Coloring_Book_00101_.png
|
62 |
+
base_model: HiDream-ai/HiDream-I1-Full
|
63 |
+
instance_prompt: c0l0ringb00k, coloring book
|
64 |
+
license: apache-2.0
|
65 |
+
---
|
66 |
+
# Coloring Book HiDream
|
67 |
+
|
68 |
+
<Gallery />
|
69 |
+
|
70 |
+
## Model description
|
71 |
+
|
72 |
+
This HiDream LoRA is Lycoris based and produces great line art styles similar to coloring books. I found the results to be much stronger than my Coloring Book Flux LoRA. Hope this helps exemplify the quality that can be achieved with this awesome model. This is a huge win for open source as the HiDream base models are released under the MIT license.
|
73 |
+
|
74 |
+
I recommend using LCM sampler with the simple scheduler, for some reason using other samplers resulted in hallucinations that affected quality when LoRAs are utilized. Some of the images in the gallery will have prompt examples.
|
75 |
+
|
76 |
+
Trigger words: c0l0ringb00k, coloring book
|
77 |
+
|
78 |
+
Recommended Sampler: LCM
|
79 |
+
|
80 |
+
Recommended Scheduler: SIMPLE
|
81 |
+
|
82 |
+
This model was trained to 2000 steps, 2 repeats with a learning rate of 4e-4 trained with Simple Tuner using the main branch. The dataset was around 90 synthetic images in total. All of the images used were 1:1 aspect ratio at 1024x1024 to fit into VRAM.
|
83 |
+
|
84 |
+
Training took around 3 hours using an RTX 4090 with 24GB VRAM, training times are on par with Flux LoRA training. Captioning was done using Joy Caption Batch with modified instructions and a token limit of 128 tokens (more than that gets truncated during training).
|
85 |
+
|
86 |
+
The resulting LoRA can produce some really great coloring book styles with either simple designs or more intricate designs based on prompts. I'm not here to troubleshoot installation issues or field endless questions, each environment is completely different.
|
87 |
+
|
88 |
+
I trained the model with Full and ran inference in ComfyUI using the Dev model, it is said that this is the best strategy to get high quality outputs.
|
89 |
+
|
90 |
+
Testing and training takes a lot of time and personal resources. If you can afford it please contribute to my KoFi (https://ko-fi.com/renderartist) – Contributing will allow me more flexibility to train in the cloud and continue experimenting and sharing better.
|
91 |
+
|
92 |
+
renderartist.com
|
93 |
+
|
94 |
+
## Trigger words
|
95 |
+
|
96 |
+
You should use `c0l0ringb00k` to trigger the image generation.
|
97 |
+
|
98 |
+
You should use `coloring book` to trigger the image generation.
|
99 |
+
|
100 |
+
|
101 |
+
## Download model
|
102 |
+
|
103 |
+
Weights for this model are available in Safetensors format.
|
104 |
+
|
105 |
+
[Download](/renderartist/coloringbookhidream/tree/main) them in the Files & versions tab.
|