renderartist commited on
Commit
3e8fc08
·
verified ·
0 Parent(s):

initial commit

Browse files
Files changed (2) hide show
  1. .gitattributes +55 -0
  2. README.md +105 -0
.gitattributes ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.lz4 filter=lfs diff=lfs merge=lfs -text
12
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
13
+ *.model filter=lfs diff=lfs merge=lfs -text
14
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
15
+ *.npy filter=lfs diff=lfs merge=lfs -text
16
+ *.npz filter=lfs diff=lfs merge=lfs -text
17
+ *.onnx filter=lfs diff=lfs merge=lfs -text
18
+ *.ot filter=lfs diff=lfs merge=lfs -text
19
+ *.parquet filter=lfs diff=lfs merge=lfs -text
20
+ *.pb filter=lfs diff=lfs merge=lfs -text
21
+ *.pickle filter=lfs diff=lfs merge=lfs -text
22
+ *.pkl filter=lfs diff=lfs merge=lfs -text
23
+ *.pt filter=lfs diff=lfs merge=lfs -text
24
+ *.pth filter=lfs diff=lfs merge=lfs -text
25
+ *.rar filter=lfs diff=lfs merge=lfs -text
26
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
27
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
29
+ *.tar filter=lfs diff=lfs merge=lfs -text
30
+ *.tflite filter=lfs diff=lfs merge=lfs -text
31
+ *.tgz filter=lfs diff=lfs merge=lfs -text
32
+ *.wasm filter=lfs diff=lfs merge=lfs -text
33
+ *.xz filter=lfs diff=lfs merge=lfs -text
34
+ *.zip filter=lfs diff=lfs merge=lfs -text
35
+ *.zst filter=lfs diff=lfs merge=lfs -text
36
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
37
+ # Audio files - uncompressed
38
+ *.pcm filter=lfs diff=lfs merge=lfs -text
39
+ *.sam filter=lfs diff=lfs merge=lfs -text
40
+ *.raw filter=lfs diff=lfs merge=lfs -text
41
+ # Audio files - compressed
42
+ *.aac filter=lfs diff=lfs merge=lfs -text
43
+ *.flac filter=lfs diff=lfs merge=lfs -text
44
+ *.mp3 filter=lfs diff=lfs merge=lfs -text
45
+ *.ogg filter=lfs diff=lfs merge=lfs -text
46
+ *.wav filter=lfs diff=lfs merge=lfs -text
47
+ # Image files - uncompressed
48
+ *.bmp filter=lfs diff=lfs merge=lfs -text
49
+ *.gif filter=lfs diff=lfs merge=lfs -text
50
+ *.png filter=lfs diff=lfs merge=lfs -text
51
+ *.tiff filter=lfs diff=lfs merge=lfs -text
52
+ # Image files - compressed
53
+ *.jpg filter=lfs diff=lfs merge=lfs -text
54
+ *.jpeg filter=lfs diff=lfs merge=lfs -text
55
+ *.webp filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,105 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - text-to-image
4
+ - lora
5
+ - diffusers
6
+ - template:diffusion-lora
7
+ widget:
8
+ - text: '-'
9
+ output:
10
+ url: images/Coloring_Book_00001_.png
11
+ - text: '-'
12
+ output:
13
+ url: images/Coloring_Book_00002_.png
14
+ - text: '-'
15
+ output:
16
+ url: images/Coloring_Book_00004_.png
17
+ - text: '-'
18
+ output:
19
+ url: images/Coloring_Book_00011_.png
20
+ - text: '-'
21
+ output:
22
+ url: images/Coloring_Book_00013_.png
23
+ - text: '-'
24
+ output:
25
+ url: images/Coloring_Book_00026_.png
26
+ - text: '-'
27
+ output:
28
+ url: images/Coloring_Book_00028_.png
29
+ - text: '-'
30
+ output:
31
+ url: images/Coloring_Book_00032_.png
32
+ - text: '-'
33
+ output:
34
+ url: images/Coloring_Book_00036_.png
35
+ - text: '-'
36
+ output:
37
+ url: images/Coloring_Book_00045_.png
38
+ - text: '-'
39
+ output:
40
+ url: images/Coloring_Book_00046_.png
41
+ - text: '-'
42
+ output:
43
+ url: images/Coloring_Book_00049_.png
44
+ - text: '-'
45
+ output:
46
+ url: images/Coloring_Book_00055_.png
47
+ - text: '-'
48
+ output:
49
+ url: images/Coloring_Book_00058_.png
50
+ - text: '-'
51
+ output:
52
+ url: images/Coloring_Book_00079_.png
53
+ - text: '-'
54
+ output:
55
+ url: images/Coloring_Book_00084_.png
56
+ - text: '-'
57
+ output:
58
+ url: images/Coloring_Book_00098_.png
59
+ - text: '-'
60
+ output:
61
+ url: images/Coloring_Book_00101_.png
62
+ base_model: HiDream-ai/HiDream-I1-Full
63
+ instance_prompt: c0l0ringb00k, coloring book
64
+ license: apache-2.0
65
+ ---
66
+ # Coloring Book HiDream
67
+
68
+ <Gallery />
69
+
70
+ ## Model description
71
+
72
+ This HiDream LoRA is Lycoris based and produces great line art styles similar to coloring books. I found the results to be much stronger than my Coloring Book Flux LoRA. Hope this helps exemplify the quality that can be achieved with this awesome model. This is a huge win for open source as the HiDream base models are released under the MIT license.
73
+
74
+ I recommend using LCM sampler with the simple scheduler, for some reason using other samplers resulted in hallucinations that affected quality when LoRAs are utilized. Some of the images in the gallery will have prompt examples.
75
+
76
+ Trigger words: c0l0ringb00k, coloring book
77
+
78
+ Recommended Sampler: LCM
79
+
80
+ Recommended Scheduler: SIMPLE
81
+
82
+ This model was trained to 2000 steps, 2 repeats with a learning rate of 4e-4 trained with Simple Tuner using the main branch. The dataset was around 90 synthetic images in total. All of the images used were 1:1 aspect ratio at 1024x1024 to fit into VRAM.
83
+
84
+ Training took around 3 hours using an RTX 4090 with 24GB VRAM, training times are on par with Flux LoRA training. Captioning was done using Joy Caption Batch with modified instructions and a token limit of 128 tokens (more than that gets truncated during training).
85
+
86
+ The resulting LoRA can produce some really great coloring book styles with either simple designs or more intricate designs based on prompts. I&#39;m not here to troubleshoot installation issues or field endless questions, each environment is completely different.
87
+
88
+ I trained the model with Full and ran inference in ComfyUI using the Dev model, it is said that this is the best strategy to get high quality outputs.
89
+
90
+ Testing and training takes a lot of time and personal resources. If you can afford it please contribute to my KoFi (https:&#x2F;&#x2F;ko-fi.com&#x2F;renderartist) – Contributing will allow me more flexibility to train in the cloud and continue experimenting and sharing better.
91
+
92
+ renderartist.com
93
+
94
+ ## Trigger words
95
+
96
+ You should use `c0l0ringb00k` to trigger the image generation.
97
+
98
+ You should use `coloring book` to trigger the image generation.
99
+
100
+
101
+ ## Download model
102
+
103
+ Weights for this model are available in Safetensors format.
104
+
105
+ [Download](/renderartist/coloringbookhidream/tree/main) them in the Files & versions tab.