Spaces:
Running
on
Zero
Running
on
Zero
Update README.md
Browse files
README.md
CHANGED
@@ -4,11 +4,91 @@ emoji: ๐จ
|
|
4 |
colorFrom: purple
|
5 |
colorTo: yellow
|
6 |
sdk: gradio
|
7 |
-
sdk_version: 5.
|
8 |
app_file: app.py
|
9 |
pinned: false
|
10 |
license: apache-2.0
|
11 |
short_description: A Unified Framework for Custom Image and Video generation
|
12 |
---
|
13 |
|
14 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
colorFrom: purple
|
5 |
colorTo: yellow
|
6 |
sdk: gradio
|
7 |
+
sdk_version: 5.35.0
|
8 |
app_file: app.py
|
9 |
pinned: false
|
10 |
license: apache-2.0
|
11 |
short_description: A Unified Framework for Custom Image and Video generation
|
12 |
---
|
13 |
|
14 |
+
## English Description
|
15 |
+
|
16 |
+
**DreamO Video - AI-Powered Image and Video Generation**
|
17 |
+
|
18 |
+
DreamO Video is an advanced AI application that combines cutting-edge image generation with video synthesis capabilities. Built on the FLUX.1-dev model and enhanced with the DreamO pipeline, this tool allows users to create highly customized images and transform them into dynamic 2-second videos.
|
19 |
+
|
20 |
+
### Key Features:
|
21 |
+
|
22 |
+
1. **Dual Reference Image System**: Upload up to two reference images to guide the generation process, with flexible task options:
|
23 |
+
- **IP (Image Prompt)**: Use images as visual prompts to influence the overall composition
|
24 |
+
- **ID (Identity)**: Preserve facial features and identity from reference images
|
25 |
+
- **Style**: Transfer artistic style from reference images to generated content
|
26 |
+
|
27 |
+
2. **Advanced Image Generation**:
|
28 |
+
- Customizable resolution (768-1024 pixels)
|
29 |
+
- Fine-tuned guidance controls for precise output
|
30 |
+
- Seed-based generation for reproducible results
|
31 |
+
- Background removal and face alignment preprocessing
|
32 |
+
|
33 |
+
3. **Video Synthesis**: Transform any generated image into a 2-second animated video with natural motion and smooth transitions (Note: Full version supports up to 60-second videos)
|
34 |
+
|
35 |
+
4. **Professional Features**:
|
36 |
+
- Automatic watermarking for video outputs
|
37 |
+
- Advanced CFG (Classifier-Free Guidance) controls
|
38 |
+
- Negative prompting for refined results
|
39 |
+
- Gallery of preprocessing results for transparency
|
40 |
+
|
41 |
+
### Technical Specifications:
|
42 |
+
- Powered by FLUX.1-dev and DreamO pipeline
|
43 |
+
- GPU-accelerated processing using CUDA
|
44 |
+
- Integrated face restoration and background removal tools
|
45 |
+
- FFmpeg-based video post-processing
|
46 |
+
|
47 |
+
### Use Cases:
|
48 |
+
- Creative content generation for social media
|
49 |
+
- Character design and animation
|
50 |
+
- Product visualization and marketing materials
|
51 |
+
- Artistic style transfer and experimentation
|
52 |
+
- Personal avatar and portrait creation
|
53 |
+
|
54 |
+
---
|
55 |
+
|
56 |
+
## ํ๊ธ ์ค๋ช
|
57 |
+
|
58 |
+
**DreamO Video - AI ๊ธฐ๋ฐ ์ด๋ฏธ์ง ๋ฐ ๋น๋์ค ์์ฑ ๋๊ตฌ**
|
59 |
+
|
60 |
+
DreamO Video๋ ์ต์ฒจ๋จ ์ด๋ฏธ์ง ์์ฑ๊ณผ ๋น๋์ค ํฉ์ฑ ๊ธฐ๋ฅ์ ๊ฒฐํฉํ ๊ณ ๊ธ AI ์ ํ๋ฆฌ์ผ์ด์
์
๋๋ค. FLUX.1-dev ๋ชจ๋ธ์ ๊ธฐ๋ฐ์ผ๋ก ํ๊ณ DreamO ํ์ดํ๋ผ์ธ์ผ๋ก ๊ฐํ๋ ์ด ๋๊ตฌ๋ฅผ ํตํด ์ฌ์ฉ์๋ ๊ณ ๋๋ก ๋ง์ถคํ๋ ์ด๋ฏธ์ง๋ฅผ ์์ฑํ๊ณ ์ด๋ฅผ ์ญ๋์ ์ธ 2์ด ๋์์์ผ๋ก ๋ณํํ ์ ์์ต๋๋ค.
|
61 |
+
|
62 |
+
### ์ฃผ์ ๊ธฐ๋ฅ:
|
63 |
+
|
64 |
+
1. **์ด์ค ์ฐธ์กฐ ์ด๋ฏธ์ง ์์คํ
**: ์ต๋ 2๊ฐ์ ์ฐธ์กฐ ์ด๋ฏธ์ง๋ฅผ ์
๋ก๋ํ์ฌ ์์ฑ ๊ณผ์ ์ ์๋ดํ๋ฉฐ, ์ ์ฐํ ์์
์ต์
์ ๊ณต:
|
65 |
+
- **IP (์ด๋ฏธ์ง ํ๋กฌํํธ)**: ์ด๋ฏธ์ง๋ฅผ ์๊ฐ์ ํ๋กฌํํธ๋ก ์ฌ์ฉํ์ฌ ์ ์ฒด ๊ตฌ์ฑ์ ์ํฅ
|
66 |
+
- **ID (์ ์)**: ์ฐธ์กฐ ์ด๋ฏธ์ง์ ์ผ๊ตด ํน์ง๊ณผ ์ ์ ๋ณด์กด
|
67 |
+
- **Style (์คํ์ผ)**: ์ฐธ์กฐ ์ด๋ฏธ์ง์ ์์ ์ ์คํ์ผ์ ์์ฑ ์ฝํ
์ธ ๋ก ์ ์ก
|
68 |
+
|
69 |
+
2. **๊ณ ๊ธ ์ด๋ฏธ์ง ์์ฑ**:
|
70 |
+
- ์ฌ์ฉ์ ์ ์ ๊ฐ๋ฅํ ํด์๋ (768-1024 ํฝ์
)
|
71 |
+
- ์ ๋ฐํ ์ถ๋ ฅ์ ์ํ ๋ฏธ์ธ ์กฐ์ ๋ ๊ฐ์ด๋์ค ์ปจํธ๋กค
|
72 |
+
- ์ฌํ ๊ฐ๋ฅํ ๊ฒฐ๊ณผ๋ฅผ ์ํ ์๋ ๊ธฐ๋ฐ ์์ฑ
|
73 |
+
- ๋ฐฐ๊ฒฝ ์ ๊ฑฐ ๋ฐ ์ผ๊ตด ์ ๋ ฌ ์ ์ฒ๋ฆฌ
|
74 |
+
|
75 |
+
3. **๋น๋์ค ํฉ์ฑ**: ์์ฑ๋ ๋ชจ๋ ์ด๋ฏธ์ง๋ฅผ ์์ฐ์ค๋ฌ์ด ์์ง์๊ณผ ๋ถ๋๋ฌ์ด ์ ํ์ด ์๋ 2์ด ์ ๋๋ฉ์ด์
๋น๋์ค๋ก ๋ณํ (์ฐธ๊ณ : ์ ์ ๋ฒ์ ์ ์ต๋ 60์ด ๋น๋์ค ์ง์)
|
76 |
+
|
77 |
+
4. **์ ๋ฌธ ๊ธฐ๋ฅ**:
|
78 |
+
- ๋น๋์ค ์ถ๋ ฅ๋ฌผ์ ๋ํ ์๋ ์ํฐ๋งํน
|
79 |
+
- ๊ณ ๊ธ CFG (Classifier-Free Guidance) ์ปจํธ๋กค
|
80 |
+
- ์ ์ ๋ ๊ฒฐ๊ณผ๋ฅผ ์ํ ๋ค๊ฑฐํฐ๋ธ ํ๋กฌํํ
|
81 |
+
- ํฌ๋ช
์ฑ์ ์ํ ์ ์ฒ๋ฆฌ ๊ฒฐ๊ณผ ๊ฐค๋ฌ๋ฆฌ
|
82 |
+
|
83 |
+
### ๊ธฐ์ ์ฌ์:
|
84 |
+
- FLUX.1-dev ๋ฐ DreamO ํ์ดํ๋ผ์ธ ๊ตฌ๋
|
85 |
+
- CUDA๋ฅผ ์ฌ์ฉํ GPU ๊ฐ์ ์ฒ๋ฆฌ
|
86 |
+
- ํตํฉ๋ ์ผ๊ตด ๋ณต์ ๋ฐ ๋ฐฐ๊ฒฝ ์ ๊ฑฐ ๋๊ตฌ
|
87 |
+
- FFmpeg ๊ธฐ๋ฐ ๋น๋์ค ํ์ฒ๋ฆฌ
|
88 |
+
|
89 |
+
### ์ฌ์ฉ ์ฌ๋ก:
|
90 |
+
- ์์
๋ฏธ๋์ด๋ฅผ ์ํ ์ฐฝ์์ ์ธ ์ฝํ
์ธ ์์ฑ
|
91 |
+
- ์บ๋ฆญํฐ ๋์์ธ ๋ฐ ์ ๋๋ฉ์ด์
|
92 |
+
- ์ ํ ์๊ฐํ ๋ฐ ๋ง์ผํ
์๋ฃ
|
93 |
+
- ์์ ์ ์คํ์ผ ์ ์ก ๋ฐ ์คํ
|
94 |
+
- ๊ฐ์ธ ์๋ฐํ ๋ฐ ์ด์ํ ์ ์
|