openfree commited on
Commit
2010fa1
ยท
verified ยท
1 Parent(s): 412319f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +82 -2
README.md CHANGED
@@ -4,11 +4,91 @@ emoji: ๐Ÿจ
4
  colorFrom: purple
5
  colorTo: yellow
6
  sdk: gradio
7
- sdk_version: 5.30.0
8
  app_file: app.py
9
  pinned: false
10
  license: apache-2.0
11
  short_description: A Unified Framework for Custom Image and Video generation
12
  ---
13
 
14
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  colorFrom: purple
5
  colorTo: yellow
6
  sdk: gradio
7
+ sdk_version: 5.35.0
8
  app_file: app.py
9
  pinned: false
10
  license: apache-2.0
11
  short_description: A Unified Framework for Custom Image and Video generation
12
  ---
13
 
14
+ ## English Description
15
+
16
+ **DreamO Video - AI-Powered Image and Video Generation**
17
+
18
+ DreamO Video is an advanced AI application that combines cutting-edge image generation with video synthesis capabilities. Built on the FLUX.1-dev model and enhanced with the DreamO pipeline, this tool allows users to create highly customized images and transform them into dynamic 2-second videos.
19
+
20
+ ### Key Features:
21
+
22
+ 1. **Dual Reference Image System**: Upload up to two reference images to guide the generation process, with flexible task options:
23
+ - **IP (Image Prompt)**: Use images as visual prompts to influence the overall composition
24
+ - **ID (Identity)**: Preserve facial features and identity from reference images
25
+ - **Style**: Transfer artistic style from reference images to generated content
26
+
27
+ 2. **Advanced Image Generation**:
28
+ - Customizable resolution (768-1024 pixels)
29
+ - Fine-tuned guidance controls for precise output
30
+ - Seed-based generation for reproducible results
31
+ - Background removal and face alignment preprocessing
32
+
33
+ 3. **Video Synthesis**: Transform any generated image into a 2-second animated video with natural motion and smooth transitions (Note: Full version supports up to 60-second videos)
34
+
35
+ 4. **Professional Features**:
36
+ - Automatic watermarking for video outputs
37
+ - Advanced CFG (Classifier-Free Guidance) controls
38
+ - Negative prompting for refined results
39
+ - Gallery of preprocessing results for transparency
40
+
41
+ ### Technical Specifications:
42
+ - Powered by FLUX.1-dev and DreamO pipeline
43
+ - GPU-accelerated processing using CUDA
44
+ - Integrated face restoration and background removal tools
45
+ - FFmpeg-based video post-processing
46
+
47
+ ### Use Cases:
48
+ - Creative content generation for social media
49
+ - Character design and animation
50
+ - Product visualization and marketing materials
51
+ - Artistic style transfer and experimentation
52
+ - Personal avatar and portrait creation
53
+
54
+ ---
55
+
56
+ ## ํ•œ๊ธ€ ์„ค๋ช…
57
+
58
+ **DreamO Video - AI ๊ธฐ๋ฐ˜ ์ด๋ฏธ์ง€ ๋ฐ ๋น„๋””์˜ค ์ƒ์„ฑ ๋„๊ตฌ**
59
+
60
+ DreamO Video๋Š” ์ตœ์ฒจ๋‹จ ์ด๋ฏธ์ง€ ์ƒ์„ฑ๊ณผ ๋น„๋””์˜ค ํ•ฉ์„ฑ ๊ธฐ๋Šฅ์„ ๊ฒฐํ•ฉํ•œ ๊ณ ๊ธ‰ AI ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์ž…๋‹ˆ๋‹ค. FLUX.1-dev ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•˜๊ณ  DreamO ํŒŒ์ดํ”„๋ผ์ธ์œผ๋กœ ๊ฐ•ํ™”๋œ ์ด ๋„๊ตฌ๋ฅผ ํ†ตํ•ด ์‚ฌ์šฉ์ž๋Š” ๊ณ ๋„๋กœ ๋งž์ถคํ™”๋œ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•˜๊ณ  ์ด๋ฅผ ์—ญ๋™์ ์ธ 2์ดˆ ๋™์˜์ƒ์œผ๋กœ ๋ณ€ํ™˜ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
61
+
62
+ ### ์ฃผ์š” ๊ธฐ๋Šฅ:
63
+
64
+ 1. **์ด์ค‘ ์ฐธ์กฐ ์ด๋ฏธ์ง€ ์‹œ์Šคํ…œ**: ์ตœ๋Œ€ 2๊ฐœ์˜ ์ฐธ์กฐ ์ด๋ฏธ์ง€๋ฅผ ์—…๋กœ๋“œํ•˜์—ฌ ์ƒ์„ฑ ๊ณผ์ •์„ ์•ˆ๋‚ดํ•˜๋ฉฐ, ์œ ์—ฐํ•œ ์ž‘์—… ์˜ต์…˜ ์ œ๊ณต:
65
+ - **IP (์ด๋ฏธ์ง€ ํ”„๋กฌํ”„ํŠธ)**: ์ด๋ฏธ์ง€๋ฅผ ์‹œ๊ฐ์  ํ”„๋กฌํ”„ํŠธ๋กœ ์‚ฌ์šฉํ•˜์—ฌ ์ „์ฒด ๊ตฌ์„ฑ์— ์˜ํ–ฅ
66
+ - **ID (์‹ ์›)**: ์ฐธ์กฐ ์ด๋ฏธ์ง€์˜ ์–ผ๊ตด ํŠน์ง•๊ณผ ์‹ ์› ๋ณด์กด
67
+ - **Style (์Šคํƒ€์ผ)**: ์ฐธ์กฐ ์ด๋ฏธ์ง€์˜ ์˜ˆ์ˆ ์  ์Šคํƒ€์ผ์„ ์ƒ์„ฑ ์ฝ˜ํ…์ธ ๋กœ ์ „์†ก
68
+
69
+ 2. **๊ณ ๊ธ‰ ์ด๋ฏธ์ง€ ์ƒ์„ฑ**:
70
+ - ์‚ฌ์šฉ์ž ์ •์˜ ๊ฐ€๋Šฅํ•œ ํ•ด์ƒ๋„ (768-1024 ํ”ฝ์…€)
71
+ - ์ •๋ฐ€ํ•œ ์ถœ๋ ฅ์„ ์œ„ํ•œ ๋ฏธ์„ธ ์กฐ์ •๋œ ๊ฐ€์ด๋˜์Šค ์ปจํŠธ๋กค
72
+ - ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ๊ฒฐ๊ณผ๋ฅผ ์œ„ํ•œ ์‹œ๋“œ ๊ธฐ๋ฐ˜ ์ƒ์„ฑ
73
+ - ๋ฐฐ๊ฒฝ ์ œ๊ฑฐ ๋ฐ ์–ผ๊ตด ์ •๋ ฌ ์ „์ฒ˜๋ฆฌ
74
+
75
+ 3. **๋น„๋””์˜ค ํ•ฉ์„ฑ**: ์ƒ์„ฑ๋œ ๋ชจ๋“  ์ด๋ฏธ์ง€๋ฅผ ์ž์—ฐ์Šค๋Ÿฌ์šด ์›€์ง์ž„๊ณผ ๋ถ€๋“œ๋Ÿฌ์šด ์ „ํ™˜์ด ์žˆ๋Š” 2์ดˆ ์• ๋‹ˆ๋ฉ”์ด์…˜ ๋น„๋””์˜ค๋กœ ๋ณ€ํ™˜ (์ฐธ๊ณ : ์ •์‹ ๋ฒ„์ „์€ ์ตœ๋Œ€ 60์ดˆ ๋น„๋””์˜ค ์ง€์›)
76
+
77
+ 4. **์ „๋ฌธ ๊ธฐ๋Šฅ**:
78
+ - ๋น„๋””์˜ค ์ถœ๋ ฅ๋ฌผ์— ๋Œ€ํ•œ ์ž๋™ ์›Œํ„ฐ๋งˆํ‚น
79
+ - ๊ณ ๊ธ‰ CFG (Classifier-Free Guidance) ์ปจํŠธ๋กค
80
+ - ์ •์ œ๋œ ๊ฒฐ๊ณผ๋ฅผ ์œ„ํ•œ ๋„ค๊ฑฐํ‹ฐ๋ธŒ ํ”„๋กฌํ”„ํŒ…
81
+ - ํˆฌ๋ช…์„ฑ์„ ์œ„ํ•œ ์ „์ฒ˜๋ฆฌ ๊ฒฐ๊ณผ ๊ฐค๋Ÿฌ๋ฆฌ
82
+
83
+ ### ๊ธฐ์ˆ  ์‚ฌ์–‘:
84
+ - FLUX.1-dev ๋ฐ DreamO ํŒŒ์ดํ”„๋ผ์ธ ๊ตฌ๋™
85
+ - CUDA๋ฅผ ์‚ฌ์šฉํ•œ GPU ๊ฐ€์† ์ฒ˜๋ฆฌ
86
+ - ํ†ตํ•ฉ๋œ ์–ผ๊ตด ๋ณต์› ๋ฐ ๋ฐฐ๊ฒฝ ์ œ๊ฑฐ ๋„๊ตฌ
87
+ - FFmpeg ๊ธฐ๋ฐ˜ ๋น„๋””์˜ค ํ›„์ฒ˜๋ฆฌ
88
+
89
+ ### ์‚ฌ์šฉ ์‚ฌ๋ก€:
90
+ - ์†Œ์…œ ๋ฏธ๋””์–ด๋ฅผ ์œ„ํ•œ ์ฐฝ์˜์ ์ธ ์ฝ˜ํ…์ธ  ์ƒ์„ฑ
91
+ - ์บ๋ฆญํ„ฐ ๋””์ž์ธ ๋ฐ ์• ๋‹ˆ๋ฉ”์ด์…˜
92
+ - ์ œํ’ˆ ์‹œ๊ฐํ™” ๋ฐ ๋งˆ์ผ€ํŒ… ์ž๋ฃŒ
93
+ - ์˜ˆ์ˆ ์  ์Šคํƒ€์ผ ์ „์†ก ๋ฐ ์‹คํ—˜
94
+ - ๊ฐœ์ธ ์•„๋ฐ”ํƒ€ ๋ฐ ์ดˆ์ƒํ™” ์ œ์ž‘