File size: 4,192 Bytes
87dbdf7
197ad12
87dbdf7
 
 
 
2010fa1
87dbdf7
 
 
197ad12
87dbdf7
 
2010fa1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
---
title: DreamO Video
emoji: ๐Ÿจ
colorFrom: purple
colorTo: yellow
sdk: gradio
sdk_version: 5.35.0
app_file: app.py
pinned: false
license: apache-2.0
short_description: A Unified Framework for Custom Image and Video generation
---

## English Description

**DreamO Video - AI-Powered Image and Video Generation**

DreamO Video is an advanced AI application that combines cutting-edge image generation with video synthesis capabilities. Built on the FLUX.1-dev model and enhanced with the DreamO pipeline, this tool allows users to create highly customized images and transform them into dynamic 2-second videos.

### Key Features:

1. **Dual Reference Image System**: Upload up to two reference images to guide the generation process, with flexible task options:
   - **IP (Image Prompt)**: Use images as visual prompts to influence the overall composition
   - **ID (Identity)**: Preserve facial features and identity from reference images
   - **Style**: Transfer artistic style from reference images to generated content

2. **Advanced Image Generation**: 
   - Customizable resolution (768-1024 pixels)
   - Fine-tuned guidance controls for precise output
   - Seed-based generation for reproducible results
   - Background removal and face alignment preprocessing

3. **Video Synthesis**: Transform any generated image into a 2-second animated video with natural motion and smooth transitions (Note: Full version supports up to 60-second videos)

4. **Professional Features**:
   - Automatic watermarking for video outputs
   - Advanced CFG (Classifier-Free Guidance) controls
   - Negative prompting for refined results
   - Gallery of preprocessing results for transparency

### Technical Specifications:
- Powered by FLUX.1-dev and DreamO pipeline
- GPU-accelerated processing using CUDA
- Integrated face restoration and background removal tools
- FFmpeg-based video post-processing

### Use Cases:
- Creative content generation for social media
- Character design and animation
- Product visualization and marketing materials
- Artistic style transfer and experimentation
- Personal avatar and portrait creation

---

## ํ•œ๊ธ€ ์„ค๋ช…

**DreamO Video - AI ๊ธฐ๋ฐ˜ ์ด๋ฏธ์ง€ ๋ฐ ๋น„๋””์˜ค ์ƒ์„ฑ ๋„๊ตฌ**

DreamO Video๋Š” ์ตœ์ฒจ๋‹จ ์ด๋ฏธ์ง€ ์ƒ์„ฑ๊ณผ ๋น„๋””์˜ค ํ•ฉ์„ฑ ๊ธฐ๋Šฅ์„ ๊ฒฐํ•ฉํ•œ ๊ณ ๊ธ‰ AI ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์ž…๋‹ˆ๋‹ค. FLUX.1-dev ๋ชจ๋ธ์„ ๊ธฐ๋ฐ˜์œผ๋กœ ํ•˜๊ณ  DreamO ํŒŒ์ดํ”„๋ผ์ธ์œผ๋กœ ๊ฐ•ํ™”๋œ ์ด ๋„๊ตฌ๋ฅผ ํ†ตํ•ด ์‚ฌ์šฉ์ž๋Š” ๊ณ ๋„๋กœ ๋งž์ถคํ™”๋œ ์ด๋ฏธ์ง€๋ฅผ ์ƒ์„ฑํ•˜๊ณ  ์ด๋ฅผ ์—ญ๋™์ ์ธ 2์ดˆ ๋™์˜์ƒ์œผ๋กœ ๋ณ€ํ™˜ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

### ์ฃผ์š” ๊ธฐ๋Šฅ:

1. **์ด์ค‘ ์ฐธ์กฐ ์ด๋ฏธ์ง€ ์‹œ์Šคํ…œ**: ์ตœ๋Œ€ 2๊ฐœ์˜ ์ฐธ์กฐ ์ด๋ฏธ์ง€๋ฅผ ์—…๋กœ๋“œํ•˜์—ฌ ์ƒ์„ฑ ๊ณผ์ •์„ ์•ˆ๋‚ดํ•˜๋ฉฐ, ์œ ์—ฐํ•œ ์ž‘์—… ์˜ต์…˜ ์ œ๊ณต:
   - **IP (์ด๋ฏธ์ง€ ํ”„๋กฌํ”„ํŠธ)**: ์ด๋ฏธ์ง€๋ฅผ ์‹œ๊ฐ์  ํ”„๋กฌํ”„ํŠธ๋กœ ์‚ฌ์šฉํ•˜์—ฌ ์ „์ฒด ๊ตฌ์„ฑ์— ์˜ํ–ฅ
   - **ID (์‹ ์›)**: ์ฐธ์กฐ ์ด๋ฏธ์ง€์˜ ์–ผ๊ตด ํŠน์ง•๊ณผ ์‹ ์› ๋ณด์กด
   - **Style (์Šคํƒ€์ผ)**: ์ฐธ์กฐ ์ด๋ฏธ์ง€์˜ ์˜ˆ์ˆ ์  ์Šคํƒ€์ผ์„ ์ƒ์„ฑ ์ฝ˜ํ…์ธ ๋กœ ์ „์†ก

2. **๊ณ ๊ธ‰ ์ด๋ฏธ์ง€ ์ƒ์„ฑ**: 
   - ์‚ฌ์šฉ์ž ์ •์˜ ๊ฐ€๋Šฅํ•œ ํ•ด์ƒ๋„ (768-1024 ํ”ฝ์…€)
   - ์ •๋ฐ€ํ•œ ์ถœ๋ ฅ์„ ์œ„ํ•œ ๋ฏธ์„ธ ์กฐ์ •๋œ ๊ฐ€์ด๋˜์Šค ์ปจํŠธ๋กค
   - ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ๊ฒฐ๊ณผ๋ฅผ ์œ„ํ•œ ์‹œ๋“œ ๊ธฐ๋ฐ˜ ์ƒ์„ฑ
   - ๋ฐฐ๊ฒฝ ์ œ๊ฑฐ ๋ฐ ์–ผ๊ตด ์ •๋ ฌ ์ „์ฒ˜๋ฆฌ

3. **๋น„๋””์˜ค ํ•ฉ์„ฑ**: ์ƒ์„ฑ๋œ ๋ชจ๋“  ์ด๋ฏธ์ง€๋ฅผ ์ž์—ฐ์Šค๋Ÿฌ์šด ์›€์ง์ž„๊ณผ ๋ถ€๋“œ๋Ÿฌ์šด ์ „ํ™˜์ด ์žˆ๋Š” 2์ดˆ ์• ๋‹ˆ๋ฉ”์ด์…˜ ๋น„๋””์˜ค๋กœ ๋ณ€ํ™˜ (์ฐธ๊ณ : ์ •์‹ ๋ฒ„์ „์€ ์ตœ๋Œ€ 60์ดˆ ๋น„๋””์˜ค ์ง€์›)

4. **์ „๋ฌธ ๊ธฐ๋Šฅ**:
   - ๋น„๋””์˜ค ์ถœ๋ ฅ๋ฌผ์— ๋Œ€ํ•œ ์ž๋™ ์›Œํ„ฐ๋งˆํ‚น
   - ๊ณ ๊ธ‰ CFG (Classifier-Free Guidance) ์ปจํŠธ๋กค
   - ์ •์ œ๋œ ๊ฒฐ๊ณผ๋ฅผ ์œ„ํ•œ ๋„ค๊ฑฐํ‹ฐ๋ธŒ ํ”„๋กฌํ”„ํŒ…
   - ํˆฌ๋ช…์„ฑ์„ ์œ„ํ•œ ์ „์ฒ˜๋ฆฌ ๊ฒฐ๊ณผ ๊ฐค๋Ÿฌ๋ฆฌ

### ๊ธฐ์ˆ  ์‚ฌ์–‘:
- FLUX.1-dev ๋ฐ DreamO ํŒŒ์ดํ”„๋ผ์ธ ๊ตฌ๋™
- CUDA๋ฅผ ์‚ฌ์šฉํ•œ GPU ๊ฐ€์† ์ฒ˜๋ฆฌ
- ํ†ตํ•ฉ๋œ ์–ผ๊ตด ๋ณต์› ๋ฐ ๋ฐฐ๊ฒฝ ์ œ๊ฑฐ ๋„๊ตฌ
- FFmpeg ๊ธฐ๋ฐ˜ ๋น„๋””์˜ค ํ›„์ฒ˜๋ฆฌ

### ์‚ฌ์šฉ ์‚ฌ๋ก€:
- ์†Œ์…œ ๋ฏธ๋””์–ด๋ฅผ ์œ„ํ•œ ์ฐฝ์˜์ ์ธ ์ฝ˜ํ…์ธ  ์ƒ์„ฑ
- ์บ๋ฆญํ„ฐ ๋””์ž์ธ ๋ฐ ์• ๋‹ˆ๋ฉ”์ด์…˜
- ์ œํ’ˆ ์‹œ๊ฐํ™” ๋ฐ ๋งˆ์ผ€ํŒ… ์ž๋ฃŒ
- ์˜ˆ์ˆ ์  ์Šคํƒ€์ผ ์ „์†ก ๋ฐ ์‹คํ—˜
- ๊ฐœ์ธ ์•„๋ฐ”ํƒ€ ๋ฐ ์ดˆ์ƒํ™” ์ œ์ž‘