peteromallet commited on
Commit
2a60304
·
verified ·
1 Parent(s): 56cf98d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +72 -3
README.md CHANGED
@@ -1,3 +1,72 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - peteromallet/high-quality-midjouney-srefs
5
+ base_model:
6
+ - Qwen/Qwen-Image-Edit
7
+ tags:
8
+ - image
9
+ - editing
10
+ - lora
11
+ - style-transfer
12
+ - qwen
13
+ pipeline_tag: image-to-image
14
+ library_name: diffusers
15
+ ---
16
+
17
+ # QwenEdit InSubject LoRA
18
+
19
+ ## Model Description
20
+
21
+ **QwenEdit InSubject** is a LoRA fine-tune for QwenEdit that significantly improves its ability to preserve subjects while making edits to images. It works effectively with both single subjects and multiple subjects in the same image. While the base model can perform various image edits, it often loses important subject characteristics or distorts the main subjects during the editing process. This LoRA addresses these limitations to provide more accurate subject-preserving image editing.
22
+
23
+ <video controls>
24
+ <source src="samples.mp4" type="video/mp4">
25
+ Your browser does not support the video tag.
26
+ </video>
27
+
28
+ ## How to Use
29
+
30
+ To get the best results, use this prompt format:
31
+
32
+ `Make an image of [subject description] in the same scene [new pose/action/details]`
33
+
34
+ You can include "in the same scene" to preserve the original scene and background while modifying the subject's pose, clothing, or other details.
35
+
36
+ For example:
37
+ `Make an image of the horned woman in the same scene seated on a low pink ottoman, adjusting the buckle on one of her matching blue heels while her other leg is delicately crossed, wearing a blue and gold dress with a ruffled collar, red lips and freckles, the vibrant pink background still filling the frame behind her.`
38
+
39
+ ### use with diffusers
40
+
41
+ ```
42
+ import torch
43
+ from diffusers import QwenImageEditPipeline
44
+
45
+ pipe = QwenImageEditPipeline.from_pretrained("Qwen/Qwen-Image-Edit", torch_dtype=torch.bfloat16)
46
+ pipe.to("cuda")
47
+
48
+ pipe.load_lora_weights("peteromallet/Qwen-Image-Edit-InSubject", weight_name="InSubject-0.5.safetensors")
49
+ ```
50
+
51
+ ### Strengths & Weaknesses
52
+
53
+ The model excels at:
54
+ - Preserving subject identity and key characteristics during edits
55
+ - Maintaining subject proportions and anatomical accuracy
56
+ - Making targeted edits without affecting the main subject
57
+ - Strong subject-aware prompt adherence
58
+
59
+ The model may struggle with:
60
+ - Complex multi-subject scenes where subject boundaries are unclear
61
+ - Very dramatic lighting changes that fundamentally alter subject appearance
62
+ - Edits that require significant subject pose or orientation changes
63
+
64
+ ## Training Data
65
+
66
+ The QwenEdit InSubject LoRA was trained on a curated dataset of high-quality image editing pairs that focus on subject preservation. This dataset emphasizes maintaining subject integrity across various editing scenarios including background changes, lighting adjustments, and contextual modifications.
67
+
68
+
69
+ ## Links
70
+
71
+ - Model: [https://huggingface.co/peteromallet/Qwen-Image-Edit-InSubject](https://huggingface.co/peteromallet/Qwen-Image-Edit-InSubject)
72
+ - Dataset: [https://huggingface.co/datasets/peteromallet/high-quality-midjouney-srefs](https://huggingface.co/datasets/peteromallet/high-quality-midjouney-srefs)