Commit
·
94dd666
1
Parent(s):
c62e2df
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,14 +7,24 @@ tags:
|
|
| 7 |
# Control-LoRA Model Card
|
| 8 |
|
| 9 |
|
| 10 |
-
##
|
| 11 |
-
|
| 12 |
|
| 13 |
-
By
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
|
| 15 |
### MiDaS and ClipDrop Depth
|
| 16 |

|
| 17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
### Canny Edge
|
| 19 |

|
| 20 |
Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.
|
|
|
|
| 7 |
# Control-LoRA Model Card
|
| 8 |
|
| 9 |
|
| 10 |
+
## Introduction
|
| 11 |
+
What's better than ControlNets for SDXL? ControlNet... but, more efficient.
|
| 12 |
|
| 13 |
+
By introducing low-rank parameter efficient fine tuning, we introduce ***Control-LoRAs***.
|
| 14 |
+
|
| 15 |
+
Integrating the strengths of both ControlNet and PEFT, this approach offers a more efficient and compact method to bring model control for a wider variety of consumer GPUs.
|
| 16 |
+
|
| 17 |
+
For each model below, you'll find `Rank 256` files (reducing the `~4.7GB` ControlNets to `~738MB`) and experimental, ultra-pruned `Rank 128` files (reducing to `~377MB`).
|
| 18 |
|
| 19 |
### MiDaS and ClipDrop Depth
|
| 20 |

|
| 21 |
|
| 22 |
+
Depth estimation is an image processing technique that determines the distance of objects in a scene, providing a depth map that highlights variations in proximity.
|
| 23 |
+
|
| 24 |
+
In the example above, we compare the depth results of MiDaS dpt_beit_large_512 with ClipDrop Depth for portraits, and their subsequent use in Depth Control-LoRa.
|
| 25 |
+
|
| 26 |
+
The Control-LoRA utilizes a grayscale depth map for guided generation and has been trained on a diverse range of image concepts and aspect ratios.
|
| 27 |
+
|
| 28 |
### Canny Edge
|
| 29 |

|
| 30 |
Canny Edge Detection is an image processing technique that identifies abrupt changes in intensity to highlight edges in an image.
|