Update README.md
Browse files
README.md
CHANGED
|
@@ -1,22 +1,22 @@
|
|
| 1 |
# LibreFLUX-ControlNet Inference (WIP)
|
| 2 |

|
| 3 |
|
| 4 |
-
This model is a ControlNet
|
| 5 |
|
| 6 |
It incorperates:
|
| 7 |
- Attention Masking
|
| 8 |
- Running inference with CFG.
|
| 9 |
|
| 10 |
**Disclaimer**, This is pieced together by modifying and borrowing from these repos:
|
| 11 |
-
- [https://huggingface.co/jimmycarter/LibreFLUX]
|
| 12 |
-
- [https://github.com/bghira/SimpleTuner]
|
| 13 |
|
| 14 |
|
| 15 |
## Status
|
| 16 |
Work in progress. Code is being transferred and adapted from my larger project.
|
| 17 |
|
| 18 |
|
| 19 |
-
|
| 20 |
|
| 21 |
- Use these specific library versions:
|
| 22 |
```py
|
|
@@ -24,7 +24,7 @@ pip install -U diffusers==0.32.0
|
|
| 24 |
pip install -U "transformers @ git+https://github.com/huggingface/transformers@e15687fffe5c9d20598a19aeab721ae0a7580f8a"
|
| 25 |
```
|
| 26 |
|
| 27 |
-
|
| 28 |
|
| 29 |
```py
|
| 30 |
import torch
|
|
@@ -44,7 +44,7 @@ pipe = DiffusionPipeline.from_pretrained(
|
|
| 44 |
).to(device)
|
| 45 |
```
|
| 46 |
|
| 47 |
-
|
| 48 |
|
| 49 |
```py
|
| 50 |
from PIL import Image
|
|
|
|
| 1 |
# LibreFLUX-ControlNet Inference (WIP)
|
| 2 |

|
| 3 |
|
| 4 |
+
This model is a ControlNet trained on top of LibreFLUX using [https://github.com/NeuralVFX/LibreFLUX-ControlNet](https://github.com/NeuralVFX/LibreFLUX-ControlNet)
|
| 5 |
|
| 6 |
It incorperates:
|
| 7 |
- Attention Masking
|
| 8 |
- Running inference with CFG.
|
| 9 |
|
| 10 |
**Disclaimer**, This is pieced together by modifying and borrowing from these repos:
|
| 11 |
+
- [https://huggingface.co/jimmycarter/LibreFLUX](https://huggingface.co/jimmycarter/LibreFLUX)
|
| 12 |
+
- [https://github.com/bghira/SimpleTuner](https://github.com/bghira/SimpleTuner)
|
| 13 |
|
| 14 |
|
| 15 |
## Status
|
| 16 |
Work in progress. Code is being transferred and adapted from my larger project.
|
| 17 |
|
| 18 |
|
| 19 |
+
# Compatibility
|
| 20 |
|
| 21 |
- Use these specific library versions:
|
| 22 |
```py
|
|
|
|
| 24 |
pip install -U "transformers @ git+https://github.com/huggingface/transformers@e15687fffe5c9d20598a19aeab721ae0a7580f8a"
|
| 25 |
```
|
| 26 |
|
| 27 |
+
# Load Pipeline
|
| 28 |
|
| 29 |
```py
|
| 30 |
import torch
|
|
|
|
| 44 |
).to(device)
|
| 45 |
```
|
| 46 |
|
| 47 |
+
# Inference
|
| 48 |
|
| 49 |
```py
|
| 50 |
from PIL import Image
|