Commit
·
e89e563
1
Parent(s):
d31b788
fix workaround
Browse files
README.md
CHANGED
|
@@ -191,18 +191,16 @@ This is because of flash attention, which is defined in the `requirements.txt` u
|
|
| 191 |
./setup.sh
|
| 192 |
```
|
| 193 |
|
| 194 |
-
###
|
| 195 |
|
| 196 |
-
|
| 197 |
|
| 198 |
-
-
|
| 199 |
-
-
|
| 200 |
-
- solution 3: don't use clip captioning
|
| 201 |
|
| 202 |
-
|
| 203 |
-
|
| 204 |
-
|
| 205 |
-
```
|
| 206 |
|
| 207 |
## Run
|
| 208 |
|
|
|
|
| 191 |
./setup.sh
|
| 192 |
```
|
| 193 |
|
| 194 |
+
### macOS is NOT supported
|
| 195 |
|
| 196 |
+
Currently macOS is NOT supported due to two separate dependency issues:
|
| 197 |
|
| 198 |
+
- issue with flash attention
|
| 199 |
+
- issue with decord
|
|
|
|
| 200 |
|
| 201 |
+
However, the paradox is that I actually develop and maintain VMS using macOS!
|
| 202 |
+
|
| 203 |
+
So don't be surprised by the presence of "degraded_setup.sh" and all, it's just a workaround for me to be able to at least test the web ui on macOS.
|
|
|
|
| 204 |
|
| 205 |
## Run
|
| 206 |
|
degraded_finetrainers_requirements.txt
ADDED
|
@@ -0,0 +1,20 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
accelerate
|
| 2 |
+
bitsandbytes
|
| 3 |
+
datasets>=3.3.2
|
| 4 |
+
diffusers>=0.32.1
|
| 5 |
+
transformers>=4.45.2
|
| 6 |
+
huggingface_hub
|
| 7 |
+
hf_transfer>=0.1.8
|
| 8 |
+
peft>=0.13.0
|
| 9 |
+
#decord>=0.6.0
|
| 10 |
+
wandb
|
| 11 |
+
pandas
|
| 12 |
+
torch>=2.5.1
|
| 13 |
+
torchvision>=0.20.1
|
| 14 |
+
torchdata>=0.10.1
|
| 15 |
+
torchao>=0.7.0
|
| 16 |
+
sentencepiece>=0.2.0
|
| 17 |
+
imageio-ffmpeg>=0.5.1
|
| 18 |
+
numpy>=1.26.4
|
| 19 |
+
kornia>=0.7.3
|
| 20 |
+
ruff==0.9.10
|
requirements_without_flash_attention.txt → degraded_requirements.txt
RENAMED
|
@@ -3,16 +3,6 @@
|
|
| 3 |
# For GPU monitoring of NVIDIA chipsets
|
| 4 |
pynvml
|
| 5 |
|
| 6 |
-
# eva-decord is missing get_batch it seems
|
| 7 |
-
#eva-decord==0.6.1
|
| 8 |
-
#decord
|
| 9 |
-
|
| 10 |
-
# we are waiting for the next PyPI release
|
| 11 |
-
#finetrainers==0.1.0
|
| 12 |
-
finetrainers @ git+https://github.com/a-r-r-o-w/finetrainers.git@main
|
| 13 |
-
# temporary fix for pip install bug:
|
| 14 |
-
#finetrainers @ git+https://github.com/jbilcke-hf/finetrainers-patches.git@fix_missing_sft_trainer_files
|
| 15 |
-
|
| 16 |
# it is recommended to always use the latest version
|
| 17 |
diffusers @ git+https://github.com/huggingface/diffusers.git@main
|
| 18 |
|
|
|
|
| 3 |
# For GPU monitoring of NVIDIA chipsets
|
| 4 |
pynvml
|
| 5 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6 |
# it is recommended to always use the latest version
|
| 7 |
diffusers @ git+https://github.com/huggingface/diffusers.git@main
|
| 8 |
|
setup_no_captions.sh → degraded_setup.sh
RENAMED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
#!/usr/bin/env bash
|
| 2 |
|
| 3 |
-
echo "
|
| 4 |
|
| 5 |
# if you are on a mac, you can try to replace "python3.10" with:
|
| 6 |
# python3.10
|
|
@@ -12,7 +12,14 @@ python3.10 -m venv .venv
|
|
| 12 |
|
| 13 |
source .venv/bin/activate
|
| 14 |
|
| 15 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
# if you require flash attention, please install it manually for your operating system
|
| 18 |
|
|
|
|
| 1 |
#!/usr/bin/env bash
|
| 2 |
|
| 3 |
+
echo "Degraded setup for environments where decord cannot be installed"
|
| 4 |
|
| 5 |
# if you are on a mac, you can try to replace "python3.10" with:
|
| 6 |
# python3.10
|
|
|
|
| 12 |
|
| 13 |
source .venv/bin/activate
|
| 14 |
|
| 15 |
+
# :(
|
| 16 |
+
python3.10 -m pip install -r degraded_requirements.txt
|
| 17 |
+
|
| 18 |
+
# :((
|
| 19 |
+
finetrainers @ git+https://github.com/a-r-r-o-w/finetrainers.git@main --no-deps
|
| 20 |
+
|
| 21 |
+
# :(((
|
| 22 |
+
python3.10 -m pip install -r degraded_finetrainers_requirements.txt
|
| 23 |
|
| 24 |
# if you require flash attention, please install it manually for your operating system
|
| 25 |
|
setup.sh
CHANGED
|
@@ -4,4 +4,7 @@ python -m venv .venv
|
|
| 4 |
|
| 5 |
source .venv/bin/activate
|
| 6 |
|
| 7 |
-
python -m pip install -r requirements.txt
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
|
| 5 |
source .venv/bin/activate
|
| 6 |
|
| 7 |
+
python -m pip install -r requirements.txt
|
| 8 |
+
|
| 9 |
+
# if flash attention couldn't be installed for your operating system you can try this:
|
| 10 |
+
# python -m pip install wheel setuptools flash-attn --no-build-isolation --no-cache-dir
|