Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unable to install dependencies #236

Open
NadaComa opened this issue May 17, 2023 · 0 comments
Open

Unable to install dependencies #236

NadaComa opened this issue May 17, 2023 · 0 comments
Labels
bug Something isn't working

Comments

@NadaComa
Copy link

NadaComa commented May 17, 2023 •
edited
Loading

Describe the bug

Hi all, sorry for this but I am stuck. I am definitely lacking experience with setting up python properly.

Anyways: when I try to follow the documentation I run into two issues

  1. Running pip install git+https://github.com/ShivamShrirao/diffusers.git works fine but then pip install -U -r requirements.txt does not find the requirements.txt
  2. Checking out the code via git and running this in there results in issues with xformers
    `Collecting xformers
    Using cached xformers-0.0.17-cp310-cp310-manylinux2014_x86_64.whl (123.6 MB)
    Using cached xformers-0.0.16-cp310-cp310-manylinux2014_x86_64.whl (50.9 MB)
    Using cached xformers-0.0.13.tar.gz (292 kB)
    Preparing metadata (setup.py) ... error
    error: subprocess-exited-with-error

× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [8 lines of output]
Traceback (most recent call last):
File "", line 2, in
File "", line 34, in
File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 239, in
ext_modules=get_extensions(),
File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 157, in get_extensions
raise RuntimeError(
RuntimeError: CUTLASS submodule not found. Did you forget to run git submodule update --init --recursive ?
[end of output]
`

Reproduction

This is what I am actually doing on the command line.
Python 3.10.10 and PyTorch 2.1.0.dev20230513 previously installed via miniconda

python3 -m venv diffuser.env
source diffuser.env/bin/activate
pip install git+https://github.com/ShivamShrirao/diffusers.git
pip install -U -r requirements.txt #Does not work, so doing the next three lines in downloaded source. Where is my requirements.txt?
git clone https://github.com/ShivamShrirao/diffusers.git
cd diffusers/examples/dreambooth
pip install -U -r requirements.txt

Now I get the error message

Logs

Collecting accelerate
  Using cached accelerate-0.19.0-py3-none-any.whl (219 kB)
Collecting torchvision
  Using cached torchvision-0.15.2-cp310-cp310-manylinux1_x86_64.whl (6.0 MB)
Collecting transformers>=4.25.1
  Using cached transformers-4.29.2-py3-none-any.whl (7.1 MB)
Collecting ftfy
  Using cached ftfy-6.1.1-py3-none-any.whl (53 kB)
Collecting tensorboard
  Using cached tensorboard-2.13.0-py3-none-any.whl (5.6 MB)
Requirement already satisfied: Jinja2 in /home/ai/diffuser.env/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (3.1.2)
Collecting safetensors
  Using cached safetensors-0.3.1-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
Requirement already satisfied: xformers in /home/ai/diffuser.env/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (0.0.19)
Requirement already satisfied: packaging>=20.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (23.1)
Requirement already satisfied: numpy>=1.17 in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (1.24.3)
Collecting psutil
  Using cached psutil-5.9.5-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (282 kB)
Requirement already satisfied: pyyaml in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (6.0)
Requirement already satisfied: torch>=1.6.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from accelerate->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: requests in /home/ai/diffuser.env/lib/python3.10/site-packages (from torchvision->-r requirements.txt (line 2)) (2.30.0)
Collecting torch>=1.6.0
  Using cached torch-2.0.1-cp310-cp310-manylinux1_x86_64.whl (619.9 MB)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torchvision->-r requirements.txt (line 2)) (9.5.0)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (10.9.0.58)
Requirement already satisfied: filelock in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (3.12.0)
Requirement already satisfied: typing-extensions in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (4.5.0)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (10.2.10.91)
Requirement already satisfied: networkx in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (3.1)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.4.0.1)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.101)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.4.91)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: sympy in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (1.12)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.10.3.66)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (2.14.3)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/ai/diffuser.env/lib/python3.10/site-packages (from torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (8.5.0.96)
Requirement already satisfied: wheel in /home/ai/diffuser.env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (0.40.0)
Requirement already satisfied: setuptools in /home/ai/diffuser.env/lib/python3.10/site-packages (from nvidia-cublas-cu11==11.10.3.66->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (65.5.0)
Requirement already satisfied: cmake in /home/ai/diffuser.env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (3.26.3)
Requirement already satisfied: lit in /home/ai/diffuser.env/lib/python3.10/site-packages (from triton==2.0.0->torch>=1.6.0->accelerate->-r requirements.txt (line 1)) (16.0.5)
Requirement already satisfied: tqdm>=4.27 in /home/ai/diffuser.env/lib/python3.10/site-packages (from transformers>=4.25.1->-r requirements.txt (line 3)) (4.65.0)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /home/ai/diffuser.env/lib/python3.10/site-packages (from transformers>=4.25.1->-r requirements.txt (line 3)) (0.14.1)
Requirement already satisfied: regex!=2019.12.17 in /home/ai/diffuser.env/lib/python3.10/site-packages (from transformers>=4.25.1->-r requirements.txt (line 3)) (2023.5.5)
Collecting tokenizers!=0.11.3,<0.14,>=0.11.1
  Using cached tokenizers-0.13.3-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (7.8 MB)
Collecting wcwidth>=0.2.5
  Using cached wcwidth-0.2.6-py2.py3-none-any.whl (29 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.3.4-py3-none-any.whl (242 kB)
Collecting tensorboard-data-server<0.8.0,>=0.7.0
  Using cached tensorboard_data_server-0.7.0-py3-none-manylinux2014_x86_64.whl (6.6 MB)
Collecting protobuf>=3.19.6
  Using cached protobuf-4.23.0-cp37-abi3-manylinux2014_x86_64.whl (304 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting absl-py>=0.4
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting google-auth<3,>=1.6.3
  Using cached google_auth-2.18.0-py2.py3-none-any.whl (178 kB)
Collecting grpcio>=1.48.2
  Using cached grpcio-1.54.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (5.1 MB)
Collecting google-auth-oauthlib<1.1,>=0.5
  Using cached google_auth_oauthlib-1.0.0-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: MarkupSafe>=2.0 in /home/ai/diffuser.env/lib/python3.10/site-packages (from Jinja2->-r requirements.txt (line 6)) (2.1.2)
Requirement already satisfied: pyre-extensions==0.0.29 in /home/ai/diffuser.env/lib/python3.10/site-packages (from xformers->-r requirements.txt (line 8)) (0.0.29)
Collecting xformers
  Using cached xformers-0.0.19-cp310-cp310-manylinux2014_x86_64.whl (108.2 MB)
  Using cached xformers-0.0.18-cp310-cp310-manylinux2014_x86_64.whl (123.8 MB)
Collecting pyre-extensions==0.0.23
  Using cached pyre_extensions-0.0.23-py3-none-any.whl (11 kB)
Collecting xformers
  Using cached xformers-0.0.17-cp310-cp310-manylinux2014_x86_64.whl (123.6 MB)
  Using cached xformers-0.0.16-cp310-cp310-manylinux2014_x86_64.whl (50.9 MB)
  Using cached xformers-0.0.13.tar.gz (292 kB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [8 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 239, in <module>
          ext_modules=get_extensions(),
        File "/tmp/pip-install-avq6g3he/xformers_b1e7c307462c4a779595d3a29f8fc61b/setup.py", line 157, in get_extensions
          raise RuntimeError(
      RuntimeError: CUTLASS submodule not found. Did you forget to run `git submodule update --init --recursive` ?
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

System Info

Linux MINT Debian Edition (Bullseye) with RTX 3060

Python 3.10.10 and PyTorch 2.1.0.dev20230513 installed via miniconda
@NadaComa NadaComa added the bug Something isn't working label May 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@NadaComa