Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cannot install deep_training package #22

Open
dyzdyz010 opened this issue Jul 26, 2023 · 4 comments
Open

Cannot install deep_training package #22

dyzdyz010 opened this issue Jul 26, 2023 · 4 comments

Comments

@dyzdyz010
Copy link

python: 3.10

command used: pip install deep_training

console output:

Collecting deep_training
  Using cached deep_training-0.1.12-py3-none-any.whl (483 kB)
Collecting lightning>=2 (from deep_training)
  Using cached lightning-2.0.6-py3-none-any.whl (1.9 MB)
Collecting numpy-io<0.1.0,>=0.0.7 (from deep_training)
  Using cached numpy_io-0.0.7-py3-none-any.whl (27 kB)
Requirement already satisfied: sentencepiece in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (0.1.98)
Requirement already satisfied: numpy in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (1.24.0)
Requirement already satisfied: transformers>=4.22 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (4.31.0)
Collecting seqmetric (from deep_training)
  Using cached seqmetric-0.1.2-py3-none-any.whl (17 kB)
Requirement already satisfied: scipy in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (1.11.1)
Collecting scikit-learn (from deep_training)
  Using cached scikit_learn-1.3.0-cp310-cp310-macosx_12_0_arm64.whl (9.5 MB)
Collecting tensorboard (from deep_training)
  Using cached tensorboard-2.13.0-py3-none-any.whl (5.6 MB)
Requirement already satisfied: tqdm in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (4.65.0)
Requirement already satisfied: six in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from deep_training) (1.16.0)
Requirement already satisfied: Jinja2<5.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (3.1.2)
Requirement already satisfied: PyYAML<8.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages/PyYAML-6.0-py3.10-macosx-11.1-arm64.egg (from lightning>=2->deep_training) (6.0)
Collecting arrow<3.0,>=1.2.0 (from lightning>=2->deep_training)
  Using cached arrow-1.2.3-py3-none-any.whl (66 kB)
Collecting backoff<4.0,>=2.2.1 (from lightning>=2->deep_training)
  Using cached backoff-2.2.1-py3-none-any.whl (15 kB)
Requirement already satisfied: beautifulsoup4<6.0,>=4.8.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (4.12.2)
Requirement already satisfied: click<10.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (8.1.6)
Collecting croniter<1.5.0,>=1.3.0 (from lightning>=2->deep_training)
  Using cached croniter-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting dateutils<2.0 (from lightning>=2->deep_training)
  Using cached dateutils-0.6.12-py2.py3-none-any.whl (5.7 kB)
Collecting deepdiff<8.0,>=5.7.0 (from lightning>=2->deep_training)
  Using cached deepdiff-6.3.1-py3-none-any.whl (70 kB)
Requirement already satisfied: fastapi<2.0,>=0.92.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (0.100.0)
Requirement already satisfied: fsspec<2025.0,>=2022.5.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (2023.6.0)
Collecting inquirer<5.0,>=2.10.0 (from lightning>=2->deep_training)
  Using cached inquirer-3.1.3-py3-none-any.whl (18 kB)
Collecting lightning-cloud>=0.5.37 (from lightning>=2->deep_training)
  Using cached lightning_cloud-0.5.37-py3-none-any.whl (596 kB)
Collecting lightning-utilities<2.0,>=0.7.0 (from lightning>=2->deep_training)
  Using cached lightning_utilities-0.9.0-py3-none-any.whl (23 kB)
Requirement already satisfied: packaging in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (23.1)
Requirement already satisfied: psutil<7.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (5.9.5)
Requirement already satisfied: pydantic<2.1.0,>=1.7.4 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (1.10.11)
Collecting python-multipart<2.0,>=0.0.5 (from lightning>=2->deep_training)
  Using cached python_multipart-0.0.6-py3-none-any.whl (45 kB)
Requirement already satisfied: requests<4.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (2.31.0)
Requirement already satisfied: rich<15.0,>=12.3.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (13.4.2)
Requirement already satisfied: starlette in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (0.27.0)
Collecting starsessions<2.0,>=1.2.1 (from lightning>=2->deep_training)
  Using cached starsessions-1.3.0-py3-none-any.whl (10 kB)
Requirement already satisfied: torch<4.0,>=1.11.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (2.1.0.dev20230722)
Collecting torchmetrics<2.0,>=0.7.0 (from lightning>=2->deep_training)
  Using cached torchmetrics-1.0.1-py3-none-any.whl (729 kB)
Collecting traitlets<7.0,>=5.3.0 (from lightning>=2->deep_training)
  Using cached traitlets-5.9.0-py3-none-any.whl (117 kB)
Requirement already satisfied: typing-extensions<6.0,>=4.0.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (4.7.1)
Requirement already satisfied: urllib3<4.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (1.26.16)
Requirement already satisfied: uvicorn<2.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (0.23.1)
Requirement already satisfied: websocket-client<3.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from lightning>=2->deep_training) (1.6.1)
Collecting websockets<13.0 (from lightning>=2->deep_training)
  Using cached websockets-11.0.3-cp310-cp310-macosx_11_0_arm64.whl (121 kB)
Collecting pytorch-lightning (from lightning>=2->deep_training)
  Using cached pytorch_lightning-2.0.6-py3-none-any.whl (722 kB)
Collecting fastdatasets<=0.9.20,>=0.9.14 (from numpy-io<0.1.0,>=0.0.7->deep_training)
  Using cached fastdatasets-0.9.15-py3-none-any.whl (60 kB)
Requirement already satisfied: filelock in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (3.12.2)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (0.16.4)
Requirement already satisfied: regex!=2019.12.17 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (2023.6.3)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (0.13.3)
Requirement already satisfied: safetensors>=0.3.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from transformers>=4.22->deep_training) (0.3.1)
Requirement already satisfied: joblib>=1.1.1 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from scikit-learn->deep_training) (1.3.1)
Collecting threadpoolctl>=2.0.0 (from scikit-learn->deep_training)
  Using cached threadpoolctl-3.2.0-py3-none-any.whl (15 kB)
Collecting absl-py>=0.4 (from tensorboard->deep_training)
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting grpcio>=1.48.2 (from tensorboard->deep_training)
  Using cached grpcio-1.56.2-cp310-cp310-macosx_12_0_universal2.whl (8.8 MB)
Requirement already satisfied: google-auth<3,>=1.6.3 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (2.22.0)
Collecting google-auth-oauthlib<1.1,>=0.5 (from tensorboard->deep_training)
  Using cached google_auth_oauthlib-1.0.0-py2.py3-none-any.whl (18 kB)
Requirement already satisfied: markdown>=2.6.8 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (3.3.7)
Requirement already satisfied: protobuf>=3.19.6 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (4.23.4)
Requirement already satisfied: setuptools>=41.0.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (65.6.3)
Collecting tensorboard-data-server<0.8.0,>=0.7.0 (from tensorboard->deep_training)
  Using cached tensorboard_data_server-0.7.1-py3-none-any.whl (2.4 kB)
Collecting werkzeug>=1.0.1 (from tensorboard->deep_training)
  Using cached Werkzeug-2.3.6-py3-none-any.whl (242 kB)
Requirement already satisfied: wheel>=0.26 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from tensorboard->deep_training) (0.38.4)
Requirement already satisfied: python-dateutil>=2.7.0 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from arrow<3.0,>=1.2.0->lightning>=2->deep_training) (2.8.2)
Requirement already satisfied: soupsieve>1.2 in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from beautifulsoup4<6.0,>=4.8.0->lightning>=2->deep_training) (2.4.1)
Requirement already satisfied: pytz in /opt/homebrew/Caskroom/miniconda/base/envs/gpt/lib/python3.10/site-packages (from dateutils<2.0->lightning>=2->deep_training) (2023.3)
Collecting ordered-set<4.2.0,>=4.0.2 (from deepdiff<8.0,>=5.7.0->lightning>=2->deep_training)
  Using cached ordered_set-4.1.0-py3-none-any.whl (7.6 kB)
INFO: pip is looking at multiple versions of fastdatasets to determine which version is compatible with other requirements. This could take a while.
Collecting fastdatasets<=0.9.20,>=0.9.14 (from numpy-io<0.1.0,>=0.0.7->deep_training)
  Using cached fastdatasets-0.9.14-py3-none-any.whl (59 kB)
ERROR: Cannot install numpy-io because these package versions have conflicting dependencies.

The conflict is caused by:
    fastdatasets 0.9.15 depends on tfrecords<0.3 and >=0.2.12
    fastdatasets 0.9.14 depends on tfrecords<0.3 and >=0.2.12

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
@ssbuild
Copy link
Owner

ssbuild commented Jul 26, 2023

try:
pip install -i https://pypi.org/simple deep_training

@dyzdyz010
Copy link
Author

No luck, still the same error.

@ssbuild
Copy link
Owner

ssbuild commented Jul 26, 2023

tfrecords support only linux or windows , if macos , may instal failed.

@dyzdyz010
Copy link
Author

any plans to support macOS?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dyzdyz010 @ssbuild