Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fail to build image from Dockerfile #83

Open
1 of 5 tasks
mlynar-czyk opened this issue May 17, 2023 · 11 comments
Open
1 of 5 tasks

Fail to build image from Dockerfile #83

mlynar-czyk opened this issue May 17, 2023 · 11 comments
Labels

Comments

@mlynar-czyk
Copy link
Contributor

.env

# Generic
TEXT_EMBEDDINGS_MODEL=sentence-transformers/all-MiniLM-L6-v2
TEXT_EMBEDDINGS_MODEL_TYPE=HF  # LlamaCpp or HF
USE_MLOCK=true

# Ingestion
PERSIST_DIRECTORY=db
DOCUMENTS_DIRECTORY=source_documents
INGEST_CHUNK_SIZE=500
INGEST_CHUNK_OVERLAP=50

# Generation
MODEL_TYPE=LlamaCpp # GPT4All or LlamaCpp
MODEL_PATH=eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin
MODEL_TEMP=0.8
MODEL_N_CTX=1024  # Max total size of prompt+answer
MODEL_MAX_TOKENS=256  # Max size of answer
MODEL_STOP=[STOP]
CHAIN_TYPE=betterstuff
N_RETRIEVE_DOCUMENTS=100 # How many documents to retrieve from the db
N_FORWARD_DOCUMENTS=100 # How many documents to forward to the LLM, chosen among those retrieved
N_GPU_LAYERS=4

Python version

python 3.11

System

Windows 10

CASALIOY version

e72bcd5

Information

  • The official example scripts
  • My own modified scripts

Related Components

  • Document ingestion
  • GUI
  • Prompt answering

Reproduction

When trying to build the image from the Dockerfile, the poetry install seems not to behave as intended.

[+] Building 144.9s (11/16)
 => [internal] load .dockerignore                                                                   0.0s 
 => => transferring context: 2B                                                                     0.0s 
 => [internal] load build definition from Dockerfile                                                0.0s 
 => => transferring dockerfile: 561B                                                                0.0s 
 => [internal] load metadata for docker.io/library/python:3.11                                      0.5s 
 => [internal] load build context                                                                   0.0s 
 => => transferring context: 33B                                                                    0.0s 
 => [ 1/12] FROM docker.io/library/python:3.11@sha256:b9683fa80e22970150741c974f45bf1d25856bd76443  0.0s 
 => CACHED [ 2/12] WORKDIR /srv                                                                     0.0s 
 => CACHED [ 3/12] RUN git clone https://github.com/su77ungr/CASALIOY.git                           0.0s 
 => CACHED [ 4/12] WORKDIR CASALIOY                                                                 0.0s 
 => CACHED [ 5/12] RUN pip3 install poetry                                                          0.0s 
 => CACHED [ 6/12] RUN python3 -m poetry config virtualenvs.create false                            0.0s 
 => ERROR [ 7/12] RUN python3 -m poetry install                                                   144.3s 
------
 > [ 7/12] RUN python3 -m poetry install:
#10 0.953 Skipping virtualenv creation, as specified in config file.
#10 1.830 Installing dependencies from lock file
#10 5.362
#10 5.362 Package operations: 157 installs, 3 updates, 0 removals
#10 5.364
#10 5.367   • Installing markupsafe (2.1.2)
#10 5.371   • Installing numpy (1.23.5)
#10 5.372   • Installing python-dateutil (2.8.2)
#10 5.374   • Installing pytz (2023.3)
#10 5.376   • Installing sniffio (1.3.0)
#10 5.377   • Installing tzdata (2023.3)
#10 11.31   • Installing anyio (3.6.2)
#10 11.31   • Installing commonmark (0.9.1)
#10 11.32   • Installing entrypoints (0.4)
#10 11.32   • Installing decorator (5.1.1)
#10 11.32   • Installing mpmath (1.3.0)
#10 11.33   • Installing h11 (0.14.0)
#10 11.33   • Installing pygments (2.15.1)
#10 11.33   • Installing jinja2 (3.1.2)
#10 11.34   • Installing soupsieve (2.4.1)
#10 11.35   • Installing pytz-deprecation-shim (0.1.0.post0)
#10 11.35   • Installing pandas (1.5.3)
#10 11.36   • Installing olefile (0.46)
#10 11.88   • Installing toolz (0.12.0)
#10 17.02   • Installing altair (4.2.2)
#10 17.02   • Installing beautifulsoup4 (4.12.2)
#10 17.02   • Installing blinker (1.6.2)
#10 17.02   • Installing cachetools (5.3.0)
#10 17.03   • Installing click (8.1.3)
#10 17.03   • Installing colorclass (2.2.2)
#10 17.04   • Installing contourpy (1.0.7)
#10 17.04   • Installing cycler (0.11.0)
#10 17.04   • Installing easygui (0.98.3)
#10 17.05   • Installing frozenlist (1.3.3)
#10 17.05   • Installing fsspec (2023.5.0)
#10 17.06   • Installing fonttools (4.39.4)
#10 17.26 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#10 17.33 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#10 17.71   • Installing hpack (4.0.0)
#10 17.73   • Installing httpcore (0.16.3)
#10 17.81   • Installing hyperframe (6.0.1)
#10 17.93   • Installing kiwisolver (1.4.4)
#10 18.16   • Installing markdown (3.4.3)
#10 18.25   • Installing marshmallow (3.19.0)
#10 18.30   • Installing msoffcrypto-tool (5.0.1)
#10 18.52   • Installing multidict (6.0.4)
#10 18.54   • Installing mypy-extensions (1.0.0)
#10 18.68   • Installing networkx (3.1)
#10 18.92   • Installing pcodedmp (1.2.6)
#10 19.08   • Installing pillow (9.5.0)
#10 19.26   • Installing protobuf (4.23.0)
#10 19.27   • Installing pyarrow (12.0.0)
#10 19.29   • Installing pympler (1.0.1)
#10 19.39   • Installing pyparsing (2.4.7)
#10 19.64   • Installing pyyaml (6.0)
#10 19.67   • Installing rfc3986 (1.5.0)
#10 19.74   • Installing rich (13.0.1)
#10 20.15   • Installing sympy (1.12)
#10 20.60   • Installing tenacity (8.2.2)
#10 20.91   • Installing toml (0.10.2)
#10 21.45   • Installing tqdm (4.65.0)
#10 21.49   • Installing typing-extensions (4.5.0)
#10 21.53   • Installing tzlocal (4.2)
#10 21.61   • Installing validators (0.20.0)
#10 21.75   • Installing watchdog (3.0.0)
#10 22.25   • Installing wrapt (1.14.1)
#10 35.52   • Installing aiosignal (1.3.1)
#10 35.52   • Installing async-timeout (4.0.2)
#10 35.52   • Installing backoff (2.2.1)
#10 35.53   • Installing deprecated (1.2.13)
#10 35.53   • Installing et-xmlfile (1.1.0)
#10 35.53   • Installing faker (18.9.0)
#10 35.54   • Installing favicon (0.7.0)
#10 35.54   • Installing greenlet (2.0.2)
#10 35.55   • Installing grpcio (1.54.2)
#10 35.56   • Installing h2 (4.1.0)
#10 35.56   • Installing httpx (0.23.3)
#10 35.57   • Installing htbuilder (0.6.1)
#10 35.79 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#10 35.80 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#10 36.37   • Installing huggingface-hub (0.14.1)
#10 36.39   • Installing joblib (1.2.0)
#10 36.41   • Installing lark-parser (0.12.0)
#10 36.44   • Installing lxml (4.9.2)
#10 36.44   • Installing marshmallow-enum (1.5.1)
#10 36.64   • Installing matplotlib (3.7.1)
#10 36.73   • Installing monotonic (1.6)
#10 37.37   • Installing oletools (0.60.1)
#10 37.38   • Updating platformdirs (2.6.2 -> 3.5.1)
#10 37.60   • Installing pydantic (1.10.7)
#10 38.53   • Installing pymdown-extensions (10.0.1)
#10 39.03   • Installing regex (2023.5.5)
#10 39.29   • Installing requests-file (1.5.1)
#10 40.00   • Installing scipy (1.10.1)
#10 40.41   • Updating setuptools (65.5.1 -> 67.7.2)
#10 40.78   • Installing streamlit (1.22.0 0b7fb1c)
#10 40.79   • Installing threadpoolctl (3.1.0)
#10 41.41   • Installing tokenizers (0.13.3)
#10 41.42   • Installing torch (2.0.1)
#10 41.97   • Installing typer (0.7.0)
#10 42.66   • Installing typing-inspect (0.8.0)
#10 43.39   • Installing xlsxwriter (3.1.0)
#10 44.94   • Installing yarl (1.9.2)
#10 52.01
#10 52.01   IncompleteRead
#10 52.01
#10 52.01   IncompleteRead(7019 bytes read, 1174 more expected)
#10 52.01
#10 52.01   at /usr/local/lib/python3.11/http/client.py:633 in _safe_read
#10 52.13        629│         IncompleteRead exception can be used to detect the problem.
#10 52.13        630│         """
#10 52.14        631│         data = self.fp.read(amt)
#10 52.14        632│         if len(data) < amt:
#10 52.14     →  633│             raise IncompleteRead(data, amt-len(data))
#10 52.14        634│         return data
#10 52.14        635│
#10 52.14        636│     def _safe_readinto(self, b):
#10 52.14        637│         """Same as _safe_read, but for reading into a buffer."""
#10 52.14
#10 52.14 The following error occurred when trying to handle this error:
#10 52.14
#10 52.14
#10 52.14   IncompleteRead
#10 52.14
#10 52.14   IncompleteRead(0 bytes read)
#10 52.14
#10 52.15   at /usr/local/lib/python3.11/http/client.py:598 in _read_chunked
#10 52.27        594│                     amt -= chunk_left
#10 52.27        595│                 self.chunk_left = 0
#10 52.27        596│             return b''.join(value)
#10 52.27        597│         except IncompleteRead as exc:
#10 52.27     →  598│             raise IncompleteRead(b''.join(value)) from exc
#10 52.28        599│
#10 52.28        600│     def _readinto_chunked(self, b):
#10 52.28        601│         assert self.chunked != _UNKNOWN
#10 52.28        602│         total_bytes = 0
#10 52.28
#10 52.28 The following error occurred when trying to handle this error:
#10 52.28
#10 52.28
#10 52.28   ProtocolError
#10 52.28
#10 52.28   ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))
#10 52.29
#10 52.29   at /usr/local/lib/python3.11/site-packages/urllib3/response.py:461 in _error_catcher
#10 52.36       457│                 raise ReadTimeoutError(self._pool, None, "Read timed out.")
#10 52.36       458│
#10 52.36       459│             except (HTTPException, SocketError) as e:
#10 52.36       460│                 # This includes IncompleteRead.
#10 52.36     → 461│                 raise ProtocolError("Connection broken: %r" % e, e)
#10 52.36       462│
#10 52.36       463│             # If no exception is thrown, we should avoid cleaning up
#10 52.37       464│             # unnecessarily.
#10 52.37       465│             clean_exit = True
#10 52.37
------
Dockerfile:9
--------------------
   7 |     RUN pip3 install poetry
   8 |     RUN python3 -m poetry config virtualenvs.create false
   9 | >>> RUN python3 -m poetry install
  10 |     RUN python3 -m pip install --force streamlit sentence_transformers # Temp fix, see pyproject.toml
  11 |     RUN python3 -m pip uninstall -y llama-cpp-python
--------------------
error: failed to solve: rpc error: code = Unknown desc = process "/bin/sh -c python3 -m poetry install" did not complete successfully: exit code: 1

Expected behavior

A docker image should be build from the command :

docker build .
@hippalectryon-0
Copy link
Contributor

Most likely fixed in #80

@mlynar-czyk
Copy link
Contributor Author

I'm waiting for the merge. It did not work from your better-docker branch a1e3108.
Thank you

[+] Building 256.7s (12/17)
 => [internal] load build definition from Dockerfile                                       0.1s 
 => => transferring dockerfile: 1.56kB                                                     0.0s 
 => [internal] load .dockerignore                                                          0.1s 
 => => transferring context: 65B                                                           0.0s 
 => [internal] load metadata for docker.io/library/python:3.11-slim                        1.7s 
 => [python-base 1/1] FROM docker.io/library/python:3.11-slim@sha256:551c9529e77896518ac5  6.3s 
 => => resolve docker.io/library/python:3.11-slim@sha256:551c9529e77896518ac5693d7e98ee5e  0.1s 
 => => sha256:551c9529e77896518ac5693d7e98ee5e12051d625de450ac2a68da1eae1 1.65kB / 1.65kB  0.0s 
 => => sha256:dcca7339f0426d2fdb33e8fbbe05cca4b39af30430602c8c894822cf81d 1.37kB / 1.37kB  0.0s 
 => => sha256:56dd444d312fcba97f3a1d1293c1bf446163c5a023ab18823cf1c5ee488 6.83kB / 6.83kB  0.0s 
 => => sha256:9e3ea8720c6de96cc9ad544dddc695a3ab73f5581c5d954e0504cc4f8 31.40MB / 31.40MB  1.1s 
 => => sha256:fe9f5cfcf49b03ec591210966a6e78b0cee3d61048a1b602e152a52941e 1.08MB / 1.08MB  0.3s 
 => => sha256:cbf438db4e3da6770b5df432eb8cdbbc34269a21299ac421b2f6053f8 11.94MB / 11.94MB  1.2s 
 => => sha256:eb097188185be91b170a078c50fb318cdb72ae32c00ac11e59cef3a15fe8d7d 243B / 243B  0.6s 
 => => sha256:a14e8556ab938fc13ee07335fe15696cc4aad4986c58dafbd72b26b9a65 3.37MB / 3.37MB  0.9s 
 => => extracting sha256:9e3ea8720c6de96cc9ad544dddc695a3ab73f5581c5d954e0504cc4f80fb5e5c  2.6s 
 => => extracting sha256:fe9f5cfcf49b03ec591210966a6e78b0cee3d61048a1b602e152a52941e9816d  0.2s 
 => => extracting sha256:cbf438db4e3da6770b5df432eb8cdbbc34269a21299ac421b2f6053f8c84323c  1.0s 
 => => extracting sha256:eb097188185be91b170a078c50fb318cdb72ae32c00ac11e59cef3a15fe8d7d8  0.0s 
 => => extracting sha256:a14e8556ab938fc13ee07335fe15696cc4aad4986c58dafbd72b26b9a650effe  0.5s 
 => [internal] load build context                                                          0.0s 
 => => transferring context: 762B                                                          0.0s 
 => [builder-base 1/9] RUN apt-get update && apt-get install -y build-essential git       48.4s 
 => [builder-base 2/9] RUN pip install "poetry==1.4.2"                                    25.5s 
 => [builder-base 3/9] WORKDIR /srv                                                        0.1s 
 => [builder-base 4/9] RUN git clone https://github.com/su77ungr/CASALIOY.git              2.4s 
 => [builder-base 5/9] WORKDIR CASALIOY                                                    0.1s 
 => [builder-base 6/9] RUN pip install --upgrade setuptools virtualenv                     7.2s 
 => ERROR [builder-base 7/9] RUN poetry install --with GUI,LLM --without dev --sync      164.9s 
------
 > [builder-base 7/9] RUN poetry install --with GUI,LLM --without dev --sync:
#11 1.444 Creating virtualenv casalioy in /srv/CASALIOY/.venv
#11 2.711 Installing dependencies from lock file
#11 7.474
#11 7.474 Package operations: 165 installs, 0 updates, 0 removals
#11 7.474 
#11 7.476   • Installing pycparser (2.21)
#11 7.476   • Installing six (1.16.0)
#11 8.013   • Installing attrs (23.1.0)
#11 8.013   • Installing cffi (1.15.1)
#11 8.016   • Installing idna (3.4)
#11 8.018   • Installing markupsafe (2.1.2)
#11 8.018   • Installing numpy (1.23.5)
#11 8.020   • Installing pyrsistent (0.19.3)
#11 8.027   • Installing python-dateutil (2.8.2)
#11 8.033   • Installing pytz (2023.3)
#11 8.057   • Installing sniffio (1.3.0)
#11 8.060   • Installing tzdata (2023.3)
#11 15.22   • Installing anyio (3.6.2)
#11 15.22   • Installing certifi (2023.5.7)
#11 15.22   • Installing charset-normalizer (3.1.0)
#11 15.23   • Installing commonmark (0.9.1)
#11 15.23   • Installing cryptography (40.0.2)
#11 15.23   • Installing decorator (5.1.1)
#11 15.23   • Installing entrypoints (0.4)
#11 15.23   • Installing h11 (0.14.0)
#11 15.24   • Installing jinja2 (3.1.2)
#11 15.24   • Installing jsonschema (4.17.3)
#11 15.25   • Installing mpmath (1.3.0)
#11 15.26   • Installing olefile (0.46)
#11 15.48 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10    
#11 15.53 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10    
#11 15.86   • Installing packaging (23.1)
#11 16.03   • Installing pandas (1.5.3)
#11 16.25   • Installing pygments (2.15.1)
#11 16.40   • Installing pytz-deprecation-shim (0.1.0.post0)
#11 16.67   • Installing soupsieve (2.4.1)
#11 16.68   • Installing toolz (0.12.0)
#11 16.74   • Installing urllib3 (1.26.15)
#11 16.76   • Installing zipp (3.15.0)
#11 23.63   • Installing altair (4.2.2)
#11 23.64   • Installing beautifulsoup4 (4.12.2)
#11 23.64   • Installing blinker (1.6.2)
#11 23.64   • Installing cachetools (5.3.0)
#11 23.64   • Installing click (8.1.3)
#11 23.64   • Installing colorclass (2.2.2)
#11 23.65   • Installing contourpy (1.0.7)
#11 23.65   • Installing cycler (0.11.0)
#11 23.65   • Installing easygui (0.98.3)
#11 23.66   • Installing filelock (3.12.0)
#11 23.66   • Installing fonttools (4.39.4)
#11 23.67   • Installing frozenlist (1.3.3)
#11 23.89 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10    
#11 24.02 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10    
#11 24.31   • Installing fsspec (2023.5.0)
#11 24.34   • Installing hpack (4.0.0)
#11 24.43   • Installing httpcore (0.16.3)
#11 24.46   • Installing hyperframe (6.0.1)
#11 24.62   • Installing importlib-metadata (6.6.0)
#11 24.73   • Installing kiwisolver (1.4.4)
#11 24.92   • Installing markdown (3.4.3)
#11 25.10   • Installing marshmallow (3.19.0)
#11 25.18   • Installing more-itertools (9.1.0)
#11 25.20   • Installing msoffcrypto-tool (5.0.1)
#11 25.30   • Installing multidict (6.0.4)
#11 25.59   • Installing mypy-extensions (1.0.0)
#11 25.62   • Installing networkx (3.1)
#11 25.96   • Installing pcodedmp (1.2.6)
#11 26.03   • Installing pillow (9.5.0)
#11 26.19   • Installing protobuf (4.23.0)
#11 26.22   • Installing pyarrow (12.0.0)
#11 26.39   • Installing pympler (1.0.1)
#11 26.39   • Installing pyparsing (2.4.7)
#11 26.42   • Installing pyyaml (6.0)
#11 26.61   • Installing requests (2.30.0)
#11 26.84   • Installing rfc3986 (1.5.0)
#11 27.21   • Installing rich (13.0.1)
#11 27.65   • Installing sympy (1.12)
#11 27.71   • Installing tenacity (8.2.2)
#11 28.26   • Installing toml (0.10.2)
#11 28.43   • Installing tqdm (4.65.0)
#11 28.52   • Installing typing-extensions (4.5.0)
#11 28.72   • Installing tzlocal (4.2)
#11 28.97   • Installing validators (0.20.0)
#11 29.07   • Installing watchdog (3.0.0)
#11 29.20   • Installing wrapt (1.14.1)
#11 44.29   • Installing aiosignal (1.3.1)
#11 44.29   • Installing async-timeout (4.0.2)
#11 44.29   • Installing backoff (2.2.1)
#11 44.29   • Installing deprecated (1.2.13)
#11 44.30   • Installing et-xmlfile (1.1.0)
#11 44.30   • Installing faker (18.9.0)
#11 44.30   • Installing favicon (0.7.0)
#11 44.31   • Installing greenlet (2.0.2)
#11 44.31   • Installing grpcio (1.54.2)
#11 44.31   • Installing h2 (4.1.0)
#11 44.31   • Installing htbuilder (0.6.1)
#11 44.32   • Installing httpx (0.23.3)
#11 44.53 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10    
#11 44.55 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10    
#11 45.09   • Installing huggingface-hub (0.14.1)
#11 45.12   • Installing joblib (1.2.0)
#11 45.13   • Installing lark-parser (0.12.0)
#11 45.14   • Installing lxml (4.9.2)
#11 45.18   • Installing marshmallow-enum (1.5.1)
#11 45.25   • Installing matplotlib (3.7.1)
#11 45.46   • Installing monotonic (1.6)
#11 46.11   • Installing oletools (0.60.1)
#11 46.12   • Installing pydantic (1.10.7)
#11 46.34   • Installing pymdown-extensions (10.0.1)
#11 47.55   • Installing regex (2023.5.5)
#11 47.94   • Installing requests-file (1.5.1)
#11 48.10   • Installing scipy (1.10.1)
#11 48.73   • Installing streamlit (1.22.0 0b7fb1c)
#11 48.87   • Installing threadpoolctl (3.1.0)
#11 49.51   • Installing tokenizers (0.13.3)
#11 49.88   • Installing torch (2.0.1)
#11 49.98   • Installing typer (0.7.0)
#11 51.02   • Installing typing-inspect (0.8.0)
#11 51.10   • Installing xlsxwriter (3.1.0)
#11 51.75   • Installing yarl (1.9.2)
#11 68.31
#11 68.31   IncompleteRead
#11 68.31
#11 68.31   IncompleteRead(2399 bytes read, 5794 more expected)
#11 68.31
#11 68.31   at /usr/local/lib/python3.11/http/client.py:633 in _safe_read
#11 68.46        629│         IncompleteRead exception can be used to detect the problem.       
#11 68.46        630│         """
#11 68.47        631│         data = self.fp.read(amt)
#11 68.47        632│         if len(data) < amt:
#11 68.47     →  633│             raise IncompleteRead(data, amt-len(data))
#11 68.47        634│         return data
#11 68.47        635│
#11 68.47        636│     def _safe_readinto(self, b):
#11 68.47        637│         """Same as _safe_read, but for reading into a buffer."""
#11 68.47
#11 68.47 The following error occurred when trying to handle this error:
#11 68.47
#11 68.47
#11 68.47   IncompleteRead
#11 68.47
#11 68.47   IncompleteRead(0 bytes read)
#11 68.47
#11 68.47   at /usr/local/lib/python3.11/http/client.py:598 in _read_chunked
#11 68.62        594│                     amt -= chunk_left
#11 68.62        595│                 self.chunk_left = 0
#11 68.62        596│             return b''.join(value)
#11 68.62        597│         except IncompleteRead as exc:
#11 68.62     →  598│             raise IncompleteRead(b''.join(value)) from exc
#11 68.62        599│
#11 68.62        600│     def _readinto_chunked(self, b):
#11 68.62        601│         assert self.chunked != _UNKNOWN
#11 68.62        602│         total_bytes = 0
#11 68.62
#11 68.63 The following error occurred when trying to handle this error:
#11 68.63
#11 68.64
#11 68.64   ProtocolError
#11 68.64
#11 68.64   ('Connection broken: IncompleteRead(0 bytes read)', IncompleteRead(0 bytes read))   
#11 68.64
#11 68.64   at /usr/local/lib/python3.11/site-packages/urllib3/response.py:461 in _error_catcher#11 68.75       457│                 raise ReadTimeoutError(self._pool, None, "Read timed out.")#11 68.75       458│
#11 68.75       459│             except (HTTPException, SocketError) as e:
#11 68.75       460│                 # This includes IncompleteRead.
#11 68.75     → 461│                 raise ProtocolError("Connection broken: %r" % e, e)        
#11 68.75       462│
#11 68.75       463│             # If no exception is thrown, we should avoid cleaning up       
#11 68.75       464│             # unnecessarily.
#11 68.75       465│             clean_exit = True
#11 68.75
------
Dockerfile:28
--------------------
  26 |     WORKDIR CASALIOY
  27 |     RUN pip install --upgrade setuptools virtualenv
  28 | >>> RUN poetry install --with GUI,LLM --without dev --sync
  29 |     RUN . .venv/bin/activate && pip install --force torch torchvision --index-url https://download.pytorch.org/whl/cpu  # CPU-only torch for sentence_transformers
  30 |     RUN . .venv/bin/activate && pip install --force streamlit # Temp fix, see pyproject.toml
--------------------
error: failed to solve: rpc error: code = Unknown desc = process "/bin/sh -c poetry install --with GUI,LLM --without dev --sync" did not complete successfully: exit code: 1

@hippalectryon-0
Copy link
Contributor

hippalectryon-0 commented May 17, 2023

After looking more into your error: it looks like you have a network error when installing yarl. This is most likely not related to casalioy itself, the dockerfile runs file on my two computers.

Nevertheless I can try to help. What's your docker version ?

EDIT: I think I know the issue: if you're using the Dockerfile from the MR that's not yet merged, you also need to change the pulling url from

RUN git clone https://github.com/su77ungr/CASALIOY.git
WORKDIR CASALIOY

to

RUN git clone https://github.com/hippalectryon-0/CASALIOY.git
WORKDIR CASALIOY
RUN git checkout better-docker

@mlynar-czyk
Copy link
Contributor Author

Docker version 23.0.5, build bc4487a

The su77ungr/casalioy:stable image worked fine.

I made the change, yarl still seems to be a bottleneck :

[+] Building 156.4s (13/18)
 => [internal] load .dockerignore                                                                   0.0s 
 => => transferring context: 65B                                                                    0.0s 
 => [internal] load build definition from Dockerfile                                                0.1s 
 => => transferring dockerfile: 1.60kB                                                              0.0s 
 => [internal] load metadata for docker.io/library/python:3.11-slim                                 0.6s 
 => [internal] load build context                                                                   0.0s 
 => => transferring context: 33B                                                                    0.0s 
 => CACHED [python-base 1/1] FROM docker.io/library/python:3.11-slim@sha256:551c9529e77896518ac569  0.0s 
 => CACHED [builder-base  1/10] RUN apt-get update && apt-get install -y build-essential git        0.0s 
 => CACHED [builder-base  2/10] RUN pip install "poetry==1.4.2"                                     0.0s 
 => CACHED [builder-base  3/10] WORKDIR /srv                                                        0.0s 
 => [builder-base  4/10] RUN git clone https://github.com/hippalectryon-0/CASALIOY.git              1.5s 
 => [builder-base  5/10] WORKDIR CASALIOY                                                           0.1s 
 => [builder-base  6/10] RUN git checkout better-docker                                             0.6s 
 => [builder-base  7/10] RUN pip install --upgrade setuptools virtualenv                            5.3s 
 => ERROR [builder-base  8/10] RUN poetry install --with GUI,LLM --without dev --sync             148.4s 
------
 > [builder-base  8/10] RUN poetry install --with GUI,LLM --without dev --sync:
#12 1.223 Creating virtualenv casalioy in /srv/CASALIOY/.venv
#12 2.369 Installing dependencies from lock file
#12 6.015
#12 6.015 Package operations: 169 installs, 0 updates, 0 removals
#12 6.017
#12 6.019   • Installing pycparser (2.21)
#12 6.020   • Installing six (1.16.0)
#12 6.495   • Installing attrs (23.1.0)
#12 6.495   • Installing cffi (1.15.1)
#12 6.498   • Installing idna (3.4)
#12 6.501   • Installing markupsafe (2.1.2)
#12 6.508   • Installing numpy (1.23.5)
#12 6.512   • Installing pyrsistent (0.19.3)
#12 6.516   • Installing python-dateutil (2.8.2)
#12 6.521   • Installing pytz (2023.3)
#12 6.528   • Installing smmap (5.0.0)
#12 6.534   • Installing sniffio (1.3.0)
#12 6.551   • Installing tzdata (2023.3)
#12 6.819 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 12.80   • Installing anyio (3.6.2)
#12 12.80   • Installing certifi (2023.5.7)
#12 12.80   • Installing charset-normalizer (3.1.0)
#12 12.80   • Installing commonmark (0.9.1)
#12 12.81   • Installing cryptography (40.0.2)
#12 12.81   • Installing decorator (5.1.1)
#12 12.81   • Installing entrypoints (0.4)
#12 12.82   • Installing gitdb (4.0.10)
#12 12.82   • Installing h11 (0.14.0)
#12 12.82   • Installing jinja2 (3.1.2)
#12 12.83   • Installing jsonschema (4.17.3)
#12 12.83   • Installing mpmath (1.3.0)
#12 13.08 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 13.09 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 13.37   • Installing olefile (0.46)
#12 13.46   • Installing packaging (23.1)
#12 13.85   • Installing pandas (1.5.3)
#12 13.98   • Installing pygments (2.15.1)
#12 14.23   • Installing pytz-deprecation-shim (0.1.0.post0)
#12 14.30   • Installing soupsieve (2.4.1)
#12 14.35   • Installing toolz (0.12.0)
#12 14.38   • Installing urllib3 (1.26.15)
#12 14.39   • Installing zipp (3.15.0)
#12 20.62   • Installing altair (4.2.2)
#12 20.62   • Installing beautifulsoup4 (4.12.2)
#12 20.62   • Installing blinker (1.6.2)
#12 20.63   • Installing cachetools (5.3.0)
#12 20.63   • Installing click (8.1.3)
#12 20.63   • Installing colorclass (2.2.2)
#12 20.63   • Installing contourpy (1.0.7)
#12 20.64   • Installing cycler (0.11.0)
#12 20.64   • Installing easygui (0.98.3)
#12 20.65   • Installing filelock (3.12.0)
#12 20.65   • Installing fonttools (4.39.4)
#12 20.65   • Installing frozenlist (1.3.3)
#12 20.86 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 20.98 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 21.23   • Installing fsspec (2023.5.0)
#12 21.31   • Installing gitpython (3.1.31)
#12 21.35   • Installing hpack (4.0.0)
#12 21.44   • Installing httpcore (0.16.3)
#12 21.48   • Installing hyperframe (6.0.1)
#12 21.77   • Installing importlib-metadata (6.6.0)
#12 21.81   • Installing kiwisolver (1.4.4)
#12 22.10   • Installing markdown (3.4.3)
#12 22.10   • Installing marshmallow (3.19.0)
#12 22.13   • Installing more-itertools (9.1.0)
#12 22.14   • Installing msoffcrypto-tool (5.0.1)
#12 22.46   • Installing multidict (6.0.4)
#12 22.65   • Installing mypy-extensions (1.0.0)
#12 22.86   • Installing networkx (3.1)
#12 22.89   • Installing pcodedmp (1.2.6)
#12 23.07   • Installing pillow (9.5.0)
#12 23.18   • Installing protobuf (4.23.0)
#12 23.26   • Installing pyarrow (12.0.0)
#12 23.34   • Installing pydeck (0.8.0)
#12 23.45   • Installing pympler (1.0.1)
#12 23.51   • Installing pyparsing (2.4.7)
#12 23.71   • Installing pyyaml (6.0)
#12 23.74   • Installing requests (2.30.0)
#12 24.21   • Installing rfc3986 (1.5.0)
#12 24.77   • Installing rich (13.0.1)
#12 25.04   • Installing sympy (1.12)
#12 25.14   • Installing tenacity (8.2.2)
#12 25.48   • Installing toml (0.10.2)
#12 25.57   • Installing tornado (6.3.2)
#12 25.99   • Installing tqdm (4.65.0)
#12 26.16   • Installing typing-extensions (4.5.0)
#12 26.19   • Installing tzlocal (4.2)
#12 26.77   • Installing validators (0.20.0)
#12 26.87   • Installing watchdog (3.0.0)
#12 27.41   • Installing wrapt (1.14.1)
#12 40.86   • Installing aiosignal (1.3.1)
#12 40.86   • Installing async-timeout (4.0.2)
#12 40.86   • Installing backoff (2.2.1)
#12 40.86   • Installing deprecated (1.2.13)
#12 40.86   • Installing et-xmlfile (1.1.0)
#12 40.86   • Installing favicon (0.7.0)
#12 40.87   • Installing greenlet (2.0.2)
#12 40.87   • Installing grpcio (1.54.2)
#12 40.87   • Installing h2 (4.1.0)
#12 40.87   • Installing htbuilder (0.6.1)
#12 40.88   • Installing httpx (0.23.3)
#12 41.10 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 41.13 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 41.64   • Installing huggingface-hub (0.14.1)
#12 41.66   • Installing joblib (1.2.0)
#12 41.69   • Installing lark-parser (0.12.0)
#12 41.72   • Installing lxml (4.9.2)
#12 41.72   • Installing marshmallow-enum (1.5.1)
#12 41.81   • Installing matplotlib (3.7.1)
#12 42.04   • Installing monotonic (1.6)
#12 42.56   • Installing oletools (0.60.1)
#12 42.69   • Installing pydantic (1.10.7)
#12 42.91   • Installing pymdown-extensions (10.0.1)
#12 43.92   • Installing regex (2023.5.5)
#12 44.33   • Installing requests-file (1.5.1)
#12 44.60   • Installing scipy (1.10.1)
#12 45.01   • Installing streamlit (1.22.0 0b7fb1c)
#12 45.03   • Installing threadpoolctl (3.1.0)
#12 45.66   • Installing tokenizers (0.13.3)
#12 45.98   • Installing torch (2.0.1)
#12 46.09   • Installing typer (0.7.0)
#12 47.04   • Installing typing-inspect (0.8.0)
#12 47.34   • Installing xlsxwriter (3.1.0)
#12 47.65   • Installing yarl (1.9.2)
#12 139.8
#12 139.8   RuntimeError
#12 139.8
#12 139.8   Hash for torch (2.0.1) from archive torch-2.0.1-cp311-cp311-manylinux1_x86_64.whl not found in known hashes (was: sha256:b3db0394cda08ad33679d3a9ec5dee2843ab70269b264795808ee505eb2696fa)
#12 139.8
#12 139.8   at /usr/local/lib/python3.11/site-packages/poetry/installation/executor.py:769 in _validate_archive_hash
#12 139.9       765│         archive_hash: str = "sha256:" + get_file_hash(archive)
#12 139.9       766│         known_hashes = {f["hash"] for f in package.files if f["file"] == archive.name}
#12 139.9       767│
#12 139.9       768│         if archive_hash not in known_hashes:
#12 139.9     → 769│             raise RuntimeError(
#12 139.9       770│                 f"Hash for {package} from archive {archive.name} not found in"      
#12 139.9       771│                 f" known hashes (was: {archive_hash})"
#12 139.9       772│             )
#12 139.9       773│
#12 139.9
------
Dockerfile:29
--------------------
  27 |     RUN git checkout better-docker
  28 |     RUN pip install --upgrade setuptools virtualenv
  29 | >>> RUN poetry install --with GUI,LLM --without dev --sync
  30 |     RUN . .venv/bin/activate && pip install --force torch torchvision --index-url https://download.pytorch.org/whl/cpu  # CPU-only torch for sentence_transformers
  31 |     RUN . .venv/bin/activate && pip install --force streamlit # Temp fix, see pyproject.toml      
--------------------
error: failed to solve: rpc error: code = Unknown desc = process "/bin/sh -c poetry install --with GUI,LLM --without dev --sync" did not complete successfully: exit code: 1

I'll try tomorrow again.

@hippalectryon-0
Copy link
Contributor

hippalectryon-0 commented May 17, 2023

On my computers the yarl install always takes a very long time (tens of seconds), but eventually succeeds. This really sounds like a network issue on the yarn install.

Edit: actually, it looks like you get a new error with the changes in the dockerfile ! Looks like an issue with the poetry cache.

@hippalectryon-0
Copy link
Contributor

@mlynar-czyk Can you rerun the latest version with --no-cache ?

@mlynar-czyk
Copy link
Contributor Author

Nope. The docker build --no-cache . option didn't affect the issue. I was tricked by the time elapsed on the yarl install just before the second error.

[+] Building 142.7s (13/18)
 => [internal] load build definition from Dockerfile                                                                                                                                                                        0.0s 
 => => transferring dockerfile: 1.60kB                                                                                                                                                                                      0.0s 
 => [internal] load .dockerignore                                                                                                                                                                                           0.1s 
 => => transferring context: 65B                                                                                                                                                                                            0.0s 
 => [internal] load metadata for docker.io/library/python:3.11-slim                                                                                                                                                         0.9s 
 => [internal] load build context                                                                                                                                                                                           0.0s 
 => => transferring context: 33B                                                                                                                                                                                            0.0s 
 => CACHED [python-base 1/1] FROM docker.io/library/python:3.11-slim@sha256:551c9529e77896518ac5693d7e98ee5e12051d625de450ac2a68da1eae15ec87                                                                                0.0s 
 => [builder-base  1/10] RUN apt-get update && apt-get install -y build-essential git                                                                                                                                      41.1s 
 => [builder-base  2/10] RUN pip install "poetry==1.4.2"                                                                                                                                                                   19.2s 
 => [builder-base  3/10] WORKDIR /srv                                                                                                                                                                                       0.1s 
 => [builder-base  4/10] RUN git clone https://github.com/hippalectryon-0/CASALIOY.git                                                                                                                                      1.7s 
 => [builder-base  5/10] WORKDIR CASALIOY                                                                                                                                                                                   0.1s 
 => [builder-base  6/10] RUN git checkout better-docker                                                                                                                                                                     0.5s 
 => [builder-base  7/10] RUN pip install --upgrade setuptools virtualenv                                                                                                                                                    5.4s 
 => ERROR [builder-base  8/10] RUN poetry install --with GUI,LLM --without dev --sync                                                                                                                                      73.6s 
------
 > [builder-base  8/10] RUN poetry install --with GUI,LLM --without dev --sync:
#12 1.190 Creating virtualenv casalioy in /srv/CASALIOY/.venv
#12 2.353 Installing dependencies from lock file
#12 5.955
#12 5.955 Package operations: 169 installs, 0 updates, 0 removals
#12 5.956
#12 5.958   • Installing pycparser (2.21)
#12 5.959   • Installing six (1.16.0)
#12 6.417   • Installing attrs (23.1.0)
#12 6.418   • Installing cffi (1.15.1)
#12 6.418   • Installing idna (3.4)
#12 6.422   • Installing markupsafe (2.1.2)
#12 6.426   • Installing numpy (1.23.5)
#12 6.430   • Installing pyrsistent (0.19.3)
#12 6.434   • Installing python-dateutil (2.8.2)
#12 6.444   • Installing pytz (2023.3)
#12 6.454   • Installing smmap (5.0.0)
#12 6.459   • Installing sniffio (1.3.0)
#12 6.470   • Installing tzdata (2023.3)
#12 6.793 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 12.52   • Installing anyio (3.6.2)
#12 12.52   • Installing certifi (2023.5.7)
#12 12.52   • Installing charset-normalizer (3.1.0)
#12 12.53   • Installing commonmark (0.9.1)
#12 12.53   • Installing cryptography (40.0.2)
#12 12.54   • Installing decorator (5.1.1)
#12 12.54   • Installing entrypoints (0.4)
#12 12.54   • Installing gitdb (4.0.10)
#12 12.55   • Installing h11 (0.14.0)
#12 12.56   • Installing jinja2 (3.1.2)
#12 12.57   • Installing jsonschema (4.17.3)
#12 12.57   • Installing mpmath (1.3.0)
#12 12.80 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 12.81 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 13.11   • Installing olefile (0.46)
#12 13.15   • Installing packaging (23.1)
#12 13.48   • Installing pandas (1.5.3)
#12 13.72   • Installing pygments (2.15.1)
#12 13.76   • Installing pytz-deprecation-shim (0.1.0.post0)
#12 13.84   • Installing soupsieve (2.4.1)
#12 14.00   • Installing toolz (0.12.0)
#12 14.01   • Installing urllib3 (1.26.15)
#12 14.07   • Installing zipp (3.15.0)
#12 20.39   • Installing altair (4.2.2)
#12 20.39   • Installing beautifulsoup4 (4.12.2)
#12 20.39   • Installing blinker (1.6.2)
#12 20.39   • Installing cachetools (5.3.0)
#12 20.39   • Installing click (8.1.3)
#12 20.39   • Installing colorclass (2.2.2)
#12 20.40   • Installing contourpy (1.0.7)
#12 20.40   • Installing cycler (0.11.0)
#12 20.40   • Installing easygui (0.98.3)
#12 20.41   • Installing filelock (3.12.0)
#12 20.41   • Installing fonttools (4.39.4)
#12 20.41   • Installing frozenlist (1.3.3)
#12 20.64 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 20.64 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 21.01   • Installing fsspec (2023.5.0)
#12 21.06   • Installing gitpython (3.1.31)
#12 21.16   • Installing hpack (4.0.0)
#12 21.28   • Installing httpcore (0.16.3)
#12 21.35   • Installing hyperframe (6.0.1)
#12 21.50   • Installing importlib-metadata (6.6.0)
#12 21.57   • Installing kiwisolver (1.4.4)
#12 21.79   • Installing markdown (3.4.3)
#12 21.98   • Installing marshmallow (3.19.0)
#12 22.10   • Installing more-itertools (9.1.0)
#12 22.15   • Installing msoffcrypto-tool (5.0.1)
#12 22.36   • Installing multidict (6.0.4)
#12 22.43   • Installing mypy-extensions (1.0.0)
#12 22.85   • Installing networkx (3.1)
#12 22.94   • Installing pcodedmp (1.2.6)
#12 22.98   • Installing pillow (9.5.0)
#12 23.00   • Installing protobuf (4.23.0)
#12 23.03   • Installing pyarrow (12.0.0)
#12 23.18   • Installing pydeck (0.8.0)
#12 23.26   • Installing pympler (1.0.1)
#12 23.38   • Installing pyparsing (2.4.7)
#12 23.43   • Installing pyyaml (6.0)
#12 23.75   • Installing requests (2.30.0)
#12 24.11   • Installing rfc3986 (1.5.0)
#12 24.72   • Installing rich (13.0.1)
#12 24.91   • Installing sympy (1.12)
#12 24.98   • Installing tenacity (8.2.2)
#12 25.13   • Installing toml (0.10.2)
#12 25.41   • Installing tornado (6.3.2)
#12 25.79   • Installing tqdm (4.65.0)
#12 25.90   • Installing typing-extensions (4.5.0)
#12 25.96   • Installing tzlocal (4.2)
#12 26.50   • Installing validators (0.20.0)
#12 26.68   • Installing watchdog (3.0.0)
#12 27.22   • Installing wrapt (1.14.1)
#12 40.97   • Installing aiosignal (1.3.1)
#12 40.97   • Installing async-timeout (4.0.2)
#12 40.97   • Installing backoff (2.2.1)
#12 40.97   • Installing deprecated (1.2.13)
#12 40.98   • Installing et-xmlfile (1.1.0)
#12 40.98   • Installing faker (18.9.0)
#12 40.98   • Installing favicon (0.7.0)
#12 40.98   • Installing greenlet (2.0.2)
#12 40.99   • Installing grpcio (1.54.2)
#12 40.99   • Installing h2 (4.1.0)
#12 40.99   • Installing htbuilder (0.6.1)
#12 41.00   • Installing httpx (0.23.3)
#12 41.23 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 41.24 Connection pool is full, discarding connection: pypi.org. Connection pool size: 10
#12 41.75   • Installing huggingface-hub (0.14.1)
#12 41.77   • Installing joblib (1.2.0)
#12 41.78   • Installing lark-parser (0.12.0)
#12 41.80   • Installing lxml (4.9.2)
#12 41.85   • Installing marshmallow-enum (1.5.1)
#12 42.00   • Installing matplotlib (3.7.1)
#12 42.19   • Installing monotonic (1.6)
#12 42.53   • Installing oletools (0.60.1)
#12 42.71   • Installing pydantic (1.10.7)
#12 43.09   • Installing pymdown-extensions (10.0.1)
#12 43.83   • Installing regex (2023.5.5)
#12 44.48   • Installing requests-file (1.5.1)
#12 44.76   • Installing scipy (1.10.1)
#12 45.16   • Installing streamlit (1.22.0 0b7fb1c)
#12 45.31   • Installing threadpoolctl (3.1.0)
#12 45.89   • Installing tokenizers (0.13.3)
#12 46.14   • Installing torch (2.0.1)
#12 46.14   • Installing typer (0.7.0)
#12 47.06   • Installing typing-inspect (0.8.0)
#12 47.27   • Installing xlsxwriter (3.1.0)
#12 47.89   • Installing yarl (1.9.2)
#12 56.45
#12 56.45   ValueError
#12 56.45
#12 56.45   invalid literal for int() with base 16: b''
#12 56.45
#12 56.45   at /usr/local/lib/python3.11/http/client.py:533 in _read_next_chunk_size
#12 56.58        529│         i = line.find(b";")
#12 56.58        530│         if i >= 0:
#12 56.59        531│             line = line[:i] # strip chunk-extensions
#12 56.59        532│         try:
#12 56.59     →  533│             return int(line, 16)
#12 56.59        534│         except ValueError:
#12 56.59        535│             # close the connection as protocol synchronisation is
#12 56.59        536│             # probably lost
#12 56.59        537│             self._close_conn()
#12 56.59
#12 56.59 The following error occurred when trying to handle this error:
#12 56.59
#12 56.60
#12 56.60   IncompleteRead
#12 56.60
#12 56.60   IncompleteRead(0 bytes read)
#12 56.60
#12 56.60   at /usr/local/lib/python3.11/http/client.py:568 in _get_chunk_left
#12 56.75        564│                 self._safe_read(2)  # toss the CRLF at the end of the chunk
#12 56.75        565│             try:
#12 56.75        566│                 chunk_left = self._read_next_chunk_size()
#12 56.75        567│             except ValueError:
#12 56.75     →  568│                 raise IncompleteRead(b'')
#12 56.75        569│             if chunk_left == 0:
#12 56.76        570│                 # last chunk: 1*("0") [ chunk-extension ] CRLF
#12 56.76        571│                 self._read_and_discard_trailer()
#12 56.76        572│                 # we read everything; close the "file"
#12 56.76
#12 56.76 The following error occurred when trying to handle this error:
#12 56.76
#12 56.76
#12 56.76   IncompleteRead
#12 56.76
#12 56.76   IncompleteRead(3828 bytes read)
#12 56.76
#12 56.76   at /usr/local/lib/python3.11/http/client.py:598 in _read_chunked
#12 56.90        594│                     amt -= chunk_left
#12 56.90        595│                 self.chunk_left = 0
#12 56.90        596│             return b''.join(value)
#12 56.90        597│         except IncompleteRead as exc:
#12 56.91     →  598│             raise IncompleteRead(b''.join(value)) from exc
#12 56.91        599│
#12 56.91        600│     def _readinto_chunked(self, b):
#12 56.91        601│         assert self.chunked != _UNKNOWN
#12 56.91        602│         total_bytes = 0
#12 56.91
#12 56.91 The following error occurred when trying to handle this error:
#12 56.91
#12 56.91
#12 56.91   ProtocolError
#12 56.91
#12 56.91   ('Connection broken: IncompleteRead(3828 bytes read)', IncompleteRead(3828 bytes read))
#12 56.92
#12 56.92   at /usr/local/lib/python3.11/site-packages/urllib3/response.py:461 in _error_catcher
#12 56.99       457│                 raise ReadTimeoutError(self._pool, None, "Read timed out.")
#12 56.99       458│
#12 57.00       459│             except (HTTPException, SocketError) as e:
#12 57.00       460│                 # This includes IncompleteRead.
#12 57.00     → 461│                 raise ProtocolError("Connection broken: %r" % e, e)
#12 57.00       462│
#12 57.00       463│             # If no exception is thrown, we should avoid cleaning up
#12 57.00       464│             # unnecessarily.
#12 57.00       465│             clean_exit = True
#12 57.00
#12 69.75
#12 69.75   RuntimeError
#12 69.75
#12 69.75   Hash for torch (2.0.1) from archive torch-2.0.1-cp311-cp311-manylinux1_x86_64.whl not found in known hashes (was: sha256:062b765540ea9c6863b9f5174bfce7974b952aff9b93d13ad00f741c8975a479)
#12 69.75
#12 69.75   at /usr/local/lib/python3.11/site-packages/poetry/installation/executor.py:769 in _validate_archive_hash
#12 69.84       765│         archive_hash: str = "sha256:" + get_file_hash(archive)
#12 69.84       766│         known_hashes = {f["hash"] for f in package.files if f["file"] == archive.name}
#12 69.84       767│
#12 69.84       768│         if archive_hash not in known_hashes:
#12 69.84     → 769│             raise RuntimeError(
#12 69.84       770│                 f"Hash for {package} from archive {archive.name} not found in"
#12 69.84       771│                 f" known hashes (was: {archive_hash})"
#12 69.84       772│             )
#12 69.84       773│
#12 69.84
------
Dockerfile:29
--------------------
  27 |     RUN git checkout better-docker
  28 |     RUN pip install --upgrade setuptools virtualenv
  29 | >>> RUN poetry install --with GUI,LLM --without dev --sync
  30 |     RUN . .venv/bin/activate && pip install --force torch torchvision --index-url https://download.pytorch.org/whl/cpu  # CPU-only torch for sentence_transformers
  31 |     RUN . .venv/bin/activate && pip install --force streamlit # Temp fix, see pyproject.toml
--------------------
error: failed to solve: rpc error: code = Unknown desc = process "/bin/sh -c poetry install --with GUI,LLM --without dev --sync" did not complete successfully: exit code: 1

@su77ungr
Copy link
Owner

su77ungr commented May 17, 2023

Sorry for the inconvenience.

Edit: windows 10 testing now

I'm spinning up some VMs in azure now.

  • Linux (ubuntu 22.04)
  • Windows 10 testing
  • Windows 10 WSL testing

@mlynar-czyk
Copy link
Contributor Author

mlynar-czyk commented May 17, 2023

Don't be sorry.
I'm on a Win10 22H2 with wsl.
Docker version 23.0.5, build bc4487a
The su77ungr/casalioy:stable image worked fine.

Hope to still be able to use it on a Windows workstation. I would like to commit a full working container to export it on a offline computer.

(I did a system reboot too, just in case...)

@su77ungr
Copy link
Owner

su77ungr commented May 17, 2023

Sure, we are planning to offer a package that works plug-in-play with every python ready machine too. Let's fix this first, run tests and I'll hit you up as soon as possible

@hippalectryon-0 sure python:3.11-slim is compatible?

see #84 on bottom

@hippalectryon-0
Copy link
Contributor

sure python:3.11-slim is compatible?

slim is just a version without additional packages. If you need to add anything, just apt install it in the dockerfile. Moreover, the dockerfile produces a perfectly working image on my end, so clearly it can work.

I'm working on another feature rn, but I'll try to pull your latest image to see what happens.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants