Tiles cache producing Timeouts

[guillemc23]

Hello! I have been using Titiler as my Tile Server for a web application based on DeckGL. I'm managing very big COGs, so I have deployed a cache which works pretty nicely most of the time.

In some occasions, for example, when I move the map or zoom very quickly, the application starts sending lots of requests and cancelling lots of them too, and it ends up producing TimeoutErrors and CancelledErrors on my tile server as the ones below.

I don't think this is a Titiler problem, but, do you think there's any middleware or configuration somewhere that can help address these errors?

Thanks in advance!

2023-05-23 13:50:59 During handling of the above exception, another exception occurred:
2023-05-23 13:50:59 
2023-05-23 13:50:59 Traceback (most recent call last):
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/cashews/backends/redis/client.py", line 26, in execute_command
2023-05-23 13:50:59     return await super().execute_command(command, *args, **kwargs)
2023-05-23 13:50:59            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/client.py", line 509, in execute_command
2023-05-23 13:50:59     conn = self.connection or await pool.get_connection(command_name, **options)
2023-05-23 13:50:59                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 1607, in get_connection
2023-05-23 13:50:59     await connection.connect()
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 609, in connect
2023-05-23 13:50:59     raise TimeoutError("Timeout connecting to server")
2023-05-23 13:50:59 redis.exceptions.TimeoutError: Timeout connecting to server
2023-05-23 13:50:59 redis: can not execute command: SET
2023-05-23 13:50:59 Traceback (most recent call last):
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 640, in _connect
2023-05-23 13:50:59     reader, writer = await asyncio.open_connection(
2023-05-23 13:50:59                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/asyncio/streams.py", line 48, in open_connection
2023-05-23 13:50:59     transport, _ = await loop.create_connection(
2023-05-23 13:50:59                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/asyncio/base_events.py", line 1034, in create_connection
2023-05-23 13:50:59     infos = await self._ensure_resolved(
2023-05-23 13:50:59             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/asyncio/base_events.py", line 1405, in _ensure_resolved
2023-05-23 13:50:59     return await loop.getaddrinfo(host, port, family=family, type=type,
2023-05-23 13:50:59            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/asyncio/base_events.py", line 864, in getaddrinfo
2023-05-23 13:50:59     return await self.run_in_executor(
2023-05-23 13:50:59            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59 asyncio.exceptions.CancelledError
2023-05-23 13:50:59 
2023-05-23 13:50:59 During handling of the above exception, another exception occurred:
2023-05-23 13:50:59 
2023-05-23 13:50:59 Traceback (most recent call last):
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 603, in connect
2023-05-23 13:50:59     await self.retry.call_with_retry(
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/retry.py", line 59, in call_with_retry
2023-05-23 13:50:59     return await do()
2023-05-23 13:50:59            ^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 639, in _connect
2023-05-23 13:50:59     async with async_timeout.timeout(self.socket_connect_timeout):
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/async_timeout/__init__.py", line 129, in __aexit__
2023-05-23 13:50:59     self._do_exit(exc_type)
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/async_timeout/__init__.py", line 212, in _do_exit
2023-05-23 13:50:59     raise asyncio.TimeoutError
2023-05-23 13:50:59 TimeoutError
2023-05-23 13:50:59 
2023-05-23 13:50:59 During handling of the above exception, another exception occurred:
2023-05-23 13:50:59 
2023-05-23 13:50:59 Traceback (most recent call last):
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/cashews/backends/redis/client.py", line 26, in execute_command
2023-05-23 13:50:59     return await super().execute_command(command, *args, **kwargs)
2023-05-23 13:50:59            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/client.py", line 509, in execute_command
2023-05-23 13:50:59     conn = self.connection or await pool.get_connection(command_name, **options)
2023-05-23 13:50:59                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 1607, in get_connection
2023-05-23 13:50:59     await connection.connect()
2023-05-23 13:50:59   File "/opt/bitnami/python/lib/python3.11/site-packages/redis/asyncio/connection.py", line 609, in connect
2023-05-23 13:50:59     raise TimeoutError("Timeout connecting to server")
2023-05-23 13:50:59 redis.exceptions.TimeoutError: Timeout connecting to server

[sairahul1526]

@guillemc23 did you get any resolution to this?

[guillemc23]

No, I did not. I implemented a workaround by adding some kind of debounce to the way my frontend was requesting new tiles.