Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrading envoy causes JedisException: Could not get a resource from the pool #36695

Open
Vasanthan-R opened this issue Oct 18, 2024 · 1 comment

Comments

@Vasanthan-R
Copy link

Vasanthan-R commented Oct 18, 2024

Hi,

We have a envoy configured for a Redis cluster. The current version of it 1.18.3, and we have observed no issues. Recently, we upgraded it to 1.27.2, and we noticed errors in the clients trying to access the cache. The error is:

redis.clients.jedis.exceptions.JedisConnectionException: Could not get a resource from the pool
Caused by: java.util.NoSuchElementException: Unable to validate object
 at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:502) ~[commons-pool2-2.2.jar:2.2]
 at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:361) ~[commons-pool2-2.2.jar:2.2]
 at redis.clients.util.Pool.getResource(Pool.java:48) ~[ContXJedis-2.8.0.jar:?]

However, I tried adding the below config on top of the existing envoy configuration and the issue got sorted out:

upstream_connection_options:
        tcp_keepalive:
          keepalive_interval: 5
          keepalive_probes: 1
          keepalive_time: 30 

Can anyone explain the reason for this behaviour?

@Vasanthan-R Vasanthan-R added the triage Issue requires triage label Oct 18, 2024
@tyxia tyxia removed the triage Issue requires triage label Oct 18, 2024
@tyxia
Copy link
Member

tyxia commented Oct 18, 2024

@Vasanthan-R from your description , it seems to point to regression.
Would you either (1) do some regression check to see the difference in Envoy between 1.18.3 and 1.27.2. with the clue you found (2) Update to latest version to see if this still occurs.

I can later add the code/domain owner if you don't have luck with either of them above.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants