Could not get a resource from the pool(SocketTimeoutException:)

Question

I'm running multiple worker threads(around 10) to access the data from the redis Q.
For the i'm using infinte timeout for Jedis Client.

Jedis jedis = pool.getResource();
jedis.getClient().setTimeoutInfinite();

Still i'm getting the error "Could not get a resource from the pool". The stacktrace is given below.

redis.clients.jedis.exceptions.JedisConnectionException: Could not get a resource from the pool
at redis.clients.util.Pool.getResource(Pool.java:22)
at Workers.Worker1.met1(Worker1.java:124)
at Workers.Worker1.work(Worker1.java:108)
at org.gearman.impl.worker.WorkerConnectionController$3.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)  

Caused by: redis.clients.jedis.exceptions.JedisConnectionException: java.net.SocketTimeoutException: connect timed out
at redis.clients.jedis.Connection.connect(Connection.java:124)
at redis.clients.jedis.BinaryClient.connect(BinaryClient.java:54)
at redis.clients.jedis.BinaryJedis.connect(BinaryJedis.java:1657)
at redis.clients.jedis.JedisPool$JedisFactory.makeObject(JedisPool.java:63)
at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:1188)
at redis.clients.util.Pool.getResource(Pool.java:20)
... 6 more  

Caused by: java.net.SocketTimeoutException: connect timed out
at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)
at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)
at java.net.AbstractPlainSocketImpl.connect(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at redis.clients.jedis.Connection.connect(Connection.java:119)
... 11 more

And is your Redis server alive? Can you connect to it from the client box using redis-cli? — Didier Spezia, Oct 24 '12 at 12:36
Yes Redis server is alive and able to connect using redis-cli — Vignesh, Oct 25 '12 at 06:19
I have the same problem. Redis is running. The problem occurs when using JedisPool, and I do `returnResource`. No problem with `Jedis jedis = new Jedis("localhost");`. Have you solved this issue? — Vladimir Prudnikov, Dec 22 '13 at 13:59

score 27 · Answer 1 · answered Jul 17 '13 at 21:31

27

I noticed that this exception can and will be thrown if Redis is not running. Just a heads up.

answered Jul 17 '13 at 21:31

Rick Hanlon II

20,549
7
47
53

cst1992 · Answer 2 · 2016-03-23T08:25:34.940

10

Based on Rick Hanlon's answer, this exception is also thrown if using Redis with Spring Boot.

If you're using Spring Boot, just the dependency of Redis is not enough; you also need to manually download and install Redis on your machine from redis.io, then run it off of a Bash terminal:

me@my_pc:/path/to/redis/dir$ ./src/redis-server ./redis.conf

After running the server, you'll need to add the relevant lines in all your apps that use Redis:

application.properties:

...
spring.redis.host: <yourhost> // usually localhost, but can also be on a LAN
spring.redis.port: <yourport> // usually 6379, but settable in redis.conf

application.yml:

...
spring:
  redis:
    host: <yourhost> // usually localhost, but can also be on a LAN
    port: <yourport> // usually 6379, but settable in redis.conf

edited Mar 23 '16 at 08:25

answered Mar 23 '16 at 08:20

cst1992

3,823
1
29
40

1

Is redis installation needed, even when connecting to remote redis instance? – zookastos May 29 '21 at 01:06
1

@zookastos no it is not – mvd Jul 29 '21 at 15:51
Thanks figured that out later by reading more docs. It was a stupid question though :) – zookastos Jul 29 '21 at 20:18

score 7 · Answer 3 · edited Mar 12 '20 at 16:04

7

Did it happen always or occasionally? If it was occasional, you may want to check the size of your connection pool.

Default connection pool size, if you are using JedisPoolConfig, is 8. This could be too small for your case.

JedisPoolConfig poolConfig = new JedisPoolConfig();
poolConfig.setMaxTotal(128);
jedisPool = new JedisPool(poolConfig, HOST, PORT, ...);

edited Mar 12 '20 at 16:04

Agnibha

613
1
11
20

answered Mar 01 '17 at 23:41

Devs love ZenUML

11,344
8
53
67

Could you pls guide me https://stackoverflow.com/questions/51408969/nested-exception-is-redis-clients-jedis-exceptions-jedisconnectionexception-cou ? – Jeff Cook Jul 18 '18 at 18:50

Murat · Answer 4 · 2019-01-23T13:42:24.050

Possible causes;

1 - Redis server is down or Redis application not responding.

2 - Application can not connect to Redis server (firewall etc. issues).

3 - Connection to Redis server timed out.

4 - All connections in the (Redis) pool are currently busy, new connection can not be allocated.

The cases 1 and 2 are infra related.

For case 3, connection timeout must be increased ("RedisConnectionTimeout"):

pool = new pool(poolConfig, RedisIp, RedisPort, RedisConnectionTimeout);

For case 4, max connection count must be increased ("RedisMaximumActiveConnectionCount"):

poolConfig.setMaxTotal(RedisMaximumActiveConnectionCount);

Assuming the following or similar implementation;

private Pool<Jedis> pool =  null;   

private final String RedisIp="10.10.10.11";
private final int RedisPort=6379;
private final String RedisConnectionTimeout=2000;
private final String RedisMaximumWaitTime=1000;
private final String RedisMaximumIdleConnectionCount=20;
private final String RedisMaximumActiveConnectionCount=300;
private final String SentinelActive=false;
private final String SentinelHostList="10.10.10.10:26379,10.10.10.10:26380,10.10.10.10:26381";
private final String SentinelMasterName="sentinel-master-name";

private synchronized void initializePool()
{
    if(pool!=null) return;

    poolConfig poolConfig = new poolConfig();
    poolConfig.setMaxTotal(RedisMaximumActiveConnectionCount); 
    poolConfig.setMaxIdle(RedisMaximumIdleConnectionCount);  
    poolConfig.setMaxWaitMillis(RedisMaximumWaitTime); 

    if(SentinelActive)
    {
        String [] sentinelsArray = SentinelHostList.split(",");

        Set<String> sentinels = new HashSet<>();            
        for(String sentinel : sentinelsArray)
        {
            sentinels.add(sentinel);
        }

        String masterName = SentinelMasterName;

        pool = new JedisSentinelPool(masterName, sentinels, poolConfig, RedisConnectionTimeout);            
    }
    else
    {       
        pool = new pool(poolConfig, RedisIp, RedisPort, RedisConnectionTimeout);
    }

}           

protected Jedis getConnection()
{               
    if(pool==null)
        initializePool();

      Jedis jedis = pool.getResource();

      return jedis;     
}

score 3 · Answer 5 · edited Mar 27 '15 at 11:15

If your code is like this:

JedisPoolConfig jedisPoolConfig = initPoolConfig();    
jedisPool = new JedisPool(jedisPoolConfig, "*.*.*.*", 6379);

You can try this:

JedisPoolConfig jedisPoolConfig = initPoolConfig();    
jedisPool = new JedisPool(jedisPoolConfig, "*.*.*.*", 6379,10*1000);

This is because for Redis the default timeout time is 2 seconds, but the program may have finished running in this time.

score 1 · Answer 6 · answered Oct 25 '12 at 20:53

1

Not sure, but maybe you don't return Jedis objects to the pool, and your redis-server has connection limit.

Every worker thread should return Jedis instances to the pool after its work is complete:

Jedis jedis = jedisPool.getResource();
try {
    jedis.getClient().setTimeoutInfinite();
    // your code here...
    ...
} finally {
    jedisPool.returnResource(jedis);
}

answered Oct 25 '12 at 20:53

Jarek

141
2

yes @Jarek, already i'm returning the resource. **pool.returnResource(jedis); pool.destroy();** – Vignesh Oct 26 '12 at 05:10
In my Java App I'm using Jedis2.0.0.jar file and redis server version is 2.4.13. Is it making the problem? – Vignesh Oct 26 '12 at 10:48
3

`returnResource` is protected method, you cannot use it. You need to use try with resources `try (Jedis jedis = pool.getResource()) {}` – Maciej Dzikowicki Jan 08 '20 at 10:12

score 0 · Answer 7 · answered Oct 27 '20 at 22:08

I've gotten that error when jedis simply could not reach the desired redis instance (domain/ip, port, or password), which could happen if they are either wrong, or they were right before and now are wrong, or if they are right but a firewall is blocking access to them, etc.

I know the OP confirmed having run redis-cli to confirm the connection, but it would have been helpful to confirm if that was done from the same place the jedis call was coming from (which could have been an app server leveraging jedis to connect to some redis server).

But that original post was from 2012, so I don't expect to hear an update but I leave these for others who may find this thread.

Omkar Pisal · Answer 8 · 2021-11-23T15:40:46.573

0

I had to struggle a lot to solve the 'Could not get a resource from the pool' error but I finally solved it and hopefully it will work out for you as well!

Change port in 'application.properties' from '6380' to '6379' It should work fine then!

edited Nov 23 '21 at 15:40

answered Nov 22 '21 at 15:08

Omkar Pisal

81
1
3

1

As it’s currently written, your answer is unclear. Please [edit] to add additional details that will help others understand how this addresses the question asked. You can find more information on how to write good answers [in the help center](/help/how-to-answer). – Community Nov 22 '21 at 19:56
Simplified the post! – Omkar Pisal Nov 23 '21 at 15:41

score 0 · Answer 9 · answered Feb 22 '22 at 06:00

I just want to add one point in @mrt's and @charlie's answers. We need to check the properties of redis server. For redis client 3.2.0 and above we can set ssl properties as well, with the help of JedisShardInfo as follows:

JedisShardInfo shardInfo = new JedisShardInfo(redisServer, redisServerPort, redisTimeout, redisSsl);
shardInfo.setPassword(redisPassword);
Jedis jedis = new Jedis(shardInfo);

and with jedisPool:

jedisPool = new JedisPool(poolConfig, redisServer, redisServerPort, redisTimeout, redisPassword, redisSsl);
jedis = jedisPool.getResource();

Where, in poolConfig, you can specify various properties like, setMaxIdle, setMaxWaitMillis, setMaxTotal and so on.

score 0 · Answer 10 · answered May 27 '22 at 06:28

0

On AWS Elastic Cache (Redis) if

Redis AUTH default user access is Yes, you need to set SSL=true in JedisPool like this

boolaen SSL=true;
jedisPool = new JedisPool(poolConfig, redisServer, redisServerPort, redisTimeout, redisPassword, SSL);

answered May 27 '22 at 06:28

Barun

1,520
2
12
18

what should be the password ? – Spartan Feb 28 '23 at 10:52

score 0 · Answer 11 · answered Jun 22 '22 at 10:32

This happenned to my application, actually I was using a single Object which was being called by multiple functions and those were not thread safe.

Problem was multiple calls on a single object leading to corrupted calls.

Something like this :

Class A{
    Object B;
    function1(){
        B.doSomething();
    }
    function2(){
        B.doSomething();
    }
}

As they were not threadsafe, I was getting these errors :

redis.clients.jedis.exceptions.JedisConnectionException: java.net.SocketException: Socket is closed

and

redis.clients.jedis.exceptions.JedisConnectionException: java.net.SocketTimeoutException: Read timed out

This is how I fixed it :

Class A{
    function1(){
        Object B;
        B.doSomething();
    }
    function2(){    
        Object B;
        B.doSomething();
    }
}

Hope it helps

Could not get a resource from the pool(SocketTimeoutException:)

11 Answers11

Linked