concurrent-ruby slow in making db calls with Rails 5

Asked Apr 07 '20 at 05:28

Active Apr 07 '20 at 05:28

Viewed 214 times

I have been using concurrent-ruby 1.1.5 with Rails 5.1.6 and MySQL 8.0. I have to make 500 DB calls, so I tried to make it using concurrent ruby but the results are extremely slow than expected

Normal Loop call - This takes on an average 7-8 seconds

[1..500].map do
  ## Db Call
end

After changing the code and using concurrent ruby, this time increases to 12-13 sec

thread_pool = Concurrent::FixedThreadPool.new(10)
promises = []
[1..500].map do
  Concurrent::Promises.future({ executor: thread_pool }) do
    Rails.application.executor.wrap do
      ActiveRecord::Base.connection_pool.with_connection do
        ## Db Call
      end
    end
  end
end

Not able to debug what could be the possible reason which is making the concurrent requests slow. Am I missing something?

asked Apr 07 '20 at 05:28

dilpreet singh

what is pool size in your database.yml? – Amit Patel Apr 07 '20 at 07:22
pool size is 30 and I have increased checkout timeout to 20 seconds – dilpreet singh Apr 07 '20 at 10:05
I have increased the pool size to 100 still, it's taking the same time – dilpreet singh Apr 07 '20 at 11:48
Increasing pool size will not do magic. It has relation with number of threads. Checkout https://devcenter.heroku.com/articles/concurrency-and-database-connections to get some fundamentals. – Amit Patel Apr 07 '20 at 11:53

concurrent-ruby slow in making db calls with Rails 5

0 Answers0