Running long tasks with rabbitmq and pika

Question

I'm using pika to run long tasks. Unfortunately, this ends up running into heartbeat timeout. Unfortunately, prolonging heartbeat periods is not a solution, and i would like to avoid workarounds like using database, etc.

What is a proper solution, to deal with long running tasks and heartbeat, without loosing benefits of RabbitMQ?

Note: I know this question was asked before, but many of the answers are related to previous versions of pika. I would like to know if there is a better solution to this issue.

If your code is running under Python 3.5+ use asyncio implementation. — VisioN, Mar 10 '20 at 12:48
Try this https://github.com/pika/pika/blob/0.12.0/examples/basic_consumer_threaded.py — bumblebee, Mar 10 '20 at 13:16
I'm experimenting with the AsyncioConnection, but the connection is always closed after creation. — Adeom, Mar 10 '20 at 13:21

score 0 · Answer 1 · answered Mar 10 '20 at 23:20

This has already been answered -

https://stackoverflow.com/a/52951933/1466825

Please use the latest version of Pika and this example code as a starting point -

https://github.com/pika/pika/blob/master/examples/basic_consumer_threaded.py

_{NOTE: the RabbitMQ team monitors the rabbitmq-users mailing list and only sometimes answers questions on StackOverflow.}

Running long tasks with rabbitmq and pika

1 Answers1