Stack Overflow
Stack Overflow

Questions tagged [celery-broker]

Celery uses messages to interact/communicate with clients and workers using brokers. This can be enabled using Redis or RabitMQ

Celery uses messages to interact/communicate with clients and workers using brokers. As Celery is a task queue, celery needs to distribute tasks to multiple workers by using a broker from application to workers. This can be enabled using Redis or RabitMQ.

More information about celery brokers : http://docs.celeryproject.org/en/master/getting-started/brokers/index.html

4 questions
20
votes
1 answer

Why does celery need a message broker?

As celery is a job queue/task queue, name illustrates that it can maintain its tasks and process them. Then why does it need a message broker like rabbitmq or redis?
Shailendra
  • 528
  • 2
  • 10
  • 21
15
votes
3 answers

Celery: why do I need a broker for periodic tasks?

I have a standalong script that scrapes a page, initiates a connection to a database, and writes database to it. I need it to execute periodically after x hours. I can make it with using a bash script, with the pseudocode: while true do python…
yayu
  • 7,758
  • 17
  • 54
  • 86
4
votes
0 answers

amqp.exceptions.PreconditionFailed: Queue.declare: (406) PRECONDITION_FAILED - inequivalent arg

I am trying to consume Celery task from a Rabbitmq queue. My tasks.py is below from celery import Celery app=Celery('tasks',broker ='amqp://localhost//') app.conf.task_default_queue = 'e' @app.task(name='hello') def hello(): …
newUser
  • 386
  • 5
  • 17
0
votes
1 answer

Airflow jobs setting the executor type to NoneType after upgrading to 1.10.6

I have airflow configured with celery worker and the celery broker is redis. All the services are up and i am monitoring through flower for the celery workers and tasks. when i run this query in the airflow database select count(*),…
Tejus Prasad
  • 6,322
  • 7
  • 47
  • 75