how to remove task from celery with redis broker?

Question

I Have add some wrong task to a celery with redis broker

but now I want to remove the incorrect task and I can't find any way to do this

Is there some commands or some api to do this ?

See if it'll help: http://stackoverflow.com/questions/2557424/delete-task-periodictask-in-celery — alecxe, Jun 19 '13 at 08:41

score 29 · Accepted Answer · answered Jun 22 '13 at 12:07

29

I know two ways of doing so:

1) Delete queue directly from broker. In your case it's Redis. There are two commands that could help you: llen (to find right queue) and del (to delete it).

2) Start celery worker with --purge or --discard options. Here is help:

--purge, --discard    Purges all waiting tasks before the daemon is started.
                      **WARNING**: This is unrecoverable, and the tasks will
                      be deleted from the messaging server.

answered Jun 22 '13 at 12:07

Artem Mezhenin

5,539
6
32
51

3

thanks for replay, celery is too complex,i have change my project to python-rq – timger Jun 24 '13 at 03:53
2

It doesn't work for me. Reddis has still all the queue and I can't delete it. Celery continues recieving tasks – Shil Nevado May 25 '17 at 10:20
In case this doesn't clean up all of your celery issues, I also encourage you to check for zombie process using `ps` and run `kill` on them. – Chris Conlan Sep 26 '18 at 19:59
3

This is not the correct answer. Why was it accepted? – DejanLekic May 07 '20 at 10:50

DejanLekic · Answer 2 · 2020-05-07T10:56:58.190

The simplest way is to use the celery control revoke [id1 [id2 [... [idN]]]] (do not forget to pass the -A project.application flag too). Where id1 to idN are task IDs. However, it is not guaranteed to succeed every time you run it, for valid reasons...

Sure Celery has API for it. Here is an example how to do it from a script: res = app.control.revoke(task_id, terminate=True)

In the example above app is an instance of the Celery application.

In some rare ocasions the control command above will not work, in which case you have to instruct Celery worker to kill the worker process: res = app.control.revoke(task_id, terminate=True, signal='SIGKILL')

score 2 · Answer 3 · answered Jul 01 '15 at 00:23

2

I just had this problem so for future readers,

http://celery.readthedocs.org/en/latest/faq.html#i-ve-purged-messages-but-there-are-still-messages-left-in-the-queue

so to properly purge the queue of waiting tasks you have to stop all the workers, and then purge the tasks using celery.control.purge().

answered Jul 01 '15 at 00:23

straykiwi

538
6
23

4

Again, like the accepted "answer" - this one is incorrect too. The question is how to revoke particular task, not how to purge the queue... – DejanLekic Sep 23 '20 at 10:26

Ukr · Answer 4 · 2017-03-27T15:39:46.653

1

1. To properly purge the queue of waiting tasks you have to stop all the workers (http://celery.readthedocs.io/en/latest/faq.html#i-ve-purged-messages-but-there-are-still-messages-left-in-the-queue):

2 ... and then purge the tasks from a specific queue:

$ cd <source_dir
$ celery amqp queue.purge <queue name>

3. Start workers again

edited Mar 27 '17 at 15:39

answered Mar 27 '17 at 15:28

Ukr

2,411
18
16

score 0 · Answer 5 · answered May 07 '20 at 10:42

0

try to remove the .state file and if you are using a beat worker (celery worker -B) then remove the schedule file as well

answered May 07 '20 at 10:42

bassel7

1
3

i removed all of state and scheduled, then deleted the queues and it worked for me – bassel7 May 09 '20 at 10:14

how to remove task from celery with redis broker?

5 Answers5