Django Celery Beat and Tasks Results

Question

Is it possible for django-celery-beat not to save tasks that are performed in a short time interval? By default, all results are saved to the Task Results table.

I cannot find this information on celeryproject webpage.

Alternatively, what should be the settings for postgres auto vacuum so that indexes don't take up that much disk space?

I want a simple solution. Overwriting django celery logic is not an option.

score 2 · Answer 1 · answered Nov 13 '20 at 17:00

2

Is rpc backend and task_ignore_result answer your needs :

app = Celery('APP_NAME', backend='rpc://', broker=BROKER_URL)
# Keep result only if you really need them: task_ignore_result = False
# In all other cases it is better to have place somewhere in db
# Note that this means you can’t use AsyncResult to check if the task is ready, or get its return value.
app.conf.task_ignore_result = True

Some docs about backend here : https://docs.celeryproject.org/en/latest/userguide/tasks.html#rpc-result-backend-rabbitmq-qpid

answered Nov 13 '20 at 17:00

MaximeK

2,039
1
10
16

What about tasks that should be saved to Task Results? Should I split this into 2 celery apps? – OceanFire Nov 13 '20 at 19:13
Hello, yes, split into 2 celery apps – MaximeK Nov 16 '20 at 08:27
That's not a bad idea. Thanks. – OceanFire Nov 17 '20 at 19:23

score 2 · Accepted Answer · answered Dec 13 '20 at 22:57

2

I found a solution. It's simpler than I thought. If you want not to save the results to the database, just add in the decorator:

@shared_task (ignore_result = True)

answered Dec 13 '20 at 22:57

OceanFire

504
4
11

Django Celery Beat and Tasks Results

2 Answers2