Django integration with RQ, a Redis based Python queuing library. Django-RQ is a simple app that allows you to configure your queues in django's settings.py and easily use them in your project.
Questions tagged [django-rq]
62 questions
24
votes
1 answer
django-rq and rqscheduler deployment on AWS Elastic Beanstalk
I have a Django app that runs on the AWS EB environment. With recent updates, I had to integrate django-rq and rqscheduler for some queue-based background tasks. This all works fine on localhost with commands rqworker and rqscheduler. But I am…
Saumya gupta
- 391
- 1
- 14
8
votes
0 answers
Auto-creating Queues in djangorq
RQ normally creates queues on the fly.
With RQ, you don’t have to set up any queues upfront, and you don’t have to specify any channels, exchanges, routing rules, or whatnot. You can just put jobs onto any queue you want
However, when using the…
Jethro
- 3,029
- 3
- 27
- 56
4
votes
0 answers
Push results of one to another job django-rq
I'm building an application in which users' information are frequently updated from external APIs. For that, I'm using django-rq.
The first job is scheduled once a day to get users who need to update their profiles.
With each result returned by the…
erik
- 61
- 5
4
votes
0 answers
Django-rq-scheduler: call function with arguments from django-admin
We are using django 1.10, django-rq, django-rq-scheduler.
In the django admin one can set a callable function, but how is it possible to send specific param-values to that function (e.g. in the screenshot call…
user3139774
- 1,295
- 3
- 13
- 24
4
votes
2 answers
Redis still fills up when results_ttl=0, Why?
Question: Why is redis filling up if the results of jobs are discarded immediately?
I'm using redis as a queue to create PDFs asynchronously and then save the result to my database. Since its saved, I don't need to access the object a later date and…
agconti
- 17,780
- 15
- 80
- 114
3
votes
0 answers
Django-RQ having a hard time adding items to Django Model
I'm using django-rq to setup background tasks using Redis. Redis is working great and the code is sending the request to Redis - but it is throwing an exception.
Exception:
Traceback (most recent call last):
File…
JeremyE
- 1,368
- 4
- 20
- 40
3
votes
1 answer
rqworker from django-rq not receiving tasks
I am trying to have some asynchronous functions run by a worker following the approach explained here.
That means, in my tasks.py file I have:
from django_rq import job
@job
def long_function(one_list):
#many stuff that should be done…
J0ANMM
- 7,849
- 10
- 56
- 90
3
votes
1 answer
RQ Timeout does not kill multi-threaded jobs
I'm having problems running multithreaded tasks using python RQ (tested on v0.5.6 and v0.6.0).
Consider the following piece of code, as a simplified version of what I'm trying to achieve:
thing.py
from threading import Thread
class…
Kludge
- 2,653
- 4
- 20
- 42
2
votes
1 answer
right way to deploy a django-rq worker
maybe it's a silly question, but I didn't found much while googling around.
So I'm on the way to transform my development environment to a deploy environment. I connected django and nginx using uwsgi, put both in docker containers... so far no…
theother
- 307
- 2
- 16
2
votes
1 answer
Error connecting django-rq: ImportError: cannot import name get_failed_queue
Never worked with django-rq, redis. The problem should be solved easily, I think, but I do not know how.
When I start the server, I get this error ImportError: cannot import name get_failed_queue
I'm use Python 2.7
Full Traceback
Unhandled exception…
user11301070
2
votes
1 answer
the proper way to run django rq in docker microservices setup
I have somehow bad setup of my docker containers I guess.
Because each time I run task from django I see in docker container output of ps aux that there is new process created of python mange.py rqworker mail instead of using the existing one.
See…
andilabs
- 22,159
- 14
- 114
- 151
2
votes
1 answer
RQ: redis.exceptions.ResponseError: Command # 3 ... of pipeline caused error: OOM command not allowed when used memory > 'maxmemory'
I am running a background task in my django app with RQ, as it is supposed to be one of the simplest ways to get the job done. The task consists in checking in some APIs if any information has been updated and inserting any new information in my own…
J0ANMM
- 7,849
- 10
- 56
- 90
2
votes
1 answer
Django-RQ: How to call function?
I am migrating a project to Django and like to use the django-rq module.
However, I am stuck at what to put here:
import django_rq
queue = django_rq.get_queue('high')
queue.enqueue(func, foo, bar=baz)
How to call func ? Can this be a string like…
Jan
- 42,290
- 8
- 54
- 79
2
votes
0 answers
Django rq worker proper setup passing django settngs
i Have a django project which works fine. I need a rq worker to do a job. I got a redis-server running.
Whis is my worker.py file:
import os
import redis
from rq import Worker, Queue, Connection
listen = ['high', 'default', 'low']
redis_url =…
HellOfACode
- 1,675
- 3
- 18
- 38
2
votes
1 answer
Sending Django-RQ exceptions to Sentry
I'm using Django-RQ in a Heroku application to handle background tasks.
When an error occurs in my background tasks, it doesn't get sent to Sentry.
My logging settings in settings.py are below:
LOGGING = {
'version': 1,
…
AJ Hung
- 21
- 2