Questions tagged [rq]

RQ (Redis Queue) refers to Redis message queue and broker software. The tag can also refer to libraries implementing the Redis message queue.

RQ (Redis Queue) is a Redis message queue and broker software. The tag can also refer to libraries implementing the Redis message queue.

See also:

46 questions
4
votes
1 answer

rq-dashboard on Heroku

I'm trying to get rq-dashboard to work on my Redis server created through Heroku. I added it to my Flask app using from flask import Flask import rq_dashboard app =…
Minh Tri Pham
  • 861
  • 3
  • 9
  • 18
3
votes
1 answer

rq info showing job_id (None None):?

Whenever we are trying to see queue info using rq info -u <> command, we are getting lots of extra entries like this - a331d42408099f7e5ec9c5864 (None None): ? c352af4c2385cdf320d7b74897 (None None): ? 134174815b44c44d706417eb0 (None…
Koushik Roy
  • 6,868
  • 2
  • 12
  • 33
3
votes
1 answer

Proper way to pass python flask app context to rq jobs

I've created a flask app that is effectively a news search app. It currently serves up a number of routes, integrates with elasticsearch for document searching and indexing and integrates with a mySQL DB via Flask-SQLAlchemy. The app should enable…
peetysmith
  • 157
  • 1
  • 10
2
votes
0 answers

RQ: success and failure handling when using `@job` decorator

I am using @job decorator to define a task as below: rqueue = Queue(connection=Redis.from_url(REDIS_URL)) @job(queue=rqueue) def add(x, y): time.sleep(2) return x+y this works fine when I call it like add.delay(100, 100). But I need to…
Neelesh
  • 666
  • 6
  • 17
2
votes
0 answers

I am getting a "ValueError: unsupported pickle protocol: 5" when trying to use Redis rq

I am trying to get Redis and rq working. This is my main code: from rq import Queue from redis import Redis from util import count_words_at_url from rq.registry import FailedJobRegistry, Job import time if name == 'main': print('Hi') # Tell RQ…
JGV
  • 163
  • 3
  • 14
1
vote
0 answers

How to handle ConnectionError error with redis-py connection while Redis pod (on kubernetes) is restarting?

I have a problem with redis-py connection into redis on kubernetes. Few times a day redis pod restarts/moves on new one pod, but my python processes catches ConnectionError error: I know, that it should bubble that exception - server is down for…
zigi
  • 21
  • 2
1
vote
1 answer

Redis Queue task is queued but never executed

I am having issues getting RQ-python to run. Like in the example of the documentation (https://python-rq.org) I have a function in an external file def createAndSaveIndex(url_list, index_path): …
sc0urge
  • 11
  • 4
1
vote
2 answers

Railway.app: Is Procfile Successfully Loading a Worker?

Migrating from Heroku to Railway.app: Python Flask app with Redis and Postgres. Using Redis as an asynchronous job queue, with the RQ Redis queue python library. Procfile, which works in dev, looks like this: web: gunicorn app:app worker: rq worker…
m-a-draco
  • 35
  • 5
1
vote
1 answer

Python RQ and Redis Server: How does the worker know the function code to execute?

So I would like to have the following architecture: Flask API (VM 1) -> Redis Server (VM 2) <- Worker (VM 3) I have seen some examples and the idea I get is that on the API you define the tasks that handle the jobs (workers will perform) and push it…
MrMteor
  • 11
  • 1
1
vote
0 answers

Requeueing specific job by ID django_rq

I can't find a straight answer, is it possible to retry a job given just the job's redis id? I want to make an endpoint in Django that can manually retry a specific job, because I don't always need failed jobs to retry themselves. An example might…
Big Guy
  • 712
  • 1
  • 8
  • 21
1
vote
0 answers

Approach to animate a progress bar using python/flask/bootstrap/rq/redis

I am using flask in an application that does some long-running computations. I've successfully offloaded the compute-intensive code to an rq worker with this code job = q.enqueue(run_simulation) This is followed by the following code: while not…
JGV
  • 163
  • 3
  • 14
1
vote
0 answers

redis python3 rq worker fails for utcparse started_at date absence

I have redis installed and running (Redis version=6.0.9 on a Ubuntu 18.04 machine) and followed this simple guide to schedule a job with rq but as soon as I launch app.py redis worker fails with: 10:31:17 RQ worker…
cccnrc
  • 1,195
  • 11
  • 27
0
votes
0 answers

flask-rq2 error when running the flask app (Unsubscribing channel)

when i try to use flask-rq2 in flask log this logs printed and queue doesn't working at all 13:51:26 Worker rq:worker:6cee0c3868f0476a88616b40447a73bc started with PID 295, version 1.15.1 13:51:26 Subscribing to channel…
abcdefg
  • 9
  • 2
0
votes
0 answers

Job gets executed twice at the same time by redis rq worker

The version of my redis is 4.1.2, rq is 1.10.1 I use supervisor to create 5 workers at most like below: command=rq worker --with-scheduler -P /myworker_path -c settings high default low numprocs=5 All of my jobs go to default queue currently. Most…
0
votes
1 answer

rq worker unable to connect to EC2 through Heroku app (SSL: CERTIFICATE_VERIFY_FAILED)

My Heroku app uses Redis and an rq worker. I recently enabled SSL on my Heroku app via the dashboard, and was met with SSL errors. Initially I was met with the following error when hitting an endpoint that used Redis: app[redis-cylindrical-86839]:…
jacob_g
  • 674
  • 8
  • 21
1
2 3 4