Questions tagged [python-huey]

Distributed task queue framework for python.

Python Huey is a distributed queue management system. It relies on a broker (currently Redis is supported) for delivering jobs specification to workers machines. A decorator-based syntax allows close-to-seamless integration with existing software.

Huey represents a simple but viable alternative to Python Celery.

54 questions
25
votes
1 answer

What is the best option for a (Python 3) task queue on Windows now that Celery 4 has dropped Windows support?

We run a Flask site under IIS on Windows, and for out-of-process tasks we use Celery. Celery has given us some problems under Windows, but for now we are satisfied running version 3.1.12, using RabbitMQ/AMQP as a back-end, which works under…
Erik Oosterwaal
  • 4,272
  • 3
  • 44
  • 64
8
votes
2 answers

Monitoring for Huey (Redis Queue, Time in Queue, and # of Workers)

Switched out Celery for Huey and am loving everything about it :) One thing Celery has that I do miss is its flower monitoring tool. Are there any monitoring tools that exist for Huey? We need to track # of tasks in the Redis Queue, Total time a…
tamarabyte
  • 1,144
  • 13
  • 19
7
votes
3 answers

Where is the huey consumer configuration?

I'm trying to get running the Huey task queue for python (it's a Celery alternative) and I'm stuck with starting the consumer with main.Configuration (as it's written in the tutorial). I know the huey_consumer is looking for the configfile somewhere…
Jakub Žitný
  • 962
  • 1
  • 9
  • 38
5
votes
4 answers

OSError: [WinError 10013] An attempt was made to access a socket in a way forbidden by its access permissions

I'm experimenting with the use of Huey as a cross platform task queue . I've found https://github.com/pjcunningham/flask-huey-example , which I've cloned and set up a virtualenv for using conda (I'm working on windows). I've followed the updated…
user1592380
  • 34,265
  • 92
  • 284
  • 515
4
votes
1 answer

How can i write test for huey scheduled task?

Im writing test for schedule task, but the task_id return always None update_task_id = update_delivery_minutes_change.schedule( args=(instance.id,), delay=(60 * 30) ) update_task_id.task.task_id -> None How can i mock or emulate huey for…
3
votes
2 answers

Can't enable huey service on deploy server

I'm working in a Django project deployment. I have integrated huey to run asynchronous tasks. Locally all runs perfectly but now, at the deployment step, I'm getting troubles about huey service activation. I really can't find any information about…
Andrés Quiroga
  • 1,837
  • 4
  • 21
  • 34
3
votes
1 answer

Run huey task queue in the background with supervisor on Elastic Beanstalk

I am trying to run a huey task queue on elastic beanstalk that is needed by my Flask app. But there is no built in way to run huey as a daemon process. The author of huey has advised to run huey with supervisor (this link) and since elastic…
3
votes
2 answers

How to do mocking/monkey patching in huey tasks?

I want to test a huey task, and need to patch requests.get. # huey_tasks.py from huey import RedisHuey huey = RedisHuey() @huey.task() def function(): import requests print(requests.get('http://www.google.com')) File that runs…
laike9m
  • 18,344
  • 20
  • 107
  • 140
3
votes
1 answer

Hue installation issue

I am new to bigdata technologies/hadoop ecosystem. As part of one of my assignment I am trying to install and run Hue on my single node hadoop cluster [apache distribution hadoop2.6.0]. I have installed hue as per the instructions provided by many…
Chauhan B
  • 461
  • 8
  • 27
2
votes
1 answer

Huey ``db_task`` successfully registered by consumer but does not receive/execute any task

I have a Django project with huey as task queue. In my dev environment (see below), everything works as expected: [save] Django model instance saved [trigger] huey task triggerd [execute] huey task gets executed by running consumer (run_huey) But…
tombreit
  • 1,199
  • 8
  • 27
2
votes
1 answer

Python Huey throws huey.exceptions.HueyException: xxxxxx not found in TaskRegistry

I'm trying to integrate Huey with Django where I'm almost done with the initial setting of app and everything with redis. Now when I'm running the actual .py file I'm getting an exception huey.exceptions.HueyException: xxxxxxx not found in…
Vin
  • 968
  • 2
  • 10
  • 22
2
votes
1 answer

How does Huey call task?

I have this code here # it's not every five mins but let's overlook that for now @periodic_task(crontab(minute='*/1')) def every_five_mins(): # ... But I couldn't find where Huey calls the function. The only other place that I've used Huey is…
crimsonpython24
  • 2,223
  • 2
  • 11
  • 27
2
votes
1 answer

Challenges getting simple Huey example started with Crontab

I'm attempting to implement the suggested organization of code from the Huey docs into an existing app, and also following the simple example. The goal is to build a crontab that will run the task every day at 3:00 am. I powered up two terminal…
Rich Everts
  • 167
  • 1
  • 13
2
votes
1 answer

Huey; Doesn't run tasks in one Django App

i have an app called "tickets", it's in the settings file, can be imported correctly. INSTALLED_APPS = [ ... "huey.contrib.djhuey", "core", "telefon", "termine", "tickets", ... ] I am running Huey for background tasks and it does run all tasks in…
Faulander
  • 327
  • 3
  • 12
2
votes
0 answers

How to integrate Sentry with Huey workers / consumers

I'd like to integrate Sentry with Huey task queue's workers / consumers. I've seen an issue in both Sentry and Huey's GitHub issues, but I found no definite answer about how to integrate them. I've read that one way to integrate them is via logging,…
hyperknot
  • 13,454
  • 24
  • 98
  • 153
1
2 3 4