Stack Overflow
Stack Overflow

Questions tagged [bull-queue]

41 questions
12
votes
2 answers

Jobs stuck in "waiting" in bull queue node.js

I had a bunch of jobs in bull queue when one got stuck for 1+ hours (normally takes ~2 minutes to run), but didn't fail. I was unable to remove the job from the active state with the bull arena UI that I use, so I deleted the key of the active job…
steveryan
  • 146
  • 1
  • 6
6
votes
2 answers

Can't resolve dependency when try to inject a Bull Queue in NestJS

I'm trying to implement Nodemailer with Bull/Redis to handle email-type of tasks in NestJS. I have a shared module called EmailService that add a job to my queue, to do this, it needs to inject the Queue from 'bull'. Nest can't resolve dependencies…
RRGT19
  • 1,437
  • 3
  • 28
  • 54
5
votes
1 answer

Using Bull queue how to retry failed jobs with higher priority?

Looking for a way to have bull retry failed jobs with a higher priority. More specifically, I would like failed jobs to be picked up before any non-failed job. It's fairly easy to set stuff like 'number of retries', but nothing else regarding the…
Geert-Jan
  • 18,623
  • 16
  • 75
  • 137
3
votes
1 answer

Bull queue not processing simple job

I'm completely new to Bull queue and I have a decent understanding of JavaScript. I am trying to get the following example to work: const Queue = require('bull') const myFirstQueue = new Queue('my-first-queue'); myFirstQueue.process(async (job,…
Long Nguyen
  • 73
  • 1
  • 6
3
votes
2 answers

How to get returned data when work with NestJS Bull queue?

Currently, I am working on a NestJS project with the bull queue. In my controller, I have a get function to receive the request from the front end. Based on the request, I will send a gRPC call to retrieve data from other microservice. I would like…
Erika
  • 453
  • 8
  • 23
3
votes
0 answers

How Redis Sentinel work with Bull queue (using NestJS)

I am working on a NestJs project using Bull queue. Here is the code I am using to connect Redis, and it works well。 BullModule.registerQueueAsync( { name: 'test', imports: [ConfigModule], useFactory: async…
Erika
  • 453
  • 8
  • 23
3
votes
2 answers

Node Bull Queue Error: Missing process handler for job type JOB_NAME

I am creating node bull queue and passing a dynamic name as an option to the Queue.add function myQueue.add(`myJob-${val}`, { attempts: 3, removeOnFail: true }); I am defining the process name as below for the above…
meallhour
  • 13,921
  • 21
  • 60
  • 117
3
votes
0 answers

Bull Queue retries being pushed to tail, not head

Using Bull queue. I have a queue that is rate limited. I would like failed jobs to be retried as soon as possible in the queue, considering the rate limits and backoff strategy. This does not seem to be the case. It seems that the failed job is…
Evil Buck
  • 1,068
  • 7
  • 20
3
votes
1 answer

Use NodeJS Bull Queue seperate processor

I'm trying to run the process in different processor file itsef as its in bull documentation, I've added the file as below. // -------- Queue.js ---------- formatQueue.process(__dirname + "/processors/format-worker.js"); // On Cmplete…
rakcode
  • 2,256
  • 4
  • 19
  • 44
3
votes
0 answers

Node/Bull/Throng background jobs. Super slow, and many processes are being used?

I've changed a long running process on an Node/Express route to use Bull/Redis. I've pretty much copied this tutorial on Heroku docs. The gist of that tutorial is: The Express route schedules the Job, immediately returns 200 to the client, and…
GN.
  • 8,672
  • 10
  • 61
  • 126
2
votes
2 answers

Bull queue not connecting with docker redis service. Error: connect ECONNREFUSED 127.0.0.1:6379

I am trying to establish a redis connection in nestjs via docker. I am using ioredis to connect to the redis but when I start my nest application I am keep on getting ECONNREFUSED. It also looks like the bull queue is also not establishing the…
JN_newbie
  • 5,492
  • 14
  • 59
  • 97
2
votes
0 answers

Bull queue - Queue was working fine but suddenly, stops working

I have implemented bull queue. It was working fine but now, queue stops working. I checked redis server. These keys are present - 1) "bull::stalled-check" 2) "bull::id" 3) "bull::lock" 4) "bull:" 5)…
Anchal Nigam
  • 21
  • 4
2
votes
1 answer

Bull queue: When a job fails, how to stop queue from processing remaining jobs?

I am using bull queue to process some jobs. In the current scenario each job is some kind of an operation. So whenever an operation(job) among a list of operations in the queue fails, queue has to stop processing the remaining jobs(operations). What…
Dheemanth Bhat
  • 4,269
  • 2
  • 21
  • 40
1
vote
1 answer

Scheduling jobs in Kafka

I am currently working on an application which will schedule a task as a timers. The timers can be run on any day of the week with the configuration by the user. Currently it is implemented with bullqueue and redis for storage. Once the timer will…
JN_newbie
  • 5,492
  • 14
  • 59
  • 97
1
vote
0 answers

Jobs doesn't get picked up by @Processor in Nest.js BullQueue

I'm trying to implement a queue using the BullQueue package in nest.js. I have two queues, one is a file queue and another is an email queue. I use the file queue to regenerate thumbnails in the background after the thumbnail is uploaded. And email…
Howard Scott
  • 171
  • 1
  • 11
1
2 3