Questions tagged [push-queue]

A queue system whose subscribers can listen for messages, rather than poll periodically.

A queue system whose subscribers can listen for messages, rather than poll periodically. An implementation of a push queue is IronMQ, as announced on their blog.

A non-push queue expects subscribers to simply poll at regular intervals. This works for consistently-busy queues, but for queues that have long periods of low activity, polling slowly wastes time and network bandwidth, essentially doing nothing.

Queue subscriber message fetch styles:

  • Listen for message (push queue)
    • Wastes zero API requests
    • Requires that network circumstances allow the queue service to contact the subscriber
  • Poll every second
  • Long-poll, with 30 second timeout
15 questions
5
votes
1 answer

$job->release() is not putting back on queue

Very new to queues so be gentle. To my understanding, $job->release() is supposed to put the job back on the queue. I currently have the code below but it only runs the job through the queue once. I need to be able to run it through up to 5 times…
Dylan Buth
  • 1,648
  • 5
  • 35
  • 57
3
votes
1 answer

Are there any charges for Google App Engine Push Queue HTTP calls within the same application

Google App Engine's documentation says that once tasks have been added to Push-Queue, the Push-Queue will initiate HTTP calls to the handler/url specified in the newly added task. My question: Do the HTTP call charges, or any other charges apply…
Nick Ross
  • 33
  • 4
2
votes
0 answers

Task in push queue not starting with Error Code 140

Sometimes (seems randomly) when I schedule a task in a GAE push queue the task doesnt start and I receive this error message: A problem was encountered with the process that handled this request, causing it to exit. This is likely to cause a new…
user1781028
  • 1,478
  • 4
  • 22
  • 45
2
votes
0 answers

Get list of task names on a push queue on google app engine

I have been looking for the last two days for a way to retrieve a list of tasks on a Google app engine push queue either programatically or with a command line command (either gcloud tool or a curl REST API). I have not been able to find anything…
thurmc
  • 495
  • 1
  • 8
  • 29
2
votes
1 answer

IronMQ push queue subscribers as Heroku workers

IronMQ supports push queues, but the example Heroku push queue subscriber is implemented as a web dyno. This feels awkward, because I need a single Heroku project to use web dynos that serve web requests, and worker dynos that process time-consuming…
Jacob Marble
  • 28,555
  • 22
  • 67
  • 78
1
vote
0 answers

run specific queue on new service in GAE java8 standard environment

We have a project which is setup on GAE with java8 standard environment and the app runs on default service. Now I would like to add a new service to the app so that I can run some tasks in a dedicated service as I need more memory. All the…
1
vote
1 answer

Script/Queue keeps running out of memory

My application has a huge amount of data it needs to process whenever a user requests it. The script was originally organised in a foreach loop but that caused PHP to timeout everytime. I moved to using Redis queues, but then I was having memory…
user1894292
  • 829
  • 1
  • 8
  • 19
1
vote
1 answer

Instance only when needed - GCP

I have a video editing task that needs to be completed occasionally. The task is relatively intensive and therefore needs a powerful machine to do it. It can take up to about 10 minutes to complete. I might get 10-20 such requests per day, though…
1
vote
3 answers

Laravel 4.1 + Push Queues + Error Queues

My goal is to somehow notify me if a push message fails after X attempts. Iron.io push queues docs describe: Error Queues http://dev.iron.io/mq/reference/push_queues/#error_queues Following the docs, I have to define an error_queue option in order…
cmancre
  • 1,061
  • 3
  • 11
  • 23
0
votes
0 answers

Oracle APEX 20.2 Email Sending

I done the email configuration and done the email sending code in oracle apex page, but unable to send emails properly, some time it works smoothly but all of a sudden it stuck and my emails appear in mail queue, can anyone guide me no this that…
alibutt
  • 1
  • 1
0
votes
1 answer

Deadline exceed error in task queue with Basic module (Google app engine)

I'm using python Google App engine SDK and Django framework. In my case, the task queue is throwing deadline exceed error DeadlineExceededError: The overall deadline for responding to the HTTP request was exceeded. though using task queue in basic…
Amandeep Singh
  • 305
  • 2
  • 11
0
votes
1 answer

Can I view raw message in iron.io webpage?

I'm learning to use iron.io MQ push queues. I'm pushing some messages with Laravel php framework and everything works. However, just to round up my knowledge, I would like to see the raw contents of these messages. In my iron.io account I can see…
0
votes
1 answer

Laravel 4 & IronMQ queue - Exception handling architecture for push failures?

There should be an architecture in place to not have any push queue tasks lost while Laravel fails to communicate with IronIO servers. For example there is IronIO service outages, or DNS hiccups along the way. Or as in our case, it seems our…
ux.engineer
  • 10,082
  • 13
  • 67
  • 112
0
votes
1 answer

Laravel - Push queue task with a custom handling method and deleting job

Consider this kind of code which pushes a task to queue to run a custom handler method that is located within the same class:
ux.engineer
  • 10,082
  • 13
  • 67
  • 112
0
votes
1 answer

How do I check the number of tasks currently in the queue?

According to the Push queue in GAE there are a number of task request headers. X-AppEngine-QueueName, the name of the queue (possibly default) X-AppEngine-TaskName, the name of the task, or a system-generated unique ID if no name was…
Houman
  • 64,245
  • 87
  • 278
  • 460