Stack Overflow
Stack Overflow

Questions tagged [beanstalkd]

Beanstalkd is a simple, fast work queue.

Beanstalkd is a simple, fast work queue.

Its interface is generic, but was originally designed for reducing the latency of page views in high-volume web applications by running time-consuming tasks asynchronously.

401 questions
64
votes
3 answers

delayed_jobs vs resque vs beanstalkd?

Here is my needs: Enqueue_in(10.hours, ... ) (DJ syntax is perfect.) Multiply workers, concurrently. (Resque or beanstalkd are good for this, but not DJ) Must handle push and pop of 100 jobs a second. (I will need to run a test to make sure, but I…
rafamvc
  • 8,227
  • 6
  • 31
  • 34
26
votes
1 answer

How can I get a list of all jobs in a beanstalk tube?

I have beanstalk installed on my server, and run the following: $ telnet localhost 11300 use my_tube USING my_tube peek-ready FOUND 11065 41 {"ts":1295537419,"data":{"nid":"212156"}} Now my question is: how can I get a list of all jobs in the…
Alaa
  • 4,471
  • 11
  • 50
  • 67
25
votes
8 answers

Stats/Monitor/Inspector for beanstalkd

Does anyone know of an app that can monitor a beanstalkd queue? I'm looking for something that shows stats on tubes and jobs, and allows you to inspect the details. I'm not really picky about language/platform, just want to know if there's…
Tim Lytle
  • 17,549
  • 10
  • 60
  • 91
24
votes
3 answers

Laravel Artisan Queues - high cpu usage

I have set up queues in Laravel for my processing scripts. I am using beanstalkd and supervisord. There are 6 different tubes for different types of processing. The issue is that for each tube, artisan is constantly spawning workers every…
bsparacino
  • 333
  • 1
  • 3
  • 8
24
votes
4 answers

God starts too many processes

I have a god script that is supposed to keep an eye on two stalker processes. The problem is that after 24h it starts way too many processes. This is the god script. rails_root = File.expand_path("../..", __FILE__) 2.times do |n| God.watch do…
Linus Oleander
  • 17,746
  • 15
  • 69
  • 102
22
votes
2 answers

Laravel Queue, Beanstalkd vs Database, what are the differences?

Is there much difference between using Beanstalkd and a database driver for queues? What would some pros and cons be? The database queue seems to easier to setup and run, what should I know about using it? Theres no real explanations in the docs…
Nicekiwi
  • 4,567
  • 11
  • 49
  • 88
21
votes
8 answers

Deleting queued jobs in laravel

I have added some jobs to a queue in Laravel. However, I forgot to put $job->delete() in the function and there is an error in my function. This means the job is never ending. It keeps going being replaced onto the queue and keeps erroring in my…
Claire
  • 3,683
  • 13
  • 47
  • 74
17
votes
4 answers

Message Queues Vs DB Table Queue via CRON

We have a large project coming up soon with quite a lot of media processing (Images, Video) as well email output etc, the sort of stuff normally we'd put into a table called "email_queue" and we use a cron to run a script process the queue in the…
Bowen
  • 523
  • 1
  • 4
  • 11
16
votes
3 answers

Memory considerations for long-running php scripts

I want to write a worker for beanstalkd in php, using a Zend Framework 2 controller. It starts via the CLI and will run forever, asking for jobs from beanstalkd like this example. In simple pseudo-like code: while (true) { $data =…
Jurian Sluiman
  • 13,498
  • 3
  • 67
  • 99
15
votes
5 answers

Beanstalkd for CentOs 7

Due to a misconfiguration I've migrated a VPS from CentOs 6 to CentOs 7 for a fresh start. Among other things I had a beanstalkd service installed on CentOs 6. At the time I've followed this tutorial…
Hrusdik
  • 225
  • 3
  • 8
13
votes
1 answer

PHP asynchronous processing with beanstalkd. Do you recommend it?

would you recommend using beanstalkd [ http://kr.github.com/beanstalkd/ ] for asynchronous processing in PHP ? I need some feedback/comments pros-cons, from anyone that has used this lib. Thanks,
Andreas
  • 5,305
  • 4
  • 41
  • 60
12
votes
1 answer

How to set up Beanstalkd with PHP

Recently I've been researching the use of Beanstalkd with PHP. I've learned quite a bit but have a few questions about the setup on a server, etc. Here is how I see it working: I install Beanstalkd and any dependencies (such as libevent) on my…
joshholat
  • 3,371
  • 9
  • 39
  • 48
12
votes
1 answer

How to pass arguments to homebrew service

I have installed beanstalkd using homebrew but am unable to increase the maximum job size. This is normally done by passing the -z argument as "-z byte_size" All attempts to edit the formula for myself have failed to increase the job size as…
Moylin
  • 737
  • 1
  • 9
  • 20
10
votes
3 answers

Connecting http request/response model with asynchronous queue

What's a good way to connect the synchronous http request/response model with an asynchronous queue based model? When the user's HTTP request comes it generates a work request that goes onto a queue (beanstalkd in this case). One of the workers…
Parand
  • 102,950
  • 48
  • 151
  • 186
10
votes
6 answers

beanstalkd interface/GUI

Does anyone know of any interface to administer beanstalkd? What I'm looking for vaguely is something like PhpMyAdmin for MySQL. Doesn't have to be PHP or web-based, could be any interface, GUI ..etc
Ammar Ibrahim
  • 313
  • 3
  • 9
1
2 3
…
26 27