140

I need the ability to run a PHP script 20 times a day at completely random times. I also want it to run only between 9am - 11pm.

I'm familiar with creating cron jobs in linux.

Micah Elliott
  • 9,600
  • 5
  • 51
  • 54
floatleft
  • 6,243
  • 12
  • 43
  • 53
  • 3
    The question is not very well posed. Ultimately you want to distribute 20 points on the time axis between 9am and 11am. But are there constraints on the minimum time difference? Is doing nothing between 9am and 10:30am acceptable? The only way to do this acceptably seems to Klaus' idea: select your 20 times at 09:00, which allows you to fulfill any constraints you might have, then schedule things with "at". – David Tonhofer Oct 14 '13 at 19:27

13 Answers13

185

How to cron something at a random offset 20 times a day between 9am and 11pm? That's kinda tricky within cron, because you are dividing 14 hours by 20 execution times. I don't like the other answers very much because they require writing a bash wrapper script for your php script.

However, if you'll allow me the liberty to ease the timing and frequency restriction to 13 times between 8:30am and 11:09pm, this might do the trick, and all within the confines of your crontab:

30 8-21/* * * * sleep ${RANDOM:0:2}m ; /path/to/script.php

${RANDOM:3:2} uses bash's $RANDOM that other people have mentioned above, but adds bash array slicing. Since bash variables are untyped, the pseudo-random signed 16-bit number gets truncated to the first 2 of its 5 decimal digits, giving you a succinct one-liner for delaying your cronjob between 10 and 99 minutes (though the distribution is biased towards 10 to 32).

The following might also work for you, but I found it do be "less random" for some reason (perhaps Benford's Law is triggered by modulating pseudo-random numbers. Hey, I don't know, I flunked math... Blame it on bash!):

30 8-21/* * * * sleep $[RANDOM\%90]m ; /path/to/script.php

You need to render modulus as '%' above because cron (well, at least Linux 'vixie-cron') terminates the line when it encounters an unescaped '%'.

Maybe you could get the remaining 7 script executions in there by adding another line with another 7-hour range. Or relax your restriction to run between 3am and 11pm.

aggregate1166877
  • 2,196
  • 23
  • 38
al-x
  • 1,983
  • 2
  • 11
  • 3
  • 4
    I like the late answer. But if you're trying to generate a random integer evenly distributed in the range of 10 to 99, and the output of RANDOM is 0 to 32,767, why wouldn't you just do `$[(RANDOM/368)+10]`? – jsdalton May 02 '13 at 16:24
  • 4
    @jsdalton: Wouldn't the modulo operator be better? `$((RANDOM % 90 + 10))` Test: `for i in {0..9999}; do echo $((RANDOM % 90 + 10)); done | sort | uniq -c` – geon Sep 17 '14 at 08:50
  • 6
    On many systems cron does not use bash by default so it could be better to avoid the bashism `$RANDOM`: `sleep $(( $(od -N1 -tuC -An /dev/urandom) \% 90 ))m`. – pabouk - Ukraine stay strong Jun 18 '15 at 13:57
  • 12
    **Make sure that `crontab` is using `bash` before you use `$RANDOM`.** If you have `vixie-cron` (seems to be my case on Ubuntu), then you can add `SHELL=/bin/bash` to the top. There are more alternatives for other cron versions here: http://superuser.com/a/264541/260350 – DaAwesomeP Jul 10 '15 at 23:16
  • 1
    When I use the first suggestion above, I get `crontab: errors in crontab file, can't install. Do you want to retry the same edit?` please help – Sean H Sep 13 '15 at 18:04
  • ${RANDOM:0:2} will never be a single digit number so ${RANDOM:1:2} would give better randomness while having a very small possibility of returning an empty string in case ${RANDOM} was a single-digit number. – ColinM Jun 05 '18 at 14:09
  • @Seano Precisely because of what DaAwesomeP points out in the comment before yours. – tripleee May 04 '20 at 12:25
  • any advise on randomly once every 36 hours? – Grimeire Nov 26 '21 at 15:54
93

So I'm using the following to run a command between 1AM and 330AM

0 1 * * * perl -le 'sleep rand 9000' && *command goes here*

That has been taking care of my random needs for me. That's 9000 seconds == 150 minutes == 2.5 hours

Dave
  • 931
  • 6
  • 2
44

If I understand what you're looking for, you'll need to do something a bit messy, like having a cron job that runs a bash script that randomizes the run times... Something like this:

crontab:

0 9 * * * /path/to/bashscript

and in /path/to/bashscript:

#!/bin/bash

maxdelay=$((14*60))  # 14 hours from 9am to 11pm, converted to minutes
for ((i=1; i<=20; i++)); do
    delay=$(($RANDOM%maxdelay)) # pick an independent random delay for each of the 20 runs
    (sleep $((delay*60)); /path/to/phpscript.php) & # background a subshell to wait, then run the php script
done

A few notes: this approach it a little wasteful of resources, as it fires off 20 background processes at 9am, each of which waits around for a random number of minutes (up to 14 hours, i.e. 11pm), then launches the php script and exits. Also, since it uses a random number of minutes (not seconds), the start times aren't quite as random as they could be. But $RANDOM only goes up to 32,767, and there are 50,400 seconds between 9am and 11pm, it'd be a little more complicated to randomize the seconds as well. Finally, since the start times are random and independent of each other, it's possible (but not very likely) that two or more instances of the script will be started simultaneously.

Gordon Davisson
  • 118,432
  • 16
  • 123
  • 151
  • 2
    You can make the arithmetic assignments more readable by dropping the dollar sign and moving the double parens to the left (e.g. `((maxdelay = 14 * 60))` or `((delay = $RANDOM % maxdelay))`). The `sleep` argument still needs to be the way you have it (although you could add spaces, if desired). – Dennis Williamson Jan 29 '12 at 15:41
  • 1
    This worked for me too. My custom bash script looks like below `sleep $[ ( $RANDOM % 60 ) + 1 ]s && some_script.sh` – Shyam Habarakada Mar 07 '17 at 01:07
  • Am I missing something or the maximum delay should be set to maxdelay=$((14*60/20)) – Jenish Oct 23 '19 at 04:34
  • @jenishSakhiya The random delays for each of the 20 runs is absolute (well, starting at 9am), not relative to another of the runs. That is, if one of the random delays comes up as 13 hours, that means it'll run at 10pm (13 hours after 9am), not 13 hours after any of the other runs. – Gordon Davisson Oct 23 '19 at 04:57
32

Some cron implementations offer a RANDOM_DELAY variable.

The RANDOM_DELAY variable allows delaying job startups by random amount of minutes with upper limit specified by the variable.

See crontab(5) for details.

This is seen commonly in anacron jobs, but also can be useful in a crontab.

You might need to be careful with this if you have some jobs that run at fine (minute) granularity and others that are coarse.

JamesThomasMoon
  • 6,169
  • 7
  • 37
  • 63
Micah Elliott
  • 9,600
  • 5
  • 51
  • 54
  • I would love to use the RANDOM_DELAY variable, but can't find any hint in the manpage of crontab(5) on Ubuntu 14.04.4 LTS. – Exocom Oct 19 '16 at 12:51
  • That's unfortunate. I wonder if it's not supported there. I see it documented in that manpage on Centos 7 and Arch Linux. – Micah Elliott Oct 19 '16 at 17:21
  • 11
    this seems like the correct answer but can you put an example? – chovy Apr 13 '17 at 07:21
  • 16
    Please note that `RANDOM_DELAY` is established once and remains constant for the whole runtime of the daemon. – Maciej Swic May 14 '17 at 11:23
  • That variable does not seem to exist even in Ubuntu 19.04 man page. `cron` package is `3.0pl1-128.1ubuntu1` – Patrick Mevzek Jun 30 '19 at 22:17
  • 16
    The `RANDOM_DELAY` flag is feature of [cronie-crond](https://github.com/cronie-crond/cronie) while Ubuntu seems to be running `vixie-cron` which lacks this flag. – kravietz Jul 18 '19 at 08:00
  • I had to run through a good handful of man pages to find it, but `RANDOM_DELAY` is described in `info crontab` as well as `man 5 crontab` for `cronie` on CentOS 8. I was starting to suspect that it wasn't there, but I was just looking at section 1 instead of section 5. – Steen Schütt Jun 21 '21 at 07:28
11

I ended up using sleep $(( 1$(date +%N) % 60 )) ; dostuffs (compatible with bash & sh)

The 1 prefix is to force NON base 8 interpretation of date +%N (e.g. 00551454)

Do not forget to escape % using \% in a crontab file

* * * * *  nobody  sleep $(( 1$(date +\%N) \% 60 )) ; dostuffs 
Cave Johnson
  • 6,499
  • 5
  • 38
  • 57
131
  • 3,071
  • 31
  • 32
  • 2
    If someone wonders, like me: %N provides current nanos, but some man pages are lacking information for it. This is a very clever solution for people which just need "some randomness" easily per command. – Thorsten Schöning Mar 18 '16 at 14:05
  • 1
    Apart from the caveats already covered elsewhere, this will only work if you have GNU `date` (which you probably do on most Linuxes, but not on Busybox, standard MacOS, or various other BSD-derived platforms). – tripleee May 04 '20 at 12:29
7

My first thought would be to create one cron job launching 20 randomly scheduled at jobs. The at utility (http://unixhelp.ed.ac.uk/CGI/man-cgi?at) is used for executing commands at specified time.

klaus
  • 359
  • 1
  • 3
5

al-x 's Solution does not work for me since crontab commands are not executed in bash but in sh I guess. What does work is:

30 8 * * * bash -c "sleep $[RANDOM\%90]m" ; /path/to/script.py
Wilbert
  • 1,618
  • 15
  • 13
  • I tried everything and it still didn't work for me. You post explained why, thanks! – marlar Mar 10 '20 at 16:45
  • 1
    `$[ ... ]` is deprecated syntax since waaaay back; for anything from this millennium, you would prefer `$((RANDOM\%90))m` which is POSIX-compatible syntax (but of course `RANDOM` is still Bash only). – tripleee May 04 '20 at 12:31
4

You can try with this example to use random times before execute command:

#!/bin/bash
# start time
date +"%H:%M:%S"

# sleep for 5 seconds
sleep $(shuf -i 1-25 -n 1)
# end time
date +"%H:%M:%S"
Houssin Boulla
  • 2,687
  • 1
  • 16
  • 22
3

at -f [file] [timespec]

or

echo [command] | at [timespec]

or

at [timespec] ... and interactive specification like script's recording.

Command

At runs the text provide on stdin or in the file specified by -f [file].

Timespec

Here's the [timespec] grammar. It can be something like:

  • 24-hour time as 4-digit int, e.g. 0100, 2359, 1620
  • now + 10 minutes
  • 2071-05-31 - 5 hours 12 minutes UTC

If you're explicitly specifying the timezone, some versions of the timespec might only allow UTC for the optional timezone argument.

Example

cat script.sh | at now + $(($RANDOM % 10)) hours $(($RANDOM % 60)) minutes

at -f script.sh now + $(($RANDOM % 10)) hours $(($RANDOM % 60)) minutes

Try it out...

You can test the bash parsing by pre-pending echo and escaping the | (pipe).

echo cat script.sh \| at now + $(($RANDOM % 10)) hours $(($RANDOM % 60)) minutes

echo at -f script.sh now + $(($RANDOM % 10)) hours $(($RANDOM % 60)) minutes

To see jobs scheduled, use atq and job contents (environment vars, setup, and command/script) with at -c [jobid].

Note

The system is part of cron, and the interactive prompt actually captures the whole current state of your shell, so you can run commands without specifying absolute paths.

mcint
  • 804
  • 8
  • 18
3

I realize it's an older thread, but I want to add one random-value related thing that I use a lot. Instead of using the $RANDOM variable with a fixed and limited range, I often make arbitrary-range random values in the shell with

dd if=/dev/urandom bs=4 count=1 2>/dev/null | od -N4 -t u4 -A none

so you can do, for example,

FULLRANDOM=$(dd if=/dev/urandom bs=4 count=1 2>/dev/null | od -N4 -t u4 -A none)

and overcome some the restrictions that were discussed in this thread.

Dharman
  • 30,962
  • 25
  • 85
  • 135
MLP
  • 31
  • 2
  • 1
    Welcome to SO. Well, old thread or not, this sent me off to `~$info dd` and I can understand what's going on on the left side of `|`, but can't make out the right side. So, for me and others interested in `overcoming some restrictions` in random value generation, why not take a moment to explain the RHS, and make a stronger pitch for using your approach. The depth of explanation both makes people comfortable with the process you suggest and its benefits Thanks. – Chris Jul 18 '20 at 18:14
  • 2
    Ah ok. od aka "octal dump" takes a file or stdin and dumps the binary data in human-readable form. We want our number shown as an unsigned decimal (-t u4), and don't want the address index (-A none). The -N4 is redundant as we take only 4 bytes, but doesn't hurt either. I hope this explains it... – MLP Jul 19 '20 at 05:13
2

What about creating a script that rewrites the crontab every day?

  1. Read current crons (A)
  2. Pick random times (B)
  3. Rewrite prior crons (A), add new random crons (B)
  4. Make sure to add to the cron to run this script in the first place.
Ted Lyngmo
  • 93,841
  • 5
  • 60
  • 108
mellofellow
  • 57
  • 1
  • 7
  • 2
    Don't circumvent the reputation system by posting comments as answers. Your _comment_ does however look good enough to actually _be_ an answer. I recommend removing "_I don't have rep to add a comment, but_". – Ted Lyngmo Jun 17 '20 at 18:55
  • 1
    I just reviewed this answer and missed the part where you're asking a question in return at the end (sloppy work on my part). Don't ask questions in answers. Post your own question for questions you have. I made your semi-question into something that could pass for an answer. – Ted Lyngmo Jun 17 '20 at 18:57
  • 1
    Got it! Thx. I'll be more careful next time, no ill intent was meant. – mellofellow Jun 17 '20 at 22:12
  • 2
    I'm sure you had no ill intent and you don't need to be overly careful. You outlined a possible solution - and stumbled a bit at the end. No worries! – Ted Lyngmo Jun 17 '20 at 23:25
0

I was looking for the same problem, for me the best solution was to create a schedule on the server side (it's very simple by means of a programming language), populate a db table with these tasks with two columns: run_time and status (new | processed). So my cron runs every minute and finds jobs that need to be done (status = new and running time <= now()). Very simple and there is one huge plus: in this case I can make an interface for it and see what happens...

-1

For those who googled the way here:

If you are using anacron(Ubuntu desktop and laptop) then you can edit

/etc/anacrontab

and add

RANDOM_DELAY=XX 

Where XX is the amount of minutes you want to delay the base job.

Anacron is like cron but it does not expect your computer to be on 24x7 (like our laptops) and will run the scripts that it missed because the system was down.

Ganesh Krishnan
  • 7,155
  • 2
  • 44
  • 52