How to set crontab for a Python and Selenium script at which the browser is to be opened at the time of script execution

Question

I have a Python script for web scraping using Selenium. In that I want to execute the script in a period of time. For that, I want to know how to schedule using crontab on Ubuntu.

Crontab is not opening the browser and executing the Selenium automation, so is there another way to schedule the Python script?

why dont you simply do `crontab -e` and edit the file. This is one time task — Yugandhar Chaudhari, Nov 05 '19 at 07:24
Please use the below link as this is already answered. https://stackoverflow.com/questions/8727935/execute-python-script-via-crontab — Navin Dalal, Nov 05 '19 at 07:27
Please use the below link as this is already answered https://stackoverflow.com/questions/8727935/execute-python-script-via-crontab — Navin Dalal, Nov 05 '19 at 07:28

score 0 · Accepted Answer · edited Nov 21 '20 at 21:16

0

Run command

sudo  crontab -e

If you want to run your script every two hours,

0 */2 * * *  DISPLAY=:0 /usr/bin/python3.7 /home/monic/PycharmProjects/scrap.py

You can adjust the cron schedule from here.

edited Nov 21 '20 at 21:16

Peter Mortensen

30,738
21
105
131

answered Nov 05 '19 at 07:28

Zakaria Shahed

2,589
6
23
52

score 0 · Answer 2 · answered Nov 05 '19 at 07:42

0

You can use this tool to determine your cron expression.

Do

sudo  crontab -e

Choose the editor if asked nano is easier

Go to the bottom of the file use your cron expression interpretor and path to the python script like this

* * * * * /usr/bin/python /home/myuser/script.py

Above script will run every minute

Explanation

* * * * * is cron-expression 

/usr/bin/python is path to interpretor

/home/myuser/script.py is path to script

answered Nov 05 '19 at 07:42

Yugandhar Chaudhari

3,831
3
24
40

I did the same but not executing the script @Yugandhar Chaudhari – Monic Annadurai Nov 05 '19 at 07:45
What is your time interval if it is too long then you should wait please post what you have done it is difficult to help without it – Yugandhar Chaudhari Nov 05 '19 at 07:47
`19 13 05 11 02 /usr/bin/python /home/monic/PycharmProjects/scrap.py` – Monic Annadurai Nov 05 '19 at 07:49
Your cron expression is wrong what is your time interval? Every day, every hour ? what is it? – Yugandhar Chaudhari Nov 05 '19 at 07:51
It will only run At 13:19 on day-of-month 5 and on Tuesday in November.” – Yugandhar Chaudhari Nov 05 '19 at 07:52
I set for the current time to execute the script 1 19 PM (IST) NOV 15 Tuesday – Monic Annadurai Nov 05 '19 at 07:52
yes at that time it didn't execute @Yugandhar Chaudhari – Monic Annadurai Nov 05 '19 at 07:54
What your script does it will run in background is it testable like getting an email? – Yugandhar Chaudhari Nov 05 '19 at 07:56
As I said in question , webscraping using python and selenium and store extracted data to mysql – Monic Annadurai Nov 05 '19 at 07:58
What timzone is set for crontab ? – Yugandhar Chaudhari Nov 05 '19 at 08:09
India Standard Time – Monic Annadurai Nov 05 '19 at 08:12
You should read this https://stackoverflow.com/help/how-to-ask – Yugandhar Chaudhari Nov 05 '19 at 08:14

How to set crontab for a Python and Selenium script at which the browser is to be opened at the time of script execution

2 Answers2