Scrapy spider - Scheduling process like rq worker

Question

I need to schedule the scrapy spiders in different time zones. Previously I have used the rq worker for the python script it dosen't support the scrapy spider.

Kindly anyone can suggest the idea to schedule the scrapy spiders

Answer 1

TwistedScheduler from APScheduler can handle scheduling of Scrapy and also supports time zones.

Here is an example that uses APScheduler to schedule Scrapy-spiders. You would have to edit the call of the add_job()-method to fit your specific needs, so add the timezone-parameter to it, change the trigger from interval to date or cron etc. See APSchedulers official documentation for all available parameters.