0

I am trying to build a Flask application on Windows where user uploads a big Excel file then it is processed in Python which takes 4-5 minutes. I need to process those tasks in background after user uploads the file.

I RQ, Celery, etc. but those are not working on Windows and I have never worked on Linux. I need some advice on how to achieve this.

davidism
  • 121,510
  • 29
  • 395
  • 339
Anil Patel
  • 31
  • 1
  • 4

3 Answers3

2

celery and rq can work on windows but have some trouble

for rq use this

and for celery use this

hn_tired
  • 690
  • 10
  • 21
1

I don't think it's accurate to say that you can't run RQ on Windows, it just has some limitations (as you can in the documentation).

As you can run Redis on Windows, you might want to give a try to other task queues based on Redis. One such example is huey. There are at least examples of people who were successful running it on Windows (e.g. look at this SO question).

Tomáš Linhart
  • 9,832
  • 1
  • 27
  • 39
  • Thankyou for your input.. I have seen this thread and tried to setup huey with available info.. I am gonna try it once again.. meanwhile more inputs from other experts are most welcome – Anil Patel Apr 11 '19 at 14:45
  • well at least when rq worker receives job it pops up this self-explanatory error : `AttributeError: module 'os' has no attribute 'fork'` – elsadek Jan 14 '22 at 07:05
1

I solved this by using WSL Linux Emulation on windows.. and running my RQ worker on WSL.. I am not sure though if I will face any issues in future but as of now its queuing and processing tasks as I desire..

info Might be useful for somebody with same problem

Anil Patel
  • 31
  • 1
  • 4