how to run parallel job in python

Question

I am doing a data mining project in Python, and during the experiment phase I have to run many experiments at the same time. How could I create n processes, so that each process is dedicated to an experiment? Which module I should use?

score 7 · Accepted Answer · edited May 23 '17 at 10:32

7

Have a look at Does python support multiprocessor/multicore programming?

Then look at http://wiki.python.org/moin/ParallelProcessing for more options

but generally python multiprocessing(http://docs.python.org/library/multiprocessing.html) module will be enough

edited May 23 '17 at 10:32

Community

1
1

answered Nov 12 '09 at 08:33

score 6 · Answer 2 · answered Nov 12 '09 at 07:58

6

Have a look at the multiprocessing module.

answered Nov 12 '09 at 07:58

Pär Wieslander

28,374
7
55
54

how to run parallel job in python

2 Answers2