Questions tagged [pp-python-parallel]
6 questions
2
votes
1 answer
python-2.7 bug in inspect()?
I want to parallelize execution of a for loop on the quadcore processor of my computer's CPU. I am using pp (Python-Parallel) - rather than joblib.Parallel for reasons considered here.
But I am getting an error:
Traceback (most recent call last):
…
Alexandre Holden Daly
- 6,944
- 5
- 25
- 36
2
votes
1 answer
python joblib.Parallel vs Parallel-Python: parallelise over multiple cores of a single CPU?
I want to parallelize the execution of a for loop written in python-2.7 on the quadcore processor of my computer's CPU.
Shall I implement this with joblib.Parallel or with Parallel-Python?
I've seen joblib.Parallel being used more, but the first…
Alexandre Holden Daly
- 6,944
- 5
- 25
- 36
1
vote
1 answer
Parallelize this list comprehension in Python
I'm trying to make this statement run in parallel (on 4 threads).
[x for x in obj_list if x.attribute == given_attribute]
Any help would be appreciated.
I found this question useful for other type of comprehension, but not for filtering like in…
van
- 367
- 4
- 13
1
vote
1 answer
Python Multiprocessing arcgis shapefiles with PP or async stalling on large files
I am new trying to implement either Parallel Python (PP) or async to multiprocess arcgis shapefile clipping. I have been successful with both pool_async and PP; however, it stalls forever on big files (and yes I tried making python access large…
droid-zilla
- 536
- 7
- 8
0
votes
1 answer
Import specific class or function in Python Parallel job
If you are using some modules in a function passed to Server.submit [docs], you need to specify these in the modules argument. See below:
import os
def get_os_name():
return os.name
jobserver.submit(get_os_name,modules=('os',))
But, I would…
Marcus Johansson
- 2,626
- 2
- 24
- 44
-1
votes
1 answer
For loop parallel in python
I am working in parallelization in python.. and I have big calculation need to be parallel.
at first I have big for loop for (1000 particles for example) so my process was not independent ,and I need independent process to make it parallel. so I…
dbr
- 11
- 4