Would it be possible to share some memory with GNU Parallel?

Asked Jan 21 '16 at 20:37

Active Jan 21 '16 at 20:37

Viewed 166 times

Imagine that you use gnu parallel to run several script that load every time a big object in memory, like a corpus of document for example. In the case of a read only acces to this object the question is:

Can I load this object once in memory and share the read access by all the process running under Gnu Parallel ?

asked Jan 21 '16 at 20:37

dtrckd

Would using `/dev/shm` help here? – Dima Chubarov Jan 22 '16 at 11:52
If you can load the object using mmap, then it ought to work. In other words: It depends more on the worker scripts than on GNU Parallel. – Ole Tange Jan 22 '16 at 14:51
So it means to the workers should try to acess an existing thread for example ? – dtrckd Jan 22 '16 at 15:28
Or maybe some IPC (systemV) methods. Any preference ? – dtrckd Jan 22 '16 at 15:35

Would it be possible to share some memory with GNU Parallel?

0 Answers0

Linked