1

I would need to send a pretty large amount (logs) amount of data from multiple processes to one master processes. They are all running independent on the system.

What would be the best way to do this? Is interprocess communication a good way to do that or should I use shared memory? Maybe there is a different way I don't know yet.

The language used is C on Linux, because I have to implement it in a existing program.

How would you accomplish it?

Merl
  • 96
  • 1
  • 6

2 Answers2

0

Apart from Inter process communication using pipes/named pipe See this SO question and shared memory See this SO question and So question for fastest and large size data discussion .(It directs on using shared memory(fast and large) and pipes(easy).

You can try using Sockets. Where master listens on a port and all slaves connect to that port and master accepts connection.But this may lead to packeting and resource overhead.

Community
  • 1
  • 1
cruxion effux
  • 1,054
  • 3
  • 14
  • 27
0

If its is unidirectional then I would recommend you to go for pipe; simple and straight forward.

If it is bi-directional then I would suggest you to go for socket programming rather than going for other inter process communication; The reason is "you end up writing locking mechanisms"; With socket you don't need to deal with those and more over your life will be easier in terms of coding.

Viswesn
  • 4,674
  • 2
  • 28
  • 45
  • For bi-directional, couldn't you easily use two pipes? – sudo Jun 13 '15 at 19:02
  • 1
    definitely we can use but I am not recommending this here because @Merl specified that there will be multiple process sending data to master so if we have more than 10 process then we will have 20 pipes and its make things complex in terms of writing code and debugging too. – Viswesn Jun 13 '15 at 19:05