Robo and Codeception run large number of parallel processes

Question

I'm using Codeception for testing the API endpoints of my webserver. I want to execute some stress tests so, in a Cest file called 'StressCest', I've written some tests that execute several calls to the most used endpoints of my server.

I want to launch (in parallel) a large number of multiple instances of this Cest file.

For this propose i've used Robo. I've setted A Robo configuration file (RoboFile.php) with a "parallelRun()" (https://codeception.com/docs/12-ParallelExecution) method inside.

public function parallelRun()
{
    $parallel = $this->taskParallelExec();
    for ($i = 1; $i <= 1000; $i++) {
        $parallel->process(
            $this->taskCodecept()
                ->suite('api')
                ->test('StressCest')
        );
    }
    return $parallel->run();
}

That spawn 1000 parallel processes of StressCest. When I execute the console command robo parallel:run this error appear:

Warning: proc_open(): unable to create pipe Too many open files in /../vendor/symfony/process/Process.php on line 337 [error] Unable to launch a new process. ERROR: proc_open(): unable to create pipe Too many open files in /../vendor/symfony/process/Process.php:337

Is there some method to bypass this error or another way to execute parallel stress test with a CestFile?

Thank you in advance for any response

It is an OS limit: https://stackoverflow.com/a/34645/366348 – Naktibalda Apr 01 '19 at 11:50 — Naktibalda, Apr 01 '19 at 11:50
Yes, I confirm it was a limit of my operative system. – giovaZ Apr 03 '19 at 10:55 — giovaZ, Apr 03 '19 at 10:55

score 0 · Answer 1 · answered Apr 03 '19 at 10:57

0

I've resolved this issue incrementing my OS open files limit

Here is a guide for MacOSX also valid form Mojave

Thank you all for all the help. Hope this question will help someone else.

answered Apr 03 '19 at 10:57

giovaZ

1,432
3
20
62

Robo and Codeception run large number of parallel processes

1 Answers1