OSError: [Errno 24] Too many open files - OS Mojave

Question

So, I'm writing a script to take a certain dataset, sample it 100 times using different random seeds, completing all these datasets and then getting the mean error. However, whenever I try to run the script I end up with the error OSError: [Errno 24] Too many open files

I don't understand what I can do to fix this (if I should do something in the script or in to the system and what). I'm using Python 3 with macOS Mojave. Anybody has a clue?

Possible duplicate of [IOError: \[Errno 24\] Too many open files:](https://stackoverflow.com/questions/18280612/ioerror-errno-24-too-many-open-files) — Finn Shadow, Jul 01 '19 at 23:44

ChristianF · Accepted Answer · 2020-07-19T20:07:54.073

14

The number of open files you're allowed can be increased by using ulimit e.g. in bash you could do: ulimit -n This will probably print out 256 meaning that at one time a maximum of 256 file descriptors are allowed to be open.

Increase the limit: ulimit -n 30000 # 30,000 open files allowed

This sort of thing is generally done on systems running something like server programs that need a file descriptor (a socket descriptor) for each concurrent connection being handled.

However, if you post the code there might be another way to fix this. It doesn't sound like you want/need multiple file descriptors open at the same time.

edited Jul 19 '20 at 20:07

answered Jul 01 '19 at 23:45

ChristianF

1,735
4
28
56

For me this doesn't work, for any number bigger than current limit which is 10240 I get `cannot modify limit: Invalid argument`. I am using MacOS Mojave 10.14.6 – Florin Dobre Jul 25 '19 at 08:21
2

Pretty sure that's a kernel imposed limit for macOS – ChristianF Jul 26 '19 at 15:21
If you want to see your current limit, run `ulimit -n` or `ulimit -a` rather than `ulimit`! – George Ogden Jun 03 '21 at 10:08
Thanks - I can confirm this works on macbook + Ventrua – natersoz Jan 19 '23 at 04:41

OSError: [Errno 24] Too many open files - OS Mojave

1 Answers1

Linked