113

When I stop the script manually in PyCharm, process finished with exit code 137. But I didn't stop the script. Still got the exit code 137. What's the problem?

Python version is 3.6, process finished when running xgboost.train() method.

shawe
  • 1,155
  • 2
  • 7
  • 3

12 Answers12

135

Exit code 137 means that your process was killed by (signal 9) SIGKILL . In the case you manually stopped it - there's your answer.

If you didn't manually stop the script and still got this error code, then the script was killed by your OS. In most of the cases, it is caused by excessive memory usage.

rahul rachh
  • 99
  • 1
  • 12
ykaner
  • 1,740
  • 1
  • 9
  • 13
20

{In my experience}

this is because of Memory issue. When I try to train ml model using sklearn fit with full data set , it abruptly breaks and gives whereas with small data it works fine.

Process finished with exit code 137 (interrupted by signal 9: SIGKILL) Interestingly this is not caught in Exception block either

BrB
  • 815
  • 1
  • 8
  • 13
14

If you are in Ubuntu, increase the SWAP memory. It will work. Use htop to see SWAP usage, when it is full, it will give error 137.

ASJ
  • 141
  • 1
  • 2
  • 9
    welcome to stackoverflow. your answer is useful. Thank you for contributing. A couple of things that can improve your answer would be: adding links to an htop manual and page that explains how to increase SWAP memory, OR explaining these things yourself here. Either way, thank you for your contribution. I'm upvoting it. – Elegant Code Jun 23 '21 at 20:45
5

I had the same error. In my case was related to excessive memory usage. Solved after reseting/cleaning my cache data adding the following code for every variable that will not be used anymore :

MyVariableName = None
Camilo
  • 335
  • 5
  • 7
  • 1
    Could you please elaborate? Do you mean one should insert a literal line of code like "MyValue = None"? – John Strong Feb 20 '19 at 00:00
  • I re-edited my answer. I added "name of your variable"=None for every variable that I will not use anymore. This resets your variable and free the cache. – Camilo Feb 21 '19 at 13:53
  • 8
    You should probably use `del myVariableName` to clear the variable. This makes it no longer in scope and causes it get garbage collected. – Jonno_FTW Sep 26 '19 at 02:48
5

It's not always a memory issue. In my case subprocess.Popen was utilized and it was throwing the error as 137 which looks like signalKILL and the cause is definitely not the memory utilization, because during the runtime it was hardly using 1% of memory use. This seems to be a permission issue after more investigation. I simply moved the scripts from /home/ubuntu to the root directory.

Jack Moody
  • 1,590
  • 3
  • 21
  • 38
user11009049
  • 51
  • 1
  • 1
5

In my case, my RAM ran out, whether it is real or virtual.

Split your data into small pieces or expand your virtual memory.

I choose the latter.

Following scipts works on my ubuntu 20.04 TLS.

# disable the use of swap
sudo swapoff -a

# create the SWAP file. Make sure you have enough space on the hard disk.
# here is my size, the total size is bs*count B
sudo dd if=/dev/zero of=/swapfile bs=1024 count=136314880 status=progress
# output:
# 139458259968 bytes (139 GB, 130 GiB) copied, 472 s, 295 MB/s
# 136314880+0 records in
# 136314880+0 records out
# 139586437120 bytes (140 GB, 130 GiB) copied, 472.372 s, 296 MB/s

# Mark the file as SWAP space:
sudo mkswap /swapfile
# output:
# Setting up swapspace version 1, size = 130 GiB (139586433024 bytes)
# no label, UUID=25a565d9-d19c-4913-87a5-f02750ab625d

# enable the SWAP.
sudo swapon /swapfile

# check if SWAP is created
sudo swapon --show
# output:
# NAME      TYPE SIZE USED PRIO
# /swapfile file 130G   0B   -2

# Once everything is set, you must set the SWAP file as permanent, else you will lose the SWAP after reboot. Run this command:
echo '/swapfile none swap sw 0 0' | sudo tee -a /etc/fstab

After you run your process, memory will grow.

Here is mine:

enter image description here

Good Luck!

reference 1reference 2

Huaiyu Huang
  • 377
  • 2
  • 3
3

I've recently run into this error installing PyCharm on an M1 Mac Mini. It was accompanied by an error that said my SDK was invalid upon compilation of a project. It turns out this was due to my Python Interpreter being pointed at a strange directory, I'm not 100% how this happened.

I went to Preferences > Project:yourProject > Python Interpreter and selected a valid SDK from the drop-down (in my case Python 3.8). You'll know the package is valid because it will populate the package list below with packages.

Again, not sure how it happened on install, but this solved it.

0

My python process get killed with the 137 error code because my Docker for Windows memory limit was set too low.

0
  1. If anyone else were installing pycharm on mac and got the code 137 in PyCharm error while doing a simple print('test') command it most certainly is because of the path to interpreter being present in the new project created.
  2. The error I believe is because of python being installed through brew and it not showing up in the "Python X.YZ /Library/Frameworks/Python.framework/Versions/X.YZ/bin/pythonX" path
  3. Work around uninstall installed python version using brew and then manually install it.
  4. Now it would appear under the interpreter path which is under "Preferences-> Project -> Python Interpreter -> Gear symbol -> add base interpreter" point this to under /Library/Frameworks/.... path
rva
  • 21
  • 1
0

From my experience (Python 3.9.13, MacOSX 12.4), the "SIGKILL" behavior can happen as well if the python code causes low memory. If you run the same code from the command line

$>python your_module.py

the code will crash as well.

I work with quite large Pandas DataFrames (millions of rows, some dozen columns). I have a MacMini with 8 GB RAM and observed that the SIGKILL appears if the memory consumed by Python (MacOS activity monitor) exceeds about 60 GB.

WolfiG
  • 1,059
  • 14
  • 31
0

This is an OOM (Out-Of-Memory):

The sigkill comes from the Kernel because it's out of free memory.

  • buy more RAM
  • use an iterative approach to process data in smaller chunks, which fits into RAM
  • run your program once without PyCharm (PyCharm requires 1 GiB of RAM or more)
  • incrase swap, but you're warned, it's deadly slow
  • created virtual memory
Ilya
  • 1
  • 5
  • 18
-3
  1. Click on the gear icon.
  2. Then set the Poetry environment to Python 3.x.
  3. Click Ok and Apply.

Now the code can run without showing any error!

ouflak
  • 2,458
  • 10
  • 44
  • 49