IOPub data rate exceeded in Jupyter notebook (when viewing image)

Question

I want to view an image in Jupyter notebook. It's a 9.9MB .png file.

from IPython.display import Image
Image(filename='path_to_image/image.png')

I get the below error:

IOPub data rate exceeded.
The notebook server will temporarily stop sending output
to the client in order to avoid crashing it.

A bit surprising and reported elsewhere.

Is this expected and is there a simple solution?

(Error msg suggests changing limit in --NotebookApp.iopub_data_rate_limit.)

Is there a way to increase this from just the notebook itself instead of changing the config on the command line? I'm working in a shared environment and don't have rights to change jupyter on the command line. — Mike Pone, Nov 23 '21 at 14:40

Merlin · Accepted Answer · 2018-10-23T17:36:56.830

207

Try this:

jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10

Or this:

yourTerminal:prompt> jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10

edited Oct 23 '18 at 17:36

answered Jun 21 '17 at 14:40

Merlin

24,552
41
131
206

6

If your just looking for a temporary solution this is the easiest way to go. – mkrinblk Jul 13 '17 at 23:05
21

If I could, I would give a second upvote for using the scientific notation. – Tomasz Gandor Oct 16 '17 at 22:31
1

@TomaszGandor Although by doing so, it is a float now instead of an int. This could have undesirable effects in general, but it's probably fine here. – scottlittle Nov 07 '17 at 14:39
4

where can you run this code if you use Anaconda user interface to open up a Jupyter Notebook? – bernando_vialli Jun 25 '18 at 16:34
6

Can anyone help? I keep on trying to figure out where to put this? – bernando_vialli Aug 29 '18 at 17:41
3

I used the prompt under "Try this:" and now I can barely use Jupyter. How can I reverse it? – Tyrone_Slothrop Aug 05 '20 at 21:50
You need to put this in Anaconda prompt – Mateusz Oct 23 '21 at 08:42
1

This needs to go in terminal. Both his commands are the same. Needs a terminal to execute it. – Suprateem Banerjee Nov 29 '21 at 01:02
I use "jupyter lab" rather than "jupyter notebook". Note well that I don't actually really _understand_ what either is, other than that "jupyter lab is a thing that pops up my browser and allows me to type and execute python-like sagemath code with powerful multiprecision primitives". How does this answer translate to my use case? I was trying to print a huge string and ran into this error. – Szczepan Hołyszewski Apr 26 '22 at 17:30
@bernando_vialli open a new shell tab in Terminal – ttoshiro Aug 14 '22 at 02:55

Itay Livni · Answer 2 · 2017-12-15T04:40:53.840

98

I ran into this using networkx and bokeh

This works for me in Windows 7 (taken from here):

To create a jupyter_notebook_config.py file, with all the defaults commented out, you can use the following command line:

$ jupyter notebook --generate-config
Open the file and search for c.NotebookApp.iopub_data_rate_limit
Comment out the line c.NotebookApp.iopub_data_rate_limit = 1000000 and change it to a higher default rate. l used c.NotebookApp.iopub_data_rate_limit = 10000000

This unforgiving default config is popping up in a lot of places. See git issues:

It looks like it might get resolved with the 5.1 release

Update:

Jupyter notebook is now on release 5.2.2. This problem should have been resolved. Upgrade using conda or pip.

edited Dec 15 '17 at 04:40

answered Apr 14 '17 at 23:12

Itay Livni

2,143
24
38

2

After creating the config file, you can run `jupiter notebook`; since the jupyter_notebook_config.py was written to your Jupyter folder (for me: C:\Users\nnd\.jupyter\jupyter_notebook_config.p) ; Jupyter will pick up your changes. – Nate Anderson May 07 '17 at 22:36
2

If you cannot run jupyter notebook from cmd.exe (windows 10), try doing so from 'Anaconda prompt' (if you have that installed). – andyw Aug 30 '17 at 10:58
2

@Itay Livni: my windows command line doesn't recognise the command `$ jupyter notebook --generate-config` and says the command is either wrong or couldn't be found. I have windows 10. any suggestions? – artre Oct 22 '17 at 11:00
2

@artre `notebook --generate-config` should be typed. not the dollar sign – Itay Livni Oct 22 '17 at 15:00
@ItayLivni I tried that. but also without the dollar sign i get the same error message. – artre Oct 22 '17 at 16:10
1

@artre You should browse to the location of your jupyter,exe and then run the command provided above. For me it was in `\documents\anaconda2\scripts` – Salain Nov 21 '17 at 16:51
Release 5.2.2 is not in the changelog. The default config is the same in my 6.4.9 version. – liakoyras Mar 16 '22 at 12:55
1

I'm on 6.4.6, and still have the issue. – Hugh Perkins Jun 30 '22 at 14:23
v6.5.2 just gave me this issue. Never seen it previously. – sh37211 Mar 18 '23 at 02:48

score 32 · Answer 3 · answered Feb 02 '21 at 02:55

32

Removing print statements can also fix the problem.

Apart from loading images, this error also happens when your code is printing continuously at a high rate, which is causing the error "IOPub data rate exceeded". E.g. if you have a print statement in a for loop somewhere that is being called over 1000 times.

answered Feb 02 '21 at 02:55

azizbro

3,069
4
22
36

1

Amazinng It works perfactly for me. Thanks @azizbro
`import pandas as pd df=pd.DataFrame() df = pd.read_json('applicant-schema.json') #print(df.to_string()) ` – prashant thakre Feb 15 '22 at 05:22
Perfect Solution – raiyan22 Aug 10 '23 at 06:49

score 9 · Answer 4 · edited Jan 18 '20 at 03:18

9

By typing 'jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10' in Anaconda PowerShell or prompt, the Jupyter notebook will open with the new configuration. Try now to run your query.

edited Jan 18 '20 at 03:18

Merlin

24,552
41
131
206

answered Dec 20 '19 at 22:58

munzer manzlgi

91
1
1

score 6 · Answer 5 · answered May 22 '20 at 11:27

Some additional advice for Windows(10) users:

If you are using Anaconda Prompt/PowerShell for the first time, type "Anaconda" in the search field of your Windows task bar and you will see the suggested software.
Make sure to open the Anaconda prompt as administrator.
Always navigate to your user directory or the directory with your Jupyter Notebook files first before running the command. Otherwise you might end up somewhere in your system files and be confused by an unfamiliar file tree.

The correct way to open Jupyter notebook with new data limit from the Anaconda Prompt on my own Windows 10 PC is:

(base) C:\Users\mobarget\Google Drive\Jupyter Notebook>jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10

Andrei Tulbure · Answer 6 · 2022-07-01T05:30:19.250

3

I have the same problem in my Jupyter NB on Win 10 when querying from a MySQL database.

Removing any print statements solved my problem.

edited Jul 01 '22 at 05:30

answered Jul 01 '22 at 05:29

Andrei Tulbure

61
7

score 2 · Answer 7 · answered Sep 24 '21 at 19:48

I ran into this problem running version 6.3.0. When I tried the top rated solution by Merlin the powershell prompt notified me that iopub_data_rate_limit has moved from NotebookApp to ServerApp. The solution still worked but wanted to mention the variation, especially as internal handling of the config may become deprecated.

score 1 · Answer 8 · answered Jun 30 '21 at 14:41

1

For already running docker containers, try editing the file name - ~/.jupyter/jupyter_notebook_config.py uncomment the line - NotebookApp.iopub_data_rate_limit = and set high number like 1e10. Restart the docker, it should fix the problem

answered Jun 30 '21 at 14:41

Sincole Brans

186
12

score 0 · Answer 9 · answered Feb 24 '22 at 02:07

Easy workaround is to create a for loop and print. Then there wont be any issue. Printing directly wcc would cause if graph is huge. Hence any of below code will work as workaround.

wcc=list(nx.weakly_connected_components(train_graph)) for i in range(1,10): print(wcc[i])

for i in wcc): print(wcc)

Skynet · Answer 10 · 2022-04-19T19:20:42.573

0

Using Visual Studio Code, the Jupyter extension will be able to handle big data. launch from anaconda navigator

edited Apr 19 '22 at 19:20

answered Mar 24 '22 at 16:23

Skynet

35
6

score 0 · Answer 11 · answered Apr 19 '22 at 15:31

0

Like others pointed out, print statement at a high rate can cause this. Resolve it by printing modulo a number using if statement. Example in python:

k = 10
if (i % k == 0):
   print("Something")

Increase k if the warning persists.

answered Apr 19 '22 at 15:31

Toonia

61
1
7

score 0 · Answer 12 · answered Apr 29 '22 at 00:51

0

In general, trying to print something that is too long will trigger this error. I tried to print a string that was 9221593 characters long (too long), and that triggered the error.

answered Apr 29 '22 at 00:51

Javier Marchena Hurtado

11

score 0 · Answer 13 · answered Apr 09 '23 at 05:25

I get the same error message in JupyterLab 3.6.3 (on Python 3.10.0 on Windows 10) when I use the help() on Pandas.

Although the help() function does not use print explicitly, the pandas documentation is 100s of pages long, so probably exceeds JupyterLab's or Jupyter Notebook capacity to display it.

The return type of the help() function and it is a NoneType so it likely uses the print() function internally or at least the str() attribute, which is the equivalent result as the print() function.

$ import pandas

$ help(pandas)

IOPub data rate exceeded. The Jupyter server will temporarily stop sending output to the client in order to avoid crashing it. To change this limit, set the config variable --ServerApp.iopub_data_rate_limit.

I get the same error message from Jupyter Classic NB started from the Help menu of JupyterLab 3.6.3.

IOPub data rate exceeded. The Jupyter server will temporarily stop sending output to the client in order to avoid crashing it. To change this limit, set the config variable --ServerApp.iopub_data_rate_limit.

Current values: ServerApp.iopub_data_rate_limit=1000000.0 (bytes/sec) ServerApp.rate_limit_window=3.0 (secs)

Server Information: You are using Jupyter NbClassic.

Jupyter Server v2.5.0 Jupyter nbclassic v0.5.3 (started using the "Launch Jupyter Classic Notebook dropdown menu within JupyterLab "Help" menu)

The solution above ( jupyter notebook --NotebookApp.iopub_data_rate_limit=1.0e10 ) eliminated the help() function output error message. It gives me the full pandas help documentation within the JupyterLab NB output cell.

Thanks for the answers.

IOPub data rate exceeded in Jupyter notebook (when viewing image)

13 Answers13

Update:

Linked