3

I'm running a Jupyter Notebook with some code involving pySpark where I get a Py4JJavaError error as output. This error is truncated, that means that I cannot see all the lines; the very last being a:

... 44 more

Is there a way to make the Notebook display all the output rows?

espogian
  • 607
  • 8
  • 23

1 Answers1

1

It looks like that's all the interpreter will print. Is it also the same case for other run cases?

You can try to run in a debugging mode.

from IPython.core.debugger import set_trace

and 

set_trace()

evokes a breakpoint. source You can also try the solution here if it helps.

AzyCrw4282
  • 7,222
  • 5
  • 19
  • 35
  • Thank you, this improved the output (more details in the error lines) but I still can not see all the lines – espogian Apr 23 '20 at 07:40
  • 1
    I am not able to find a straight answer on how this can be done on Jupyter. I also think this is because printing full error traceback would be enormous, sometimes it could involve 10+ files and this is just tedious with a lot of redundant info. You can though try this [method here](https://stackoverflow.com/a/16946886/6505847) – AzyCrw4282 Apr 23 '20 at 08:18