6

I am a newbie in Spark programming and developing a Spark application using IntelliJ IDE. What I want to achieve is reaching Spark Web UI while continuing debugging in IntelliJ. However, I'am getting "This site can't be reached" error when trying to reach the URL provided by SparkContext.

enter image description here

Is it possible to both monitoring the Spark Web UI and debugging in IntelliJ?

Thanks in advance.

UPDATE

I've already tried http://localhost:4040 and http://localhost:8088. Also, I could reach Spark Web UI from http://localhost:4040 when starting spark-shell via command line interface.

katronai
  • 540
  • 1
  • 8
  • 25

2 Answers2

0

you can see your application on port :8088 ex: https://hostname:8088

roh
  • 1,033
  • 1
  • 11
  • 19
0

I met the same problem. My observation is that when the program is running, you can still access the SparkUI on port 4040. But when you reach the breakpoint, you cannot -- probably because the program is suspended, but I am not very sure.

Hope this helps

Chenghao
  • 345
  • 1
  • 3
  • 10