google colab - port forwarding

Asked Aug 28 '20 at 12:37

Active Aug 28 '20 at 12:53

Viewed 2,474 times

Google colab is great for the notebook - however, I want to access the user interface of a running process such as mlflow or spark from my local machine.

For the example case of spark:

!pip install pyspark
import pyspark
from pyspark.sql import SparkSession
spark = SparkSession.builder.master("local[2]").getOrCreate()
spark

The URI to the spark UI: http://5eb11567e012:4040/ cannot be resolved in my browser.

I guess some sort of port forwarding should do the trick? A) is there a better option and B) if not, how to set up the port forwarding?

edit

Notice: I have read some tutorials which mount the google colab directory into google drive and that one locally - but this is NOT a desired solution (and in the case of spark would not work anyways).

edited Aug 28 '20 at 12:53

Lamanus

12,898
4
21
47

asked Aug 28 '20 at 12:37

Georg Heiler

16,916
36
162
292

https://stackoverflow.com/questions/48459804/how-can-i-ssh-to-google-colaboratory-vm sounds promising – Georg Heiler Aug 28 '20 at 12:48
Indeed, using ngrok as defined https://stackoverflow.com/questions/48459804/how-can-i-ssh-to-google-colaboratory-vm works just fine – Georg Heiler Aug 28 '20 at 13:23
Check out my answer in a different question here: https://stackoverflow.com/a/64183673/783874 – ponadto Oct 03 '20 at 11:25

google colab - port forwarding

edit

0 Answers0