0

Hi I'm using Jupyterlab 3.1.9. Can you tell me how do I fund my pyspark version using jupyter notebook in Jupyterlab Tried following code

from pyspark 
import SparkContext 
sc = SparkContext("local", "First App") 
sc.version

But I'm not sure if it's returning pyspark version of spark version

JDoe
  • 423
  • 2
  • 9
  • 19
  • `spark.version`? – blackbishop Feb 14 '22 at 11:30
  • @blackbishop, I tried `from pyspark import SparkContext sc = SparkContext("local", "First App") sc.version` But I'm not sure if it's giving pyspark version or spark version – JDoe Feb 14 '22 at 11:38
  • 3
    Why do you think they are different? Pyspark is just Python API to use Spark. both `sc.version` and `spark.version` give you the version. – blackbishop Feb 14 '22 at 11:59
  • https://stackoverflow.com/questions/38586834/how-to-check-spark-version – JAdel Feb 14 '22 at 12:57

1 Answers1

1

You can check on jupyter by these method.

enter image description here

sonia
  • 75
  • 1
  • 1
  • 9