0

What is the alternate of inferschema in Spark 2.0 or above ? I am unable execute sqlContext.inferschema

pratik rudra
  • 41
  • 2
  • 9

1 Answers1

0

from spark documentation , inferSchema is deprecated in version 1.3, use createDataFrame() instead.

Pushkr
  • 3,591
  • 18
  • 31
  • Thanks Pushkar , however I am getting error in pyspark installed in windows machine with below query - orderItemsSchema = sqlContext.createDataFrame(orderItems) ----------Py4JJavaError: An error occurred while calling o785.applySchemaToPythonRDD. : java.lang.RuntimeException: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient – pratik rudra Apr 12 '17 at 06:03
  • check this - http://stackoverflow.com/questions/35449274/java-lang-runtimeexception-unable-to-instantiate-org-apache-hadoop-hive-ql-meta#35594597 – Pushkr Apr 12 '17 at 12:33