where to find all the "options" available on spark.read api on Spark DataFrame

Asked Aug 23 '18 at 14:21

Active Aug 23 '18 at 15:15

Viewed 90 times

val df = spark.read    
              .format("json")
              .option("inferSchema=true")
              .option("multiline=true")
              .load("/file/to/something.json")

I would like to know all the options available on this spark.read API in Spark 2.3.0

Where to find these details? I've tried searching in Spark documentation but I was unable to find that.

EDIT: Where is the reference for options for writing or reading per format? this does not have the list of all the available option for the "spark.read" API, i am not interested in spark.write api.

edited Aug 23 '18 at 14:38

asked Aug 23 '18 at 14:21

TheCodeCache

I am looking for all the hardcoded "option" values which is available on the spark.read.option(...) api – TheCodeCache Aug 23 '18 at 14:39
You need to be creative and try things, that's how I did it. – thebluephantom Aug 24 '18 at 06:56

where to find all the "options" available on spark.read api on Spark DataFrame

0 Answers0