Get Schema details from the Multiline Json File

Asked Jan 12 '21 at 19:35

Active Jan 12 '21 at 19:49

Viewed 156 times

The following sample code would read the file as it is but need spark.read alternative in python to read the schema:

import json
with open('F:/Samp_Multiline.json', 'r') as jf:
    weatherData = json.load(jf)
    SS = json.dumps(weatherData)
    SS1 = json.loads(SS)
    print(SS1)

Expected output to be schema rather than the actual file contents.

In Spark, this can be achieved by

multiline_df.printSchema()
    multiline_df.show(false)

but needed the alternative in Python.

edited Jan 12 '21 at 19:49

asked Jan 12 '21 at 19:35

Ambitioussignal

try this print(SS1.keys()) ref: https://stackoverflow.com/questions/15789059/python-json-only-get-keys-in-first-level – FAhad Al-Hantushi Jan 12 '21 at 19:37
Thanks for a quick response; Its showing only the first level key but need to schema in whole – Ambitioussignal Jan 12 '21 at 19:41
For a Json file, trying to get the schema using python, file is present in windows instead of linux where we can use spark – Ambitioussignal Jan 12 '21 at 19:57
{"votes": {"funny": 2, "useful": 5, "cool": 1}, "user_id": "viswa", "name": "viswa", "url": "http://example.org/user_details?userid=viswa", "average_stars": 3.5, "review_count": 12, "type": "user"} – Ambitioussignal Jan 12 '21 at 20:05
Schema, I mean the Json structure for the file – Ambitioussignal Jan 13 '21 at 08:56

Get Schema details from the Multiline Json File

0 Answers0