seeking help regarding converting data from nested JSON to flat json in python

Question

I am looking for converting a nested json into flat json using python. I have the data coming from an API response, the number of keys/columns can be upto 100, and the rows/overall count of elements can be 100k

[{"Name":"John", "Location":{"City":"Los Angeles","State":"CA"}},{"Name":"Sam", "Location":{"City":"Chicago","State":"IL"}}]

I did came across this (Python flatten multilevel JSON) but this flattens the whole JSON completely, as a result everything falls under one line which I am not looking for currently. I also thought of using this on one the data one array at a time in loop but that is causing a lot of load on the system

[{"Name":"John", "City":"Los Angeles","State":"CA"},{"Name":"Sam", "City":"Chicago","State":"IL"}]

score 0 · Answer 1 · answered Aug 16 '19 at 06:16

0

Use unpacking with dict.pop:

[{**d.pop("Location"), **d} for d in l]

Output:

[{'City': 'Los Angeles', 'Name': 'John', 'State': 'CA'},
 {'City': 'Chicago', 'Name': 'Sam', 'State': 'IL'}]

answered Aug 16 '19 at 06:16

Chris

29,127
3
28
51

Thanks Chris for checking on this. but isn't pop supposed to remove the values from dictionary, I never saw pop helping in such a way. I will try this – devops_learner Aug 16 '19 at 06:43
That's the beauty of it: `pop` removes the value so that you don't have to remove the nested dict by yourself :) – Chris Aug 16 '19 at 07:37
I am getting this error ``` IndexError: pop index out of range ``` I think because pop keeps on reducing the index. – devops_learner Aug 16 '19 at 09:57
Any thoughts on this. – devops_learner Aug 16 '19 at 12:48

seeking help regarding converting data from nested JSON to flat json in python

1 Answers1