Append API data to Pandas DataFrame in Python

Question

I am request data from the Zoopla API, going through each of the page and then finally trying to append the data in a dataframe. I am using the following code:

raw_data = pd.DataFrame([])

for i in range(1,5):
    r = requests.get('http://api.zoopla.co.uk/api/v1/property_listings.json?area=Nottingham&api_key=my_key&page_size=20&page_number='+str(i))
    data = r.json()
    df_temp = pd.DataFrame.from_dict(data['listing'])
    raw_data.append(df_temp,ignore_index=True,sort=False)

The code above, however, doesn't append any data to raw_data at all.

raw_data.shape // returns (0,0) after the for loop.

Note: I haven't shared my API key in the url above. I can confirm that I am receiving data from the API

Have you confirmed that you are receiving data from requests? — Daniel Scott, Jan 07 '19 at 19:19
hey Daniel, yes I am. I haven't shared my API key publicly here. You will see in the URL I've replaced my API key with "my_key" @DanielScott — Nant, Jan 07 '19 at 19:22
Great, and have you confirmed that it is real json? If the json snippet is small, can you post it here? — Daniel Scott, Jan 07 '19 at 19:23

score 1 · Accepted Answer · answered Jan 07 '19 at 19:30

1

Append isn't an inplace operation by default. You can fix it by changing to

raw_data = raw_data.append(df_temp,ignore_index=True,sort=False)

answered Jan 07 '19 at 19:30

Allen

236
3
12

this works. Thanks so much – Nant Jan 07 '19 at 19:42

Append API data to Pandas DataFrame in Python

1 Answers1