2

I am trying to load a csv file from the following URL into a dataframe using Python 3.5 and Pandas:

link = "http://api.worldbank.org/v2/en/indicator/NY.GDP.MKTP.CD?downloadformat=csv"

The csv file (API_NY.GDP.MKTP.CD_DS2_en_csv_v2.csv) is inside of a zip file. My try:

import urllib.request
urllib.request.urlretrieve(link, "GDP.zip")
import zipfile
compressed_file = zipfile.ZipFile('GDP.zip')
csv_file = compressed_file.open('API_NY.GDP.MKTP.CD_DS2_en_csv_v2.csv')
GDP = pd.read_csv(csv_file)

But when reading it, I got the error "pandas.io.common.CParserError: Error tokenizing data. C error: Expected 3 fields in line 5, saw 62".

Any idea?

Antonio Serrano
  • 882
  • 2
  • 14
  • 27

1 Answers1

1

I think you need parameter skiprows, because csv header is in row 5:

GDP = pd.read_csv(csv_file, skiprows=4)
print (GDP.head())
  Country Name Country Code     Indicator Name  Indicator Code          1960  \
0        Aruba          ABW  GDP (current US$)  NY.GDP.MKTP.CD           NaN   
1      Andorra          AND  GDP (current US$)  NY.GDP.MKTP.CD           NaN   
2  Afghanistan          AFG  GDP (current US$)  NY.GDP.MKTP.CD  5.377778e+08   
3       Angola          AGO  GDP (current US$)  NY.GDP.MKTP.CD           NaN   
4      Albania          ALB  GDP (current US$)  NY.GDP.MKTP.CD           NaN   

           1961          1962          1963          1964          1965  \
0           NaN           NaN           NaN           NaN           NaN   
1           NaN           NaN           NaN           NaN           NaN   
2  5.488889e+08  5.466667e+08  7.511112e+08  8.000000e+08  1.006667e+09   
3           NaN           NaN           NaN           NaN           NaN   
4           NaN           NaN           NaN           NaN           NaN   

              2008          2009          2010          2011  \
0     ...       2.791961e+09  2.498933e+09  2.467704e+09  2.584464e+09   
1     ...       4.001201e+09  3.650083e+09  3.346517e+09  3.427023e+09   
2     ...       1.019053e+10  1.248694e+10  1.593680e+10  1.793024e+10   
3     ...       8.417803e+10  7.549238e+10  8.247091e+10  1.041159e+11   
4     ...       1.288135e+10  1.204421e+10  1.192695e+10  1.289087e+10   

           2012          2013          2014          2015  2016  Unnamed: 61  
0           NaN           NaN           NaN           NaN   NaN          NaN  
1  3.146152e+09  3.248925e+09           NaN           NaN   NaN          NaN  
2  2.053654e+10  2.004633e+10  2.005019e+10  1.933129e+10   NaN          NaN  
3  1.153984e+11  1.249121e+11  1.267769e+11  1.026269e+11   NaN          NaN  
4  1.231978e+10  1.278103e+10  1.321986e+10  1.139839e+10   NaN          NaN
jezrael
  • 822,522
  • 95
  • 1,334
  • 1,252
  • I have omitted that argument for simplification. I tried that before but I got this error: "pandas.io.common.EmptyDataError: No columns to parse from file". BTW, I am using Mac OS Sierra and PyCharm Community Edition 2016.3. Any idea about why does it fails loading the data? – Antonio Serrano Dec 19 '16 at 08:35
  • Hmmm, maybe problem with download or unpack, test it by `print csv_file.readlines()[:3]` – jezrael Dec 19 '16 at 08:37
  • I got this @jezrael: `[b'\xef\xbb\xbf"Data Source","World Development Indicators",\r\n', b'\r\n', b'"Last Updated Date","2016-12-16",\r\n'] `. Any clue? – Antonio Serrano Dec 19 '16 at 09:04
  • Only one idea - what is your pandas version? `print (pd.show_versions())` – jezrael Dec 19 '16 at 09:06
  • The same: 0.19.1. But I have been using PyCharm. I have just tried on the terminal and it works perfectly. Thanks! BTW, any idea why it does not work with PyCharm? – Antonio Serrano Dec 19 '16 at 09:30
  • I never use it. I use anaconda spyder. – jezrael Dec 19 '16 at 09:31