I must pass two-dimensional input. Three-dimensional list to dataframe (Python)

Question

I'm web scraping data and want to put it into a data frame for analysis.

I have a three-dimensional list that comes out of my scrape and I can't figure out how to get it into a data frame. I know I need to make it two-dimensional (249, 4) from the three-dimensional list (1, 249, 4).

table_countryCodes = pd.read_html("https://www.iban.com/country-codes")
np.reshape(table_countryCodes, (249,4))
df_countryCodes = pd.DataFrame(table_countryCodes)
print(df_countryCodes)

Error: ValueError: Must pass 2-d input. shape=(1, 249, 4)

How can I fix this?

Here is a sample of the three-dimensional list from the web scrape for context:

Country            Alpha-2 code   Alpha-3 code   Numeric
American Samoa        AS             ASM            16
Andorra               AD             AND            20
Angola                AO             AGO            24
Anguilla              AI             AIA            660

Does this answer your question? [numpy with python: convert 3d array to 2d](https://stackoverflow.com/questions/32838802/numpy-with-python-convert-3d-array-to-2d) — Himanshu Poddar, Jul 11 '22 at 04:59
I try running that but I get an error when using the transpose function "'list' object has no attribute 'transpose'" — Jordan, Jul 11 '22 at 05:02
Okay, then how do I convert from 2d array to dataframe? I thought pd.dataframe would do it no? — Jordan, Jul 11 '22 at 05:21
I added a picture from the spyder ide. It says the type is a list but the valu e is a dataframe — Jordan, Jul 11 '22 at 05:24

score 1 · Accepted Answer · edited Jul 11 '22 at 13:25

pd.read_html reads all HTML tables into a list of DataFrame objects. Since your use case has only one table in the page, you can extract the same using

df = table_countryCodes[0]
print(df)

which gives us

               Country Alpha-2 code Alpha-3 code  Numeric
0          Afghanistan           AF          AFG        4
1        Åland Islands           AX          ALA      248
2              Albania           AL          ALB        8
3              Algeria           DZ          DZA       12
4       American Samoa           AS          ASM       16
..                 ...          ...          ...      ...
244  Wallis and Futuna           WF          WLF      876
245     Western Sahara           EH          ESH      732
246              Yemen           YE          YEM      887
247             Zambia           ZM          ZMB      894
248           Zimbabwe           ZW          ZWE      716

[249 rows x 4 columns]

score 1 · Answer 2 · answered Jul 11 '22 at 05:33

1

You simply need:

pd.DataFrame(table_countryCodes[0])

i.e. add [0] to select the first and only element in table_countryCodes, which has the shape you need.

answered Jul 11 '22 at 05:33

Grismar

27,561
4
31
54

I must pass two-dimensional input. Three-dimensional list to dataframe (Python)

2 Answers2