How to do one hot encoding in Pandas and Pyspark

Question

I have a dataframe as follows:

   id  country    amount    city  
    1  France       4         Paris
    2  Italy        9         Naples

I want to convert it to

   id amount    city    France   Italy  
    1  4        Paris     1        0
    2  9        Naples    0        1

How can I achieve this using Pandas and Pyspark respectively?

for pandas, there are already many resources: https://stackoverflow.com/questions/37292872/how-can-i-one-hot-encode-in-python — mozway, Jul 07 '22 at 08:16
see [How to do selected one hot encoding on pyspark?](https://stackoverflow.com/q/72891394/8279585) — samkart, Jul 07 '22 at 08:17
Does this answer your question? [How can I one hot encode in Python?](https://stackoverflow.com/questions/37292872/how-can-i-one-hot-encode-in-python) — Arkadip Bhattacharya, Jul 07 '22 at 08:25
in pyspark example, you have to explicitly name the column values. Can I use all the column value in default? — 1stgear_learner, Jul 07 '22 at 08:45

Niels Henkens · Answer 1 · 2022-07-07T08:24:45.437

0

In pandas you can use pd.get_dummies().

df = pd.get_dummies(df, columns=['country'])

edited Jul 07 '22 at 08:24

answered Jul 07 '22 at 08:19

Niels Henkens

1 Answers1