Pandas DataFrame - Normalisation

Asked Mar 14 '19 at 14:14

Active Mar 14 '19 at 14:21

Viewed 14 times

I have a dataframe with two columns: doc_id, text

I have tokenised my text but I want to create a new row for each doc_id, token.

What is the most efficient way for me to do this?

As-is:

doc_id    text
1         "cat mat home"
2         "dog mat table"

To-be:

doc_id    text
1         cat
1         mat
1         home
2         dog
2         mat
2         table

edited Mar 14 '19 at 14:21

asked Mar 14 '19 at 14:14

user1058210

2

Would you like show us some sample data ? – BENY Mar 14 '19 at 14:15
@Wen-Ben Thanks for the reply - I have added an example of sample as-is and to-be states – user1058210 Mar 14 '19 at 14:22

0 Answers0