how to check if there a duplicate record in a pandas DataFrame

Question

I want to check if there is a duplicate record for all the columns in a DataFrame and to drop that record.

I am trying something like this but I am not sure if this is the right approach.

#remove duplicates repair = repair.drop_duplicates(subset=None,keep="first")

Yes, it's correct. Any other questions...? You could've just looked at your output to see if it was doing what you wanted. — cs95, Jun 22 '18 at 19:11
see https://stackoverflow.com/questions/14657241/how-do-i-get-a-list-of-all-the-duplicate-items-using-pandas-in-python — user3076252, Jun 22 '18 at 19:14

score 0 · Accepted Answer · answered Jul 16 '18 at 23:42

0

repair = repair.drop_duplicates(subset=None,keep="first")

This helps to remove all duplicate records

answered Jul 16 '18 at 23:42

Sayonti

1 Answers1