Dropping rows with contain of a list of certain strings in Pandas

Question

I'm trying to drop rows which contain certain sub strings in a column. I want to drop all values that contain the sub strings 'Year', 'Monday', '/'

My dataframe looks like:

col1
24/05/2020
May Year 2020
Monday
May 2020

The code I tried:

drop_values = ['Monday','Year', '/']
df = df[~df['Col1'].str.contains(drop_values)]

However I get the following error:

TypeError: unhashable type: 'list'

`'|'.join(drop_values)` , join the list and pass into str.contains — anky, May 24 '20 at 14:23
To explain a little further. You are creating a regular expression from your list using '|'.join where '|' is an OR operator. — Scott Boston, May 24 '20 at 14:25

score 8 · Accepted Answer · answered May 24 '20 at 14:25

The Series.str.contains method accepts a regex.

>>> df
            col1
0     24/05/2020
1  May Year 2020
2         Monday
3       May 2020
>>> drop_values = ['Monday','Year', '/']
>>> df[~df['col1'].str.contains('|'.join(drop_values))]
       col1
3  May 2020

score 3 · Answer 2 · answered May 24 '20 at 14:28

3

You can do this:

df = df[~df['col1'].str.contains('Monday|Year|/')]
print(df)

Output:

       col1
3  May 2020

answered May 24 '20 at 14:28

NYC Coder

7,424
2
11
24

Dropping rows with contain of a list of certain strings in Pandas

2 Answers2