How to check if a pandas column contain strings from another dataframe column

Question

df['containName'] = 0
for i in range (df2.shape[0]):
    df.loc[df['string'].str.contains(df2['name'][i],case=False), "containName"]=1

I am using the above code, but it takes a lot of time (my df contain millions of rows). Any vectorized fast solution?

score 1 · Answer 1 · answered May 09 '19 at 03:59

1

You can using

df['containName']=df['string'].str.contains('|'.join(df2['name']),case=False)

answered May 09 '19 at 03:59

BENY

Any faster solution? I ran this line 10 mins go, still running. – John Doe May 09 '19 at 04:11
Edit: Still running. DF has 2 million rows – John Doe May 09 '19 at 04:47
Something it is wrong. It is returning true for most of the text. I did `print(df['string'].str.contains("|".join("sdfdfddsfdsffsdfsdfsdsfs"),case=False))` – John Doe May 09 '19 at 05:10
and it returns true. Not even a single row contain that word. – John Doe May 09 '19 at 05:11

1 Answers1