Apply a function to translate a column in pandas dataframe with condition on other columns

Question

data is a pandas dataframe in which language and config['TEXT FIELD'] are columns. I want to translate certain reviews in the text column to english and I am using a function dfApply

import goslate
def dfApply(row):
    if row["langauge"] == 'en':
       return row[config['TEXT FIELD']]
    else:
       return gs.translate(row[config['TEXT FIELD']], 'en')


gs = goslate.Goslate()
data['english_text'] = data.apply(dfApply, axis=1)

But the complier shows the follwing error

KeyError: ('langauge', 'occurred at index 0')

language is a column which referes to which language the text is in — Bharath Kumar, Sep 03 '15 at 12:10
Why not just convert the whole column to English, then use a mask of non-english rows to replace only the ones you need to? That is a bit easier than using apply with your conditionals happening in each step. — Brian Pendleton, Sep 03 '15 at 12:18
The language translator goslate is throwing timeout error for large number of data points — Bharath Kumar, Sep 03 '15 at 12:29

score 0 · Answer 1 · answered Sep 03 '15 at 12:29

0

Something like this might be an easier approach.

not_en = data["language"] != "en"
trans = translate(data[config['row']], "en")
col = config['row']
data.loc[not_en, col] = trans[not_en]

answered Sep 03 '15 at 12:29

Brian Pendleton

839
4
13

Apply a function to translate a column in pandas dataframe with condition on other columns

1 Answers1