Display progress of lambda function

Asked Dec 23 '15 at 15:36

Active Dec 23 '15 at 15:36

Viewed 458 times

I'm calling a lambda function getIDfromURL that takes around 1 hour to complete, as the dataframe contains almost one million lines. How can I monitor the progress of this lambda function?

df1['ID'] = df1.apply(lambda row: self.getIDfromURL(row['trade']), axis=1)

def getIDfromURL(self, URL):
       f = requests.get(URL)
       text=f.text
       temp=text[text.index("ID") + 10:]
       end=temp.index("\r\n")
       ID=temp[0:end-1]
       ID=ID.replace('"', '')
       return (ID)

asked Dec 23 '15 at 15:36

Nickpick

6,163
16
65
116

You can't, really. If you made it a non-`lambda` function you could do some logging in it. – jonrsharpe Dec 23 '15 at 15:38
Why can't you display progress from within getIDfromURL()? – Brian Dec 23 '15 at 15:45
1

@jonrsharpe well, technically, in Python3, you could: `lambda x: x if not print('progress') else None`. Which should never be done in real code, ever, of course. – timgeb Dec 23 '15 at 15:47
@timgeb please mail your Pythoning license back to GvR ;o) – jonrsharpe Dec 23 '15 at 15:48
2

@jonrsharpe happy Christmas to you, too! – timgeb Dec 23 '15 at 15:49

Display progress of lambda function

0 Answers0