How do I view progress the conversion from list to dataframe?

Asked Feb 13 '19 at 07:47

Active Feb 13 '19 at 07:57

Viewed 72 times

is it possibel to see progress under code?

morpheme = [[('apple','Noun')]....]
word2_df= pd.DataFrame(sum(morpheme_test,[]), columns = ['word','type'])

It worked well when extracting 20 from the list and proceeding.

However, when I used the whole data, it took too long to get it to work, so I had to make sure it worked.

So, I refer to the following url, but I do not know if it applies to my case.

I'd appreciate it if you could tell me how to check the progress of the above code.

edited Feb 13 '19 at 07:57

Nihal

asked Feb 13 '19 at 07:47

송준석

1

What's wrong with the answer that you linked? – iz_ Feb 13 '19 at 07:49
frankly, In the answer, I did not understand how to actually apply it. – 송준석 Feb 13 '19 at 07:51
4

The biggest problem here is `sum`, which is O(N^2). Use `itertools.chain.from_iterable` or similar instead. See https://stackoverflow.com/a/953097 – iz_ Feb 13 '19 at 07:55
You are right. It was very helpful. Thank you. – 송준석 Feb 13 '19 at 08:31

0 Answers0