I have a .csv file where the column contains string values like "St_So update the DropMessage XML file_for save updateFillUp for save_command"
How would I do the tokenization in this case?
I have a .csv file where the column contains string values like "St_So update the DropMessage XML file_for save updateFillUp for save_command"
How would I do the tokenization in this case?
I got the answer here - https://stackoverflow.com/a/43531314/10828869 .
splits the sentence without space - https://github.com/keredson/wordninja