How to extract words from a text using python?

Question

I need to extract the words and phrases within a text. For example, the text is:

Привет, hello, как дела? english word, еще одно русское слово, слово-1224, тест 4456

And script should return the following:

Привет
как
дела
еще
одно
русское
слово
слово-1224

That is, I need to take from the text of all the words that begin with the Russian letters ([а-яА-Яё-]), and can contain numbers and letters of the Russian alphabet. How is this implemented?

I think you are talking about this, http://stackoverflow.com/questions/5717886/python-regex-extracting-whole-words Regards. — X-Factor, Mar 11 '13 at 07:36
It's a simple task with regular expressions. Just read up on how they work :) — Niclas Nilsson, Mar 11 '13 at 07:38
Some of your words have a "-" in the middle, but you didn't mention it in the question. — LtWorf, Mar 11 '13 at 08:11

score 1 · Accepted Answer · answered Mar 11 '13 at 08:05

1

It was a little bit trickier than I thought. Have never used cyrrilic chars. I do believe this should do:

text =  # Set you're input unicode string here.
words = re.findall('[\p{IsCyrillic}][0-9\p{IsCyrillic}]+', text)

for word in words:
    print word

answered Mar 11 '13 at 08:05

Niclas Nilsson

5,691
3
30
43

How to extract words from a text using python?

1 Answers1