How to detect the language of a given text

Question

In my Rails 3 application, users may write messages in forum. I would like to identify what the language is for a given message. I'm interested in English, Russian, and Hebrew languages. Is there any built-in library in Ruby/Rails for such a task? If not, any ideas will be appreciated.

here good answers too https://stackoverflow.com/questions/3285511/how-can-i-detect-a-users-input-language-using-ruby-without-using-an-online-serv — Oleksandr Bratashov, Oct 06 '17 at 09:10

score 6 · Accepted Answer · answered May 07 '11 at 17:23

6

Use this: https://github.com/nashby/wtf_lang

"ruby is so awesome!".lang # => "en"
"ruby is so awesome!".full_lang # => "ENGLISH"

answered May 07 '11 at 17:23

Vasiliy Ermolovich

24,459
5
79
77

Thanks! Do you know if there is something similar that can translate one language to other and uses Google translator ? – Misha Moroshko May 08 '11 at 12:50

score 5 · Answer 2 · answered May 05 '11 at 12:38

5

You can use the api provided by google to guess it with google translate.

See here for documentation : http://code.google.com/apis/language/translate/v1/using_rest_langdetect.html

answered May 05 '11 at 12:38

Hartator

5,029
4
43
73

There is no "Using Ruby" section there :( – Misha Moroshko May 05 '11 at 13:01
2

Oh, in that case you'll have to use Java... Sorry, couldn't resist :). It has a JSON interface. You can generate and parse JSON easily with Ruby. – Matt May 05 '11 at 15:10
In fact, there are just examples, you have to anyway parse the JSON in every language. In ruby, you can use this : http://developer.yahoo.com/ruby/ruby-json.html – Hartator May 05 '11 at 15:41
2

Not the best solution. Google has rate limits. There's a dependency on a 3rd party.. you want to limit those as much as possible. – Henley Oct 27 '13 at 23:42

score 2 · Answer 3 · answered May 05 '11 at 13:30

2

Since you're concerned with languages with different character sets you could dig up the character codes that are predominantly in your strings. You could then see if they fall into the code sets that represent hebrew / cryllic characters.

answered May 05 '11 at 13:30

digitalWestie

2,647
6
28
45

score 2 · Answer 4 · answered May 05 '11 at 20:21

2

Perhaps you could look at the whatlanguage gem?

answered May 05 '11 at 20:21

Caley Woods

4,707
4
29
38

score 1 · Answer 5 · answered Jun 27 '13 at 21:02

1

Language Detection API provides Ruby GEM to detect language.

answered Jun 27 '13 at 21:02

Laurynas

3,829
2
32
22

Looks interesting. Thanks for posting this! – Misha Moroshko Jun 28 '13 at 12:39

score 1 · Answer 6 · answered May 05 '11 at 12:40

1

Take a look at this blog
http://blog.kenweiner.com/2008/04/server-side-language-detection-with.html
This may be helpful

answered May 05 '11 at 12:40

shajin

3,214
5
38
53

score 0 · Answer 7 · answered Sep 10 '12 at 01:41

0

Just a quick demo of WhatLanguage for anyone interested : http://www.youtube.com/watch?v=lNqZ2cqOReo&list=UUJ_3fstMOH-g4yBxtvgAWkw&index=0&feature=plcp

answered Sep 10 '12 at 01:41

alexizydorczyk

850
1
6
25

score 0 · Answer 8 · answered Aug 18 '14 at 05:08

0

http://rubygems.org/gems/prose Prose dose it without a gem. Try it.

answered Aug 18 '14 at 05:08

user3871311

3
2

How to detect the language of a given text

8 Answers8