Questions tagged [machine-translation]

Machine Translation, a subfield of Natural Language Processing, is the automatic translation of human languages. While historical translators are based on Statistical Machine Translation, newer systems use Neural Networks which provide much better results.

Machine Translation is the automatic translation of human languages. Current examples include Google Translate, Yandex Translate, and Bing Translate, which all are based on Statistical Machine Translation. In the 1990s Babel Fish was the best known service - it used Rules-Based Translation.

In November 2016, Google also introduced a Machine Translation based on Neural Networks ((G)NMT). DeepL introduces a free Machine Translation Service in 2017 which provides measurably better results than Google Translate.

353 questions
27
votes
4 answers

Google Translate iframe workaround

I'm using Google Translate tools to translate a web page and I also have an iframe on this page, that is not obviously translated with the page. Is there a workaround, that any of you know, so I can have the iframe translated as well?
Jack Johnson
  • 593
  • 4
  • 11
  • 23
23
votes
3 answers

TF2.0: Translation model: Error when restoring the saved model: Unresolved object in checkpoint (root).optimizer.iter: attributes

I am trying to restore the checkpoints and predict on different sentences NMT Attention Model. While restoring the checkpoints and predicting, I am getting gibberish results with warning below: Unresolved object in checkpoint…
Hackerds
  • 1,195
  • 2
  • 16
  • 34
19
votes
5 answers

Is there a tutorial about giza++?

The Urls in its 'readme' file is not valid (http://www.fjoch.com/mkcls.html and http://www.fjoch.com/GIZA++.html). Is there a good tutorial about giza++? Or is there some alternatives that have complete documentation?
Intelligence Gear
  • 279
  • 1
  • 3
  • 10
16
votes
6 answers

Google's text-to speech engine voices?

Most of you probably know the text-to-speech synthesizer of google translate, as you can access programmatically here btw: http://translate.google.com/translate_tts?tl=en&q=text My impression was it's sometimes using espeak, but in the major…
14
votes
4 answers

How to save Python NLTK alignment models for later use?

In Python, I'm using NLTK's alignment module to create word alignments between parallel texts. Aligning bitexts can be a time-consuming process, especially when done over considerable corpora. It would be nice to do alignments in batch one day and…
Merchako
  • 789
  • 1
  • 8
  • 19
13
votes
7 answers

Automatic Translation tool for Android

Do you know if there is any free automatic localization tool currently out of the market ? It would be to translate my XML files from my android project The ones i have found all rely on Google translate API. Since this API is now paying(Since…
13
votes
2 answers

Open Source Machine Translation Engines?

We're looking for an open source Machine Translation Engine that could be incorporated into our localization workflow. We're looking at the options below: Moses (C++) Joshua (Java) Phrasal (Java) Among these, Moses has the widest community support…
Sam
  • 131
  • 1
  • 5
11
votes
3 answers

What's a good explanation of statistical machine translation?

I'm trying to find a good high level explanation of how statistical machine translation works. That is, supposing I have a corpus of non-aligned English, French and German texts, how could I use that to translate any sentence from one language to…
Michael Low
  • 24,276
  • 16
  • 82
  • 119
10
votes
1 answer

How do I train a encoder-decoder model for a translation task using hugging face transformers?

I would like to train a encoder decoder model as configured below for a translation task. Could someone guide me as to how I can set-up a training pipeline for such a model? Any links or code snippets would be appreciated to understand. from…
8
votes
4 answers

High Precision Word Alignment Algorithm in Python

I am working on a project for building a high precision word alignment between sentences and their translations in other languages, for measuring translation quality. I am aware of Giza++ and other word alignment tools that are used as part of the…
hmghaly
  • 1,411
  • 3
  • 29
  • 47
8
votes
1 answer

Hidden size vs input size in RNN

Premise 1: Regarding neurons in a RNN layer - it is my understanding that at "each time step, every neuron receives both the input vector x (t) and the output vector from the previous time step y (t –1)" [1]: Premise 2: It is also my understanding…
8
votes
1 answer

What is the difference between mteval-v13a.pl and NLTK BLEU?

There is an implementation of BLEU score in Python NLTK, nltk.translate.bleu_score.corpus_bleu But I am not sure if it is the same as the mtevalv13a.pl script. What is the difference between them?
8
votes
1 answer

Phrase extraction algorithm for statistical machine translation

I have written the following code with the phrase extraction algorithm for SMT. GitHub # -*- coding: utf-8 -*- def phrase_extraction(srctext, trgtext, alignment): """ Phrase extraction algorithm. """ def extract(f_start, f_end,…
alvas
  • 115,346
  • 109
  • 446
  • 738
7
votes
1 answer

What is the difference between MarianMT and OpusMT?

I'm currently comparing various pre-trained NMT models and can't help but wonder what the difference between MarianMT and OpusMT is. According to OpusMT's Github it is based on MarianMT. However in the Huggingface transformers implementation all…
Zwiebak
  • 344
  • 1
  • 11
7
votes
6 answers

BLEU score implementation for sentence similarity detection

I need to calculate BLEU score for identifying whether two sentences are similar or not.I have read some articles which are mostly about BLEU score for Measuring Machine translation accuracy.But i'm in need of a BLEU score to find out similarity…
KNsiva
  • 377
  • 2
  • 8
  • 19
1
2 3
23 24