How Accurate is Google Translate in 2021? These 4 Tests Will Tell You

12.07.2021

Google Translate has come a long way since its #googlefail days of yore. But whoever uses the automated translation tool can tell you that it still has its glitches and faults. So how accurate is Google Translate today?

And who better to assess its accuracy than a leading translation services provider?

We gave Google Translate a spin with four languages and assessed the accuracy of their translation into English: Spanish, French, Italian, and Russian. The results are rather interesting.

But let’s start with some background first.

What is Google Translate, and how does it work?

Google launched its automated translation tool back in 2006. At the time, it was based on zillions of human translations made by the European Parliament and the United Nations. But the translation algorithm was built on a statistical model. Simply put, it meant that Google translated meaning on a word-level.

The result?

This is just an analogy for all the #googlefails memes that swarmed the internet.

Truth be told, the most significant problems came up when translating languages with utterly different word order. With a statistical model, Google had no way of understanding how to turn the sentence structure around. (Remember german students: the verb always goes at the end). And so a German-to-English translation went something like:

Roses and violets will you go pluck.

We wonder who that might resemble…

Fast-forward ten years, and Google decides to uproot its computing entirely, introducing
Google Neural Machine Translation (GNMT). The new artillery operates on a wholly different level. It doesn’t translate words anymore. Instead, it uses an AI-powered neural machine translation algorithm that fetches the meaning from a broader context.

And instead of mirroring the source text’s word sequence, it tries to mimic the target language’s grammar and syntax rules. Which is basically how a human brain translates. Translating meaning, not words. And putting it into appropriate grammar structures and sequences.

With so great a postulate, human translation’s days were to be counted, surely. After all, with access to so much multilingual content, Google Translate could surely “learn” fast enough to outdo any human translator.

Or could it?

Google Translate Accuracy today

It’s 2021, so we decided to check how well Google Translate has “learned” over the years.

We selected four prominent language combinations:

  • Spanish to English
  • French to English
  • Italian to English
  • Russian to English

And asked our expert translators to give their assessment. Fail, near-miss, or stellar pass?

How Accurate is Google Translate for Spanish to English translation?🇪🇸

Spanish

Las vacaciones para este verano están a la vuelta de la esquina, y si deseas salir con tus amistades o familiares para disfrutar algún destino hondureño, no te olvides tomar todas las medidas de bioseguridad para tengas unos días relajantes y seguros.

English

Vacations for this summer are just around the corner, and if you want to go out with your friends or family to enjoy a Honduran destination, don’t forget to take all the biosecurity measures to have a few relaxing and safe days.

At first glance, Google Translate seems to have done a decent job. No epic translation fails or odd style choices.

But let’s look at a few thorny details.

‘Vacations for this summer’ is overly wordy and not precisely the expression of choice in English. And vacation? It works in US English, but Brits tend to call them summer holidays. So mind the gap here.

The most salient point is this one: ‘biosecurity measures’. Really? The text is referring to safety measures to be taken during this pandemic era. Biosecurity seems just a tad over the top. (Is that still Yoda speaking from the future?).

Our version of the translation:

Summer vacations are just around the corner. If you wish to come to enjoy one of our Honduran spots with your family or friends, make sure to take all the necessary health precautions for a relaxing and safe stay.

How Accurate is Google Translate for French to English translation? 🇫🇷

French

Balade dans le Paris enjazzé de Boris Vian
Écrivain, ingénieur, trompettiste, chanteur, poète… À Paris, Boris Vian a exercé tous ses talents.

English

A stroll through Boris Vian’s invaded Paris
Writer, engineer, trumpeter, singer, poet… In Paris, Boris Vian has exercised all his talents.

Truth be told, when the author of a source text “invents” words, it isn’t easy for a human translator, either. Enjazzé doesn’t exist in French, but any human translator would understand what the author made by adding the prefix en -a suffix –é to jazz.

But one wonders what was going on inside Google Translate’s robot head when it decided to translate a word containing “jazz” into “invasion”. Probably it isn’t a big jazz fan.

‘Vacations for this summer’ is overly wordy and not precisely the expression of choice in English. And vacation? It works in US English, but Brits tend to call them summer holidays. So mind the gap here.

The most salient point is this one ‘biosecurity measures’. Really? The text is referring to safety measures to be taken during this pandemic era. Biosecurity seems just a tad over the top. (Is that still Yoda speaking from the future?).

Our version of the translation:

Summer vacations are just around the corner. If you wish to come to enjoy one of our Honduran spots with your family or friends, make sure to take all the necessary health precautions for a relaxing and safe stay.

How accurate is Google Translate for Italian to English?🇮🇹

Italian

Nuova stagione condotta da Giancarlo Magalli con accanto Samanta Togni, Umberto Broccoli, Paolo Fox e il gruppo musicale di Stefano Palatresi. Quotidiano di attualità, costume, spettacolo, musica e curiosità.

English

New season conducted by Giancarlo Magalli alongside Samanta Togni, Umberto Broccoli, Paolo Fox and the Stefano Palatresi musical group. Newspaper of current affairs, costumes, entertainment, music and curiosities.

It’s interesting to see how even a contemporary writing piece can cause such significant math-ache for Google Translate. In the case of Italian, we have a full array of errors, from grammar errors in English (starting the sentence with “New season…” without an article) to many style choices which sound so unnatural in English:

Conducted — We usually host a show

The Stefano Palatresi musical group — It’s not the name of the musical group. It’s a person’s group, and the person’s name is Stefano Palatresi. And while we’re at it: musical group? Why not simply band?

Newspaper — Here is a hashtag-worthy fail. A quotidiano can either be a newspaper or a daily show. And the beginning of the sentence already alludes it’s not a newspaper because you can’t conduct one.

Costumes — In this context, it’s fashion or outfits, not costumes.

Curiosities — Would anyone ever use it in English? We bet interesting facts (or stuff) sounds more like it, doesn’t it?

Our version of the translation:

A new season hosted by Giancarlo Magalli, together with Samanta Togni, Umberto Broccoli, Paolo Fox, and music by Stefano Palatresi and his band. A show covering news, fashion, entertainment, music, and other topics of interest.

How accurate is Google Translate for Russian to English?🇷🇺

Let’s see how Google Translate manages a more distant language combination now.

Russian

Москва была одним из любимых городов Александра Пушкина. Поэт родился здесь, провел детство, часто бывал, повзрослев, встретил главную любовь своей жизни и женился. Не обошел он вниманием Москву и в «Евгении Онегине».

English

Moscow was one of the favorite cities of Alexander Pushkin. The poet was born here, spent his childhood, often visited, having matured, met the main love of his life and got married. He also paid attention to Moscow in Eugene Onegin.

Now, you can see how things start getting murkier the moment you translate from a more distant language family

The syntax is not clear. It looks like a string of clauses piled up. But in Russian, that finite-type gerund повзрослев actually functions as an action breaker. In fact, the English translation is not only weird. It’s actually grammatically inaccurate. No human translator would make such a mistake.

And then, we have a locution that got Google Translate’s math going berserk.

Не обошел он вниманием Москву и From an accuracy point of view, one could say everything is correct. The word-for-word translation would be: “He did not ignore Moscow in Eugene Onegin.

But what is missing is the salience. The last sentence means Pushkin liked Moscow so much he even included the city in his masterpiece. But putting it as Google Translate did makes it read as “just one more thing” Pushkin did.

So the meaning is there. But the tone and the heightened relation in respect to what was said before has gone astray.

Google Translate has a cousin called Yandex Translate. This Eastern brother algorithm claims it can do a better job with translating Slavic languages.

Let’s take a look:

Russian

Москва была одним из любимых городов Александра Пушкина. Поэт родился здесь, провел детство, часто бывал, повзрослев, встретил главную любовь своей жизни и женился. Не обошел он вниманием Москву и в «Евгении Онегине».

English – Google Translate

Moscow was one of the favorite cities of Alexander Pushkin. The poet was born here, spent his childhood, often visited, having matured, met the main love of his life and got married. He also paid attention to Moscow in Eugene Onegin.

English – Yandex Translate

Moscow was one of Alexander Pushkin’s favorite cities. The poet was born here, spent his childhood, often visited, grew up, met the main love of his life and got married. He did not ignore Moscow in “Eugene Onegin”.

Yandex does a better job at using possessives, which shortens the English translation. But as far as including Moscow, it falls flat the same way Google Translate did.

Our version of the translation:

Moscow was one of Alexander Pushkin’s favorite cities. The poet was born here, spent his childhood, visited often—and once grown up, the place where found the love of his life and got married. He didn’t even fail to give a worthwhile mention of the city in his Eugene Onegin.

Why is Google Translate still so inaccurate?

  1. Algorithm deep- or shallow-learning, it’s still just that: an algorithm. Google doesn’t try to understand the text. It’s a statistics game.

    Suppose a sentence or a word pair gets translated many times in a certain way. In that case, Google will suggest it as the appropriate translation. See the example of the Italian translation of costume: 9 times out of 10, its appropriate English translation is costumes. But that 1 time, it can actually mean fashion or clothing in Italian. Sadly, Google Translate will suggest a statistically more frequent translation, albeit it being wrong.
  2. Google can’t understand if the translation it produced makes sense or not. When the sum of the parts doesn’t make a coherent whole. Only you can judge it. If you’re in the helping mood, you can suggest a better translation to Google by using the “Suggest an edit” or “Contribute” function.
  1. Remember the enjazzé example from French before?

    A big part of using language involves breaking its rules. It’s called creativity.But Google Translate can’t break the word down and understand that the prefix and suffix to jazz actually follows a grammatical rule on how certain adjectives are formed to describe something being filled in, full of, or representativeof something


How to spot if someone used Google Translate in 2021?

pager_left Previous Next pager_right
Other news
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.