The conversation feature is pretty phenomenal, and comes close to a true Babelfish device. I just tried it with English<->Mandarin with my wife (we both speak fluently), and works pretty accurately and is fast.
I just tried English<->Mandarin with my wife...though not always grammatically correct, it gets the point across.
For those who would use it while travelling abroad, keep it mind this requires an Internet connection. In China, you would need VPN since Google services are blocked.
WordLens works offline without any additional downloads, at least for the languages I tried (Spanish, French, English).
Audio translation and TTS works offline if you have the proper languages downloaded, but being able to detect what language is being spoken seems to be an online-only feature.
Baidu translate works great in China and will translate anything you copy to the clipboard automatically. Requires the usual insane Chinese app permissions so Xprivacy or something similar is a must.
It is really perfectible for French<->Mandarin at least.
You actually have to translate both sentences into English to understand how they somewhat mean the same thing when taken literally (but that's just the same problem as on translate.google.com)
> It is really perfectible for French<->Mandarin at least.
You might prefer to say "imperfect" instead of "perfectible". While "perfectible" is a, well, perfectly good word, it is unusually rare enough that I thought you had meant to say "perfect" and made an error. "imperfect" is much more common and less likely to be misinterpreted. Apologies for the unsolicited criticism but I really was confused by this at first.
It sounds strange in english. Saying "c'est perfectible" in french is correct and usual. It is translated by google translate into "This is perfectible". As usual, google translate is very poor.
The irony being the poster above used that exact translation themselves?
Translation is difficult, and at least in this case the translation is an accurate one (albeit one many english speakers would need to look up in a dictionary).
I don't know whether they have a specific French <--> Chinese model. They might, they might not.
It's hard to train for all n^2 language pairs, so MT systems usually back off to English as a pivot language. i.e., they'll translate French --> English --> Chinese.
New neural machine translation architectures are experimenting with pairs of neural encoders / decoders, one pair for each language and a shared language independent vector space for the meaning of all words:
- the vocabulary and topics covered in the bible is quite different from today's written and spoken text, especially phone discussions or social network messages.
- other aligned corpora such as http://www.statmt.org/europarl/ are much larger than the bible (several millions of tokens for most pairs vs less than 1 million for the Bible)
> so MT systems usually back off to English as a pivot language
That's an interesting choice, because English lacks features some other languages might have, and thus you end up distorting through English. I remember considerable work from different sources a ways back toward a constructing artificial languages for this purpose so to mitigate the introduction of ambiguity by using an existing natural language as a pivot language, I'm surprised that natural language as the pivot is the state of the art (though I'm not surprised that English is the pivot language given that.)
• Word Lens: Just point your camera to a sign or text and the Translate app will instantly translate the text, even without Internet/data connection. Currently available in: English ↔ French, German, Italian, Portuguese, Russian, Spanish.
The live video translation was a startup that they acquired ("Word Lens"). It already worked offline so it would be strange if they had removed that feature.
I doubt this implies that the Google translation engine has been ported to work offline.
It does and has for some time[1]. Just switch to airplane mode and try it before asserting this? You have to download the language packs first, but it works.
The translation quality won't be (anywhere near) as good offline as online, but it works well enough for word lens to be useful without a data connection!
They've been able to do offline voice-to-text, for English at least, for the last 1-2 years, so it's possible. But I would tend to agree...seems doubtful that they could have best-in-class real-time translations....offline, right?
Yeah, it is. I had pretty much the same idea a few years back, and called it "SpaceChat". I ended up dropping the project because I was too busy with other things. Smh.
Word Lens was the first iPhone app that I saw that really felt like Magic, glad to see it was bought up and put infront of a mass audience (where I assume it will gather data and learn)
Precisely my thinking. I was wondering what'd happened to Word Lens and so to see them baked in to the Google engine is really exciting. Great work and congratulations!
Really curious about the tech / arch. behind its ASR. Must have a lot of nodes and tricks in place to support high throughput and low latency.
If I'm not mistaken, this paper [1] is the last time Google published about the related architecture. We know very little about improvements over the last 7 years.
AFAIK there are several new advancements for both ASR and Translation front. DBN and Special RNN called LSTM based systems surpassed classical approaches. A recent Translation mechanism based on LSTM from Google: http://papers.nips.cc/paper/5346-sequence-to-sequence-learni...
I speak English, Spanish and Italian. I've been talking to this app for the past hour in those languages and translating to whatever languages have speech output. This is so amazing.
Works pretty well, but so does Microsoft's Translation app for Windows Phone. Having used Microsoft's app for 2 years now, I am really wondering what took Google so long. Google's app offers coloring of the translation and a way more languages. But in the end, it's as fast and reliable as Microsoft's solution on my devices..
For those wondering, the app is called "Translator". I've also found the translation to be pretty good, though it tends to trip when it comes to handwriting.
The word lens is impressive. Tried it out on my university ID against some bright light, and it was able to detect even the low-contrast regions. Even my Mac keyboard. It works on almost anything.
Google has published a lot of work recently about using deep learning for language translation with really impressive results. Anyone know if Google Translate is now neural net based? Or would a many-layered net not scale to the amount of API calls that Google translate receives?
Having just spent a month travelling through Japan, I can attest to the brilliance of the Translate app even before this update! That said, the Android version seems more feature rich than the iOS version (maybe I just don't know where to look for the features)
Companies are free to only release wherever they want. The legal aspect is when your phone depends on an appstore that refuses to allow competition in (I.E, if Android only allowed Google Maps and not any others). That's the anti-trust illegal aspect.
If they haven't already started doing this, it seems it would be inevitable, to turn this into a full-fledged API for use in real-time communications, like WebRTC apps, etc...
I see that they have an API, but not sure how feasible it would be to use in real-time apps.
I work on software that, among other things, runs a call center and I've been getting requests to do something like this in real time so that we can communicate with our users that don't speak english (We have agents who speak other languages but they wanted a fallback for when they weren't there). I told them real-time was still a little bit out (even with this as an API it would take time to integrate). This is really exciting though and I look forward to the day that we can do this will little to no lag and talk to people who don't share a language in common.
Some friends and I actually did something like this at a hackathon. We built a Google Hangouts app that used Google's translate API for real-time video conferencing in different languages.
Meanwhile on Windows Phone, we have YouTube blocked. Anyway, I have to admit Google Translate is phenomenal now, even though it's thanks to the guys behind Word Lens. Kudos to everyone involved. This is probably going to be one of my most used apps from now on.
So what languages are actually supported in conversation mode?
Few months ago spoken Thai input was not supported.
Also, World Lens works nothing like in the animation. The app scans for words and provides translation in a traditional UI, it does not overlay translation over the image.
The Google Translate app (and Word Lens, I believe - it's been a few years since I played with it) do use augmented reality to overlay directly on the image.
The photo translation doesn't work offline for me. I downloaded the languages but when I take a photo it just says "no network". I can mark the text but nothing happens.
As cool as the new features are, the app is now difficult and slow to use the way I used to. Little things, like focusing the textbox when you tap clear, are just missing. I'm willing to take that for the automatic OCR features, but it's just worse for everything else (probably due to their new "Material Design" strategy which doesn't belong on iOS).
Unfortunately, all of their text-recognition is still done on the cloud. So If you're traveling, you most likely won't have a data plan in the country you're visiting, and word lens won't work. This seems like a huge missing piece to me.
It's strange because they let you download language packs so that all the translation (and voice recognition) can be done locally. I have no knowledge in this area, but honestly: is there something fundamental about text recognition that it can't be done client-side?
Nowadays Pocket Wifi's or data SIMs for your phone/tablet are fairly cheap and ubiquitous, if you're travelling to the parts of the world supported by the feature, you'll likely have a decent connection.
Google Translate came pre-installed on my handy, but since data is expensive- at least here in Germany- I removed it and defaulted to an offline German <=> English dictionary. After reading this post and watching the video I decided I'd give it another go and I'm glad I did.
In order to do translation w/out using data each and every time you have to:
1. Open the Translate app
2. Tap the options icon; top right
3. Tap "Settings"
4. Tap "Manage Offline Languages"
5. Select the language you would like available offline and how you'd like to download it( wifi only, wifi 3G, etc )
The German language pack is about 300mb, but that's nothing compared to the cost over time of using the app; data cost. Let's just hope they don't pull a SketchUp with this.
In fact, the blog post subheading for that section is "Instant translation with Word Lens"
I'm curious if that part has improved with integration with Google's Translate. The video-based translated word substitution was amazing, but my understanding was that it was doing a very simple translation in the original app, essentially a word at a time.
I will definitely use this when traveling.