Media & Entertainment

Google Translate’s App Now Instantly Translates Printed Text In 27 Languages

Comment

Image Credits:

One of the most intense experiences you’ll ever have is visiting a country that speaks a language different than yours. There’s a host of tools you can use, but Google’s Translate product has leapfrogged just about everything out there over the years.

Its most handy, and impressive, tool is the six-month-old instant translation feature, using the goodies from the acquired Word Lens, that lets you point your camera at something written in another language, say a sign, and it’ll translate into your language with ridiculous accuracy in almost real-time.

Today, that feature is expanding today from seven languages to 27 languages: English, French, German, Italian, Portuguese, Russian, Spanish, Bulgarian, Catalan, Croatian, Czech, Danish, Dutch, Filipino, Finnish, Hungarian, Indonesian, Lithuanian, Norwegian, Polish, Romanian, Slovak, Swedish, Turkish and Ukrainian. The update is rolling out over both iOS and Android.

Google’s secret for the speed of instant translations, is its use of convolutional neural networks. It’s pretty rad stuff, and the explanation by Otavio Good, software engineer for Google Translate, is worth the full geeky read.

With some additional tweaks, voice translations are also available much faster, especially for those in spots with 3G or slower speeds.

With tools like these, I wondered if translation tools cause us to rely on the technology without actually learning the language. I liken it to GPS, which has not helped me with learning locations, but has just made me rely on…GPS.

I spoke to Julie Cattiau, product manager at Google Translate, yesterday about the Translate project as a whole, and asked specifically about Translate as an aid, rather than a replacement:

———-
28d2908TC: Tell me more about how people use Google Translate to actually learn a new language, and not just survive in a pinch?
JC: Translate is not a replacement for a language-learning course; it’s not going to teach you a language from scratch or all of the intricacies involved in learning a language. But with that said, we do hear from a lot of students and individuals learning languages who use Google translate as an assistant. It can help by suggesting translations for unfamiliar words or even help with pronunciation via text-to-speech. And recently, based on user feedback, we launched a new feature that allows our users to listen to translated words more slowly.

TC: Does the Translate team drive toward one certain goal or have its own mission? If so, what is that?
JC: Our mission is to help overcome language barriers. Whenever someone faces an obstacle due to encountering a second language, we want to be there to help solve the problem. Within that mission, our most important project is improving the quality of machine translation. But part of that is also the overall user experience, which is why we also invest in things like instant camera translation and multi-language conversation.

TC: Can you tell me more about the people on the Translate team, or touch the Translate product at Google?
JC: While we don’t break down the exact roles or number of team members, we can say that our team is very international. We have team members from Japan, China, Romania, Italy, France, Russia – and that’s just to name a few.

TC: What are your favorite parts about working on the Translate product?
JC: Personally, I really enjoy reading and hearing user stories around how we were able to improve their lives by enabling them to connect with other people — whether it’s someone successfully ordering off of a foreign menu, a couple getting married who didn’t speak each other’s languages, or a life being saved because an emergency responder could communicate with someone.

TC: Have any stories to share about why you’re so passionate about Translate?
JC: This is one of my favorite parts of the job! Here are some of the stories that have stuck with me:
There was a Congolese woman who only spoke Swahili and was able to deliver a baby in Ireland thanks to Google Translate.

We also had an Indian couple share their story. When they got married, they actually didn’t speak each others’ language and were able to communicate thanks to Google Translate (they even sent us a picture of the wedding!).

And the Translate app has also helped friends of mine – a Czech friend whose father was seriously ill in hospital was able to have a conversation in Czech / English with her boyfriend thanks to Google Translate.
———-

Translate is an example of a tool that “just works,” but when you find out how, it pretty much blows your mind.

More TechCrunch

Featured Article

Spyware found on US hotel check-in computers

Several hotel check-in computers are running a remote access app, which is leaking screenshots of guest information to the interne

1 hour ago
Spyware found on US hotel check-in computers

Gavet has had a rocky tenure at Techstars and her leadership was the subject of much controversy.

Techstars CEO Maëlle Gavet is out

The struggle isn’t universal, however.

Connected fitness is adrift post-pandemic

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

3 hours ago
A comprehensive list of 2024 tech layoffs

HoundDog actually looks at the code a developer is writing, using both traditional pattern matching and large language models to find potential issues.

HoundDog.ai helps developers prevent personal information from leaking

The changes are designed to enhance the consumer experience of using Google Pay and make it a more competitive option against other payment methods.

Google Pay will now display card perks, BNPL options and more

Few figures in the tech industry have earned the storied reputation of Vinod Khosla, founder and partner at Khosla Ventures. For over 40 years, he has been at the center…

Vinod Khosla is coming to Disrupt to discuss how AI might change the future

AI has already started replacing voice agents’ jobs. Now, companies are exploring ways to replace the existing computer-generated voice models with synthetic versions of human voices. Truecaller, the widely known…

Truecaller partners with Microsoft to let its AI respond to calls in your own voice

Meta is updating its Ray-Ban smart glasses with new hands-free functionality, the company announced on Wednesday. Most notably, users can now share an image from their smart glasses directly to…

Meta’s Ray-Ban smart glasses now let you share images directly to your Instagram Story

Spotify launched its own font, the company announced on Wednesday. The music streaming service hopes that its new typeface, “Spotify Mix,” will help Spotify distinguish its own unique visual identity. …

Why Spotify is launching its own font, Spotify Mix

In 2008, Marty Kagan, who’d previously worked at Cisco and Akamai, co-founded Cedexis, a (now-Cisco-owned) firm developing observability tech for content delivery networks. Fellow Cisco veteran Hasan Alayli joined Kagan…

Hydrolix seeks to make storing log data faster and cheaper

A dodgy email containing a link that looks “legit” but is actually malicious remains one of the most dangerous, yet successful, tricks in a cybercriminal’s handbook. Now, an AI startup…

Bolster, creator of the CheckPhish phishing tracker, raises $14M led by Microsoft’s M12

If you’ve been looking forward to seeing Boeing’s Starliner capsule carry two astronauts to the International Space Station for the first time, you’ll have to wait a bit longer. The…

Boeing, NASA indefinitely delay crewed Starliner launch

TikTok is the latest tech company to incorporate generative AI into its ads business, as the company announced on Tuesday that it’s launching a new “TikTok Symphony” AI suite for…

TikTok turns to generative AI to boost its ads business

Gone are the days when space and defense were considered fundamentally antithetical to venture investment. Now, the country’s largest venture capital firms are throwing larger portions of their money behind…

Space VC closes $20M Fund II to back frontier tech founders from day zero

These days every company is trying to figure out if their large language models are compliant with whichever rules they deem important, and with legal or regulatory requirements. If you’re…

Patronus AI is off to a magical start as LLM governance tool gains traction

Link-in-bio startup Linktree has crossed 50 million users and is rolling out the beta of its social commerce program.

Linktree surpasses 50M users, rolls out its social commerce program to more creators

For a $5.99 per month, immigrants have a bank account and debit card with fee-free international money transfers and discounted international calling.

Immigrant banking platform Majority secures $20M following 3x revenue growth

When developers have a particular job that AI can solve, it’s not typically as simple as just pointing an LLM at the data. There are other considerations such as cost,…

Unify helps developers find the best LLM for the job

Response time is Aerodome’s immediate value prop for potential clients.

Aerodome is sending drones to the scene of the crime

Granola takes a more collaborative approach to working with AI.

Granola debuts an AI notepad for meetings

DeepL, which builds automated text translation and writing tools, has raised a $300 million round led by Index Ventures.

AI language translation startup DeepL nabs $300M on a $2B valuation to focus on B2B growth

Praktika has secured a $35.5M Series A round to apply AI-powered avatars to language-learning apps.

Praktika raises $35.5M to use AI avatars to make learning languages feel more natural

Humane, the company behind the hyped Ai Pin that launched to less-than-glowing reviews last month, is reportedly on the hunt for a buyer.

Humane, the creator of the $700 Ai Pin, is reportedly seeking a buyer

India’s Oyo, once valued at $10 billion, has withdrawn its IPO application from the market regulator for the second time.

Oyo, once valued at $10 billion, shelves IPO plans for second time

Ore Energy emerged from stealth today with €10 million in seed funding. The company hopes to make grid-scale batteries that are cheaper and longer lasting.

Ore Energy emerges from stealth to build utility-scale batteries that last days, not hours

Paytm, a leading financial services firm in India, said its net loss widened in the fourth quarter as it grappled with a regulatory clampdown.

Paytm warns of job cuts as losses swell after RBI clampdown

Government officials and AI industry executives agreed on Tuesday to apply elementary safety measures in the fast-moving field and establish an international safety research network. Nearly six months after the…

In Seoul summit, heads of states and companies commit to AI safety

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Some startups choose to bootstrap from the beginning while others find themselves forced into self funding by a lack of investor interest or a business model that doesn’t fit traditional…

VCs wanted FarmboxRx to become a meal kit, the company bootstrapped instead