Media & Entertainment

Google Translate’s App Now Instantly Translates Printed Text In 27 Languages

Comment

Image Credits:

One of the most intense experiences you’ll ever have is visiting a country that speaks a language different than yours. There’s a host of tools you can use, but Google’s Translate product has leapfrogged just about everything out there over the years.

Its most handy, and impressive, tool is the six-month-old instant translation feature, using the goodies from the acquired Word Lens, that lets you point your camera at something written in another language, say a sign, and it’ll translate into your language with ridiculous accuracy in almost real-time.

Today, that feature is expanding today from seven languages to 27 languages: English, French, German, Italian, Portuguese, Russian, Spanish, Bulgarian, Catalan, Croatian, Czech, Danish, Dutch, Filipino, Finnish, Hungarian, Indonesian, Lithuanian, Norwegian, Polish, Romanian, Slovak, Swedish, Turkish and Ukrainian. The update is rolling out over both iOS and Android.

Google’s secret for the speed of instant translations, is its use of convolutional neural networks. It’s pretty rad stuff, and the explanation by Otavio Good, software engineer for Google Translate, is worth the full geeky read.

With some additional tweaks, voice translations are also available much faster, especially for those in spots with 3G or slower speeds.

With tools like these, I wondered if translation tools cause us to rely on the technology without actually learning the language. I liken it to GPS, which has not helped me with learning locations, but has just made me rely on…GPS.

I spoke to Julie Cattiau, product manager at Google Translate, yesterday about the Translate project as a whole, and asked specifically about Translate as an aid, rather than a replacement:

———-
28d2908TC: Tell me more about how people use Google Translate to actually learn a new language, and not just survive in a pinch?
JC: Translate is not a replacement for a language-learning course; it’s not going to teach you a language from scratch or all of the intricacies involved in learning a language. But with that said, we do hear from a lot of students and individuals learning languages who use Google translate as an assistant. It can help by suggesting translations for unfamiliar words or even help with pronunciation via text-to-speech. And recently, based on user feedback, we launched a new feature that allows our users to listen to translated words more slowly.

TC: Does the Translate team drive toward one certain goal or have its own mission? If so, what is that?
JC: Our mission is to help overcome language barriers. Whenever someone faces an obstacle due to encountering a second language, we want to be there to help solve the problem. Within that mission, our most important project is improving the quality of machine translation. But part of that is also the overall user experience, which is why we also invest in things like instant camera translation and multi-language conversation.

TC: Can you tell me more about the people on the Translate team, or touch the Translate product at Google?
JC: While we don’t break down the exact roles or number of team members, we can say that our team is very international. We have team members from Japan, China, Romania, Italy, France, Russia – and that’s just to name a few.

TC: What are your favorite parts about working on the Translate product?
JC: Personally, I really enjoy reading and hearing user stories around how we were able to improve their lives by enabling them to connect with other people — whether it’s someone successfully ordering off of a foreign menu, a couple getting married who didn’t speak each other’s languages, or a life being saved because an emergency responder could communicate with someone.

TC: Have any stories to share about why you’re so passionate about Translate?
JC: This is one of my favorite parts of the job! Here are some of the stories that have stuck with me:
There was a Congolese woman who only spoke Swahili and was able to deliver a baby in Ireland thanks to Google Translate.

We also had an Indian couple share their story. When they got married, they actually didn’t speak each others’ language and were able to communicate thanks to Google Translate (they even sent us a picture of the wedding!).

And the Translate app has also helped friends of mine – a Czech friend whose father was seriously ill in hospital was able to have a conversation in Czech / English with her boyfriend thanks to Google Translate.
———-

Translate is an example of a tool that “just works,” but when you find out how, it pretty much blows your mind.

More TechCrunch

Welcome to TechCrunch Fintech! This week, we’re looking at the continued fallout from Synapse’s bankruptcy, how Layer wants to disrupt SMB accounting, and much more! To get a roundup of…

There’s a real appetite for a fintech alternative to QuickBooks

The company is hoping to produce electricity at $13 per megawatt hour, which would be more than 50% cheaper than traditional onshore wind.

Bill Gates-backed wind startup AirLoom is raising $12M, filings reveal

Generative AI makes stuff up. It can be biased. Sometimes, it spits out toxic text. So can it be “safe”? Rick Caccia, the CEO of WitnessAI, believes it can. “Securing…

WitnessAI is building guardrails for generative AI models

It’s not often that you hear about a seed round above $10 million. H, a startup based in Paris and previously known as Holistic AI, has announced a $220 million…

French AI startup H raises $220 million seed round

Hey there, Series A to B startups with $35 million or less in funding — we’ve got an exciting opportunity that’s tailor-made for your growth journey! If you’re looking to…

Boost your startup’s growth with a ScaleUp package at TC Disrupt 2024

TikTok is pulling out all the stops to prevent its impending ban in the United States. Aside from initiating legal challenges against the government, that means shaping up its public…

As a U.S. ban looms, TikTok announces a $1M program for socially driven creators

Microsoft wants to put its Copilot everywhere. It’s only a matter of time before Microsoft renames its annual Build developer conference to Microsoft Copilot. Hopefully, some of those upcoming events…

Microsoft’s Power Automate no-code platform adds AI flows

Build is Microsoft’s largest developer conference and of course, it’s all about AI this year. So it’s no surprise that GitHub’s Copilot, GitHub’s “AI pair programming tool,” is taking center…

GitHub Copilot gets extensions

Microsoft wants to make its brand of generative AI more useful for teams — specifically teams across corporations and large enterprise organizations. This morning at its annual Build dev conference,…

Microsoft intros a Copilot for teams

Microsoft’s big focus at this year’s Build conference is generative AI. And to that end, the tech giant announced a series of updates to its platforms for building generative AI-powered…

Microsoft upgrades its AI app-building platforms

The U.K.’s data protection watchdog has closed an almost year-long investigation of Snap’s AI chatbot, My AI — saying it’s satisfied the social media firm has addressed concerns about risks…

UK data protection watchdog ends privacy probe of Snap’s GenAI chatbot, but warns industry

U.S. cell carrier Patriot Mobile experienced a data breach that included subscribers’ personal information, including full names, email addresses, home ZIP codes and account PINs, TechCrunch has learned. Patriot Mobile,…

Conservative cell carrier Patriot Mobile hit by data breach

It’s been three years since Spotify acquired live audio startup Betty Labs, and yet the music streaming service isn’t leveraging the technology to its fullest potential — at least not…

Spotify’s ‘Listening Party’ feature falls short of expectations

Alchemist Accelerator has a new pile of AI-forward companies demoing their wares today, if you care to watch, and the program itself is making some international moves into Tokyo and…

Alchemist’s latest batch puts AI to work as accelerator expands to Tokyo, Doha

“Late Pledge” allows campaign creators to continue collecting money even after the campaign has closed.

Kickstarter now lets you pledge after a campaign closes

Stack AI’s co-founders, Antoni Rosinol and Bernardo Aceituno, were PhD students at MIT wrapping up their degrees in 2022 just as large language models were becoming more mainstream. ChatGPT would…

Stack AI wants to make it easier to build AI-fueled workflows

Pinecone, the vector database startup founded by Edo Liberty, the former head of Amazon’s AI Labs, has long been at the forefront of helping businesses augment large language models (LLMs)…

Pinecone launches its serverless vector database out of preview

Young geothermal energy wells can be like budding prodigies, each brimming with potential to outshine their peers. But like people, most decline with age. In California, for example, the amount…

Special mud helps XGS Energy get more power out of geothermal wells

Featured Article

Sonos finally made some headphones

The market play is clear from the outset: The $449 headphones are firmly targeted at an audience that would otherwise be purchasing the Bose QC Ultra or Apple AirPods Max.

5 hours ago
Sonos finally made some headphones

Adobe says the feature is up to the task, regardless of how complex of a background the object is set against.

Adobe brings Firefly AI-powered Generative Remove to Lightroom

All cars suffer when the mercury drops, but electric vehicles suffer more than most as heaters draw more power and batteries charge more slowly as the liquid electrolyte inside thickens.…

Porsche Ventures invests in battery startup South 8 to boost cold-weather EV performance

Scale AI has raised a $1 billion Series F round from a slew of big-name institutional and corporate investors including Amazon and Meta.

Data-labeling startup Scale AI raises $1B as valuation doubles to $13.8B

The new coalition, Tech Against Scams, will work together to find ways to fight back against the tools used by scammers and to better educate the public against financial scams.

Meta, Match, Coinbase and others team up to fight online fraud and crypto scams

It’s a wrap: European Union lawmakers have given the final approval to set up the bloc’s flagship, risk-based regulations for artificial intelligence.

EU Council gives final nod to set up risk-based regulations for AI

London-based fintech Vitesse has closed a $93 million Series C round of funding led by investment giant KKR.

Vitesse, a payments and treasury management platform for insurers, raises $93M to fuel US expansion

Zen Educate, an online marketplace that connects schools with teachers, has raised $37 million in a Series B round of funding. The raise comes amid a growing teacher shortage crisis…

Zen Educate raises $37M and acquires Aquinas Education as it tries to address the teacher shortage

“When I heard the released demo, I was shocked, angered and in disbelief that Mr. Altman would pursue a voice that sounded so eerily similar to mine.”

Scarlett Johansson says that OpenAI approached her to use her voice

A new self-driving truck — manufactured by Volvo and loaded with autonomous vehicle tech developed by Aurora Innovation — could be on public highways as early as this summer.  The…

Aurora and Volvo unveil self-driving truck designed for a driverless future

The European venture capital firm raised its fourth fund as fund as climate tech “comes of age.”

ETF Partners raises €285M for climate startups that will be effective quickly — not 20 years down the road

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs