AI

Google rolls out AI improvements to aid with Search safety and ‘personal crisis’ queries

Comment

The Google search application is seen running on an iPhone
Image Credits: Jaap Arriens/NurPhoto / Getty Images

Google today announced it will be rolling out improvements to its AI model to make Google Search a safer experience and one that’s better at handling sensitive queries, including those around topics like suicide, sexual assault, substance abuse and domestic violence. It’s also using other AI technologies to improve its ability to remove unwanted explicit or suggestive content from Search results when people aren’t specifically seeking it out.

Currently, when people search for sensitive information — like suicide, abuse or other topics — Google will display the contact information for the relevant national hotlines above its search results. But the company explains that people who are in crisis situations may search in all kinds of ways, and it’s not always obvious to a search engine that they’re in need, even if it would raise flags if a human saw their search queries. With machine learning and the latest improvements to Google’s AI model called MUM (Multitask Unified Model), Google says it will be able to automatically and more accurately detect a wider range of personal crisis searches because of how MUM is able to better understand the intent behind people’s questions and queries.

The company last year introduced its plan to redesign Search using AI technologies at its Search On event, but it hadn’t addressed this specific use case. Instead, Google then had focused on how MUM’s better understanding of user intent could be leveraged to help web searchers unlock deeper insights into the topic they’re researching, and lead users down new search paths. For example, if a user had searched for “acrylic painting,” Google could suggest “things to know” about acrylic painting, like different techniques and styles, tips on how to paint, cleaning tips and more. It also could point users to other queries they may not have thought to search for, like “how to make acrylic paintings with household items.” In this one example, Google said it could identify more than 350 different topics related to acrylic paintings.

In a somewhat similar way, MUM will now be used to help better understand the sort of topics that someone in crisis might search for, which aren’t always as obvious as typing in a direct cry for help.

“…if we can’t accurately recognize that, we can’t code our systems to show the most helpful search results. That’s why using machine learning to understand language is so important,” explained Google in a blog post.

For example, if a user searched for “Sydney suicide hot spots,” Google’s previous systems would understand the query to be one of information-seeking because that’s how the term “hots spots” is often used, including in travel search queries. But MUM understands the query is related to people trying to find a jumping spot for suicide in Sydney and would identify this search as potentialy being from someone in crisis, allowing it to show actionable information like suicide hotlines. Another suicide query that could see improvements from MUM is “most common ways suicide is completed,” which, again, Google would have previously understood only as an information-seeking search.

MUM also better understands longer search queries where the context is obvious to humans, but not necessarily to machines. For instance, a query like “why did he attack me when i said i dont love him” implies a domestic violence situation. But long, natural-language queries have been difficult for Google’s systems without the use of advanced AI.

In addition, Google notes that MUM can transfer its knowledge across the 75 languages it’s been trained on, which helps it to more quickly scale AI improvements like this to worldwide users. That means it will be able to display the actionable information from trusted partners, like local hotlines, for these types of personal crisis searches to a broader audience.

This isn’t the first time MUM had been put to work to help direct Google Searches. MUM had previously been used to improve searches for COVID-19 vaccine information, the company said. In the coming months, Google says it will use MUM to improve its spam protection features and will expand those to languages where it has little training data. Other MUM improvements will roll out soon, as well.

Another area getting a boost from AI technology is Google’s ability to filter explicit content from search results. Even when Google’s SafeSearch filtering technology is turned off, Google still attempts to reduce unwanted explicit content from those searches where finding racy content wasn’t the goal. And today, its algorithms improve on this ability as users conduct hundreds of millions of searches globally.

But the AI technology known as BERT now works to help Google better understand if people were seeking explicit content. The company says, over the past year, BERT has reduced unwanted shocking search results by 30%, based on an analysis conducted by “Search Raters” who measured oversexualized results across random samples of queries for web and image search. The technology has also been particularly effective in reducing explicit content for searches related to “ethnicity, sexual orientation and gender,” which Google says disproportionately impacts women and especially women of color, the analysis found.

Google says the MUM AI improvements will begin to roll out to Serach in the coming weeks.

More TechCrunch

Welcome to Week in Review: TechCrunch’s newsletter recapping the week’s biggest news. This week Apple unveiled new iPad models at its Let Loose event, including a new 13-inch display for…

Why Apple’s ‘Crush’ ad is so misguided

The U.K. Safety Institute, the U.K.’s recently established AI safety body, has released a toolset designed to “strengthen AI safety” by making it easier for industry, research organizations and academia…

U.K. agency releases tools to test AI model safety

AI startup Runway’s second annual AI Film Festival showcased movies that incorporated AI tech in some fashion, from backgrounds to animations.

At the AI Film Festival, humanity triumphed over tech

Rachel Coldicutt is the founder of Careful Industries, which researches the social impact technology has on society.

Women in AI: Rachel Coldicutt researches how technology impacts society

SAP Chief Sustainability Officer Sophia Mendelsohn wants to incentivize companies to be green because it’s profitable, not just because it’s right.

SAP’s chief sustainability officer isn’t interested in getting your company to do the right thing

Here’s what one insider said happened in the days leading up to the layoffs.

Tesla’s profitable Supercharger network is in limbo after Musk axed the entire team

StrictlyVC events deliver exclusive insider content from the Silicon Valley & Global VC scene while creating meaningful connections over cocktails and canapés with leading investors, entrepreneurs and executives. And TechCrunch…

Meesho, a leading e-commerce startup in India, has secured $275 million in a new funding round.

Meesho, an Indian social commerce platform with 150M transacting users, raises $275M

Some Indian government websites have allowed scammers to plant advertisements capable of redirecting visitors to online betting platforms. TechCrunch discovered around four dozen “gov.in” website links associated with Indian states,…

Scammers found planting online betting ads on Indian government websites

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The deck included some redacted numbers, but there was still enough data to get a good picture.

Pitch Deck Teardown: Cloudsmith’s $15M Series A deck

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: What we know so far

Unlike ChatGPT, Claude did not become a new App Store hit.

Anthropic’s Claude sees tepid reception on iOS compared with ChatGPT’s debut

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Look,…

Startups Weekly: Trouble in EV land and Peloton is circling the drain

Scarcely five months after its founding, hard tech startup Layup Parts has landed a $9 million round of financing led by Founders Fund to transform composites manufacturing. Lux Capital and Haystack…

Founders Fund leads financing of composites startup Layup Parts

AI startup Anthropic is changing its policies to allow minors to use its generative AI systems — in certain circumstances, at least.  Announced in a post on the company’s official…

Anthropic now lets kids use its AI tech — within limits

Zeekr’s market hype is noteworthy and may indicate that investors see value in the high-quality, low-price offerings of Chinese automakers.

The buzziest EV IPO of the year is a Chinese automaker

Venture capital has been hit hard by souring macroeconomic conditions over the past few years and it’s not yet clear how the market downturn affected VC fund performance. But recent…

VC fund performance is down sharply — but it may have already hit its lowest point

The person who claims to have 49 million Dell customer records told TechCrunch that he brute-forced an online company portal and scraped customer data, including physical addresses, directly from Dell’s…

Threat actor says he scraped 49M Dell customer addresses before the company found out

The social network has announced an updated version of its app that lets you offer feedback about its algorithmic feed so you can better customize it.

Bluesky now lets you personalize main Discover feed using new controls

Microsoft will launch its own mobile game store in July, the company announced at the Bloomberg Technology Summit on Thursday. Xbox president Sarah Bond shared that the company plans to…

Microsoft is launching its mobile game store in July

Smart ring maker Oura is launching two new features focused on heart health, the company announced on Friday. The first claims to help users get an idea of their cardiovascular…

Oura launches two new heart health features

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI considers allowing AI porn

Garena is quietly developing new India-themed games even though Free Fire, its biggest title, has still not made a comeback to the country.

Garena is quietly making India-themed games even as Free Fire’s relaunch remains doubtful

The U.S.’ NHTSA has opened a fourth investigation into the Fisker Ocean SUV, spurred by multiple claims of “inadvertent Automatic Emergency Braking.”

Fisker Ocean faces fourth federal safety probe

CoreWeave has formally opened an office in London that will serve as its European headquarters and home to two new data centers.

CoreWeave, a $19B AI compute provider, opens European HQ in London with plans for 2 UK data centers

The Series C funding, which brings its total raise to around $95 million, will go toward mass production of the startup’s inaugural products

AI chip startup DEEPX secures $80M Series C at a $529M valuation 

A dust-up between Evolve Bank & Trust, Mercury and Synapse has led TabaPay to abandon its acquisition plans of troubled banking-as-a-service startup Synapse.

Infighting among fintech players has caused TabaPay to ‘pull out’ from buying bankrupt Synapse

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

The Twitter for Android client was “a demo app that Google had created and gave to us,” says Particle co-founder and ex-Twitter employee Sara Beykpour.

Google built some of the first social apps for Android, including Twitter and others