AI

Google rolls out AI improvements to aid with Search safety and ‘personal crisis’ queries

Comment

The Google search application is seen running on an iPhone
Image Credits: Jaap Arriens/NurPhoto / Getty Images

Google today announced it will be rolling out improvements to its AI model to make Google Search a safer experience and one that’s better at handling sensitive queries, including those around topics like suicide, sexual assault, substance abuse and domestic violence. It’s also using other AI technologies to improve its ability to remove unwanted explicit or suggestive content from Search results when people aren’t specifically seeking it out.

Currently, when people search for sensitive information — like suicide, abuse or other topics — Google will display the contact information for the relevant national hotlines above its search results. But the company explains that people who are in crisis situations may search in all kinds of ways, and it’s not always obvious to a search engine that they’re in need, even if it would raise flags if a human saw their search queries. With machine learning and the latest improvements to Google’s AI model called MUM (Multitask Unified Model), Google says it will be able to automatically and more accurately detect a wider range of personal crisis searches because of how MUM is able to better understand the intent behind people’s questions and queries.

The company last year introduced its plan to redesign Search using AI technologies at its Search On event, but it hadn’t addressed this specific use case. Instead, Google then had focused on how MUM’s better understanding of user intent could be leveraged to help web searchers unlock deeper insights into the topic they’re researching, and lead users down new search paths. For example, if a user had searched for “acrylic painting,” Google could suggest “things to know” about acrylic painting, like different techniques and styles, tips on how to paint, cleaning tips and more. It also could point users to other queries they may not have thought to search for, like “how to make acrylic paintings with household items.” In this one example, Google said it could identify more than 350 different topics related to acrylic paintings.

In a somewhat similar way, MUM will now be used to help better understand the sort of topics that someone in crisis might search for, which aren’t always as obvious as typing in a direct cry for help.

“…if we can’t accurately recognize that, we can’t code our systems to show the most helpful search results. That’s why using machine learning to understand language is so important,” explained Google in a blog post.

For example, if a user searched for “Sydney suicide hot spots,” Google’s previous systems would understand the query to be one of information-seeking because that’s how the term “hots spots” is often used, including in travel search queries. But MUM understands the query is related to people trying to find a jumping spot for suicide in Sydney and would identify this search as potentialy being from someone in crisis, allowing it to show actionable information like suicide hotlines. Another suicide query that could see improvements from MUM is “most common ways suicide is completed,” which, again, Google would have previously understood only as an information-seeking search.

MUM also better understands longer search queries where the context is obvious to humans, but not necessarily to machines. For instance, a query like “why did he attack me when i said i dont love him” implies a domestic violence situation. But long, natural-language queries have been difficult for Google’s systems without the use of advanced AI.

In addition, Google notes that MUM can transfer its knowledge across the 75 languages it’s been trained on, which helps it to more quickly scale AI improvements like this to worldwide users. That means it will be able to display the actionable information from trusted partners, like local hotlines, for these types of personal crisis searches to a broader audience.

This isn’t the first time MUM had been put to work to help direct Google Searches. MUM had previously been used to improve searches for COVID-19 vaccine information, the company said. In the coming months, Google says it will use MUM to improve its spam protection features and will expand those to languages where it has little training data. Other MUM improvements will roll out soon, as well.

Another area getting a boost from AI technology is Google’s ability to filter explicit content from search results. Even when Google’s SafeSearch filtering technology is turned off, Google still attempts to reduce unwanted explicit content from those searches where finding racy content wasn’t the goal. And today, its algorithms improve on this ability as users conduct hundreds of millions of searches globally.

But the AI technology known as BERT now works to help Google better understand if people were seeking explicit content. The company says, over the past year, BERT has reduced unwanted shocking search results by 30%, based on an analysis conducted by “Search Raters” who measured oversexualized results across random samples of queries for web and image search. The technology has also been particularly effective in reducing explicit content for searches related to “ethnicity, sexual orientation and gender,” which Google says disproportionately impacts women and especially women of color, the analysis found.

Google says the MUM AI improvements will begin to roll out to Serach in the coming weeks.

More TechCrunch

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the…

1 hour ago
A comprehensive list of 2024 tech layoffs

Featured Article

What to expect from WWDC 2024: iOS 18, macOS 15 and so much AI

Apple is hoping to make WWDC 2024 memorable as it finally spells out its generative AI plans.

2 hours ago
What to expect from WWDC 2024: iOS 18, macOS 15 and so much AI

We just announced the breakout session winners last week. Now meet the roundtable sessions that really “rounded” out the competition for this year’s Disrupt 2024 audience choice program. With five…

The votes are in: Meet the Disrupt 2024 audience choice roundtable winners

The malicious attack appears to have involved malware transmitted through TikTok’s DMs.

TikTok acknowledges exploit targeting high-profile accounts

It’s unusual for three major AI providers to all be down at the same time, which could signal a broader infrastructure issues or internet-scale problem.

AI apocalypse? ChatGPT, Claude and Perplexity all went down at the same time

Welcome to TechCrunch Fintech! This week, we’re looking at LoanSnap’s woes, Nubank’s and Monzo’s positive milestones, a plethora of fintech fundraises and more! To get a roundup of TechCrunch’s biggest…

A look at LoanSnap’s troubles and which neobanks are having a moment

Databricks, the analytics and AI giant, has acquired data management company Tabular for an undisclosed sum. (CNBC reports that Databricks paid over $1 billion.) According to Tabular co-founder Ryan Blue,…

Databricks acquires Tabular to build a common data lakehouse standard

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

The next few weeks could be pivotal for Worldcoin, the controversial eyeball-scanning crypto venture co-founded by OpenAI’s Sam Altman, whose operations remain almost entirely shuttered in the European Union following…

Worldcoin faces pivotal EU privacy decision within weeks

OpenAI’s chatbot ChatGPT has been down for several users across the globe for the last few hours.

OpenAI fixes the issue that caused ChatGPT outage for several hours

True Fit, the AI-powered size-and-fit personalization tool, has offered its size recommendation solution to thousands of retailers for nearly 20 years. Now, the company is venturing into the generative AI…

True Fit leverages generative AI to help online shoppers find clothes that fit

Audio streaming service TuneIn is teaming up with Discord to bring free live radio to the platform. This is TuneIn’s first collaboration with a social platform and one that is…

Discord and TuneIn partner to bring live radio to the social platform

The early victors in the AI gold rush are selling the picks and shovels needed to develop and apply artificial intelligence. Just take a look at data-labeling startup Scale AI…

Scale AI founder Alexandr Wang is coming to Disrupt 2024

Try to imagine the number of parts that go into making a rocket engine. Now imagine requesting and comparing quotes for each of those parts, getting approvals to purchase the…

Engineer brothers found Forge to modernize hardware procurement

Raspberry Pi has released a $70 AI extension kit with a neural network inference accelerator that can be used for local inferencing, for the Raspberry Pi 5.

Raspberry Pi partners with Hailo for its AI extension kit

When Stacklet’s founders, Travis Stanfield and Kapil Thangavelu, came out of Capital One in 2020 to launch their startup, most companies weren’t all that concerned with constraining cloud costs. But…

Stacklet sees demand grow as companies take cloud cost control more seriously

Fivetran’s Managed Data Lake Service aims to remove the repetitive work of managing data lakes.

Fivetran launches a managed data lake service

Lance Riedel and Nigel Daley both spent decades in search discovery, but it was while working at Pinterest that they began trying to understand how to use search engines to…

How a couple of former Pinterest search experts caught Biz Stone’s attention

GetWhy helps businesses carry out market studies and extract insights from video-based interviews using AI.

GetWhy, a market research AI platform that extracts insights from video interviews, raises $34.5M

AI-powered virtual physical therapy platform Sword Health has seen its valuation soar 50% to $3 billion.

Sword Health raises $130 million and its valuation soars to $3 billion

Jeffrey Katzenberg and Sujay Jaswa, along with three general partners, manage $1.5 billion in assets today through their Build, Venture and Seed strategies.

WndrCo officially gets into venture capital with fresh $460M across two funds

The startup targets the middle ground between platforms that offer rigid templates, and those that facilitate a full-control approach.

Storyblok raises $80M to add more AI to its ‘headless’ CMS aimed at non-technical people

The startup has been pursuing a ground-up redesign of a well-understood technology.

‘Star Wars’ lasers and waterfalls of molten salt: How Xcimer plans to make fusion power happen

Sēkr, a startup that offers a mobile app for outdoor enthusiasts and campers, is launching a new AI tool for planning road trips. The new tool, called Copilot, is available…

Travel app Sēkr can plan your next road trip with its new AI tool

Microsoft’s education-focused flavor of its cloud productivity suite, Microsoft 365 Education, is facing investigation in the European Union. Privacy rights nonprofit noyb has just lodged two complaints with Austria’s data…

Microsoft hit with EU privacy complaints over schools’ use of 365 Education suite

Since the shock of Russia’s 2022 invasion of Ukraine, solar energy has been having a moment in Europe. Electricity prices have been going up while the investment required to get…

Samara is accelerating the energy transition in Spain one solar panel at a time

Featured Article

DEI backlash: Stay up-to-date on the latest legal and corporate challenges

It’s clear that this year will be a turning point for DEI.

23 hours ago
DEI backlash: Stay up-to-date on the latest legal and corporate challenges

The keynote will be focused on Apple’s software offerings and the developers that power them, including the latest versions of iOS, iPadOS, macOS, tvOS, visionOS and watchOS.

Watch Apple kick off WWDC 2024 right here

Hello and welcome back to TechCrunch Space. Unfortunately, Boeing’s Starliner launch was delayed yet again, this time due to issues with one of the three redundant computers used by United…

TechCrunch Space: China’s victory

The court ruling said that Fearless Fund’s Strivers Grant likely violates the Civil Rights Act of 1866, which bans the use of race in contracts.

An appeals court rules that VC Fearless Fund cannot issue grants to Black women, but the fight continues