Media & Entertainment

Facebook’s ad system shown failing to enforce its own anti-discriminatory policy

Comment

The Facebook thumbs down image.
Image Credits: Bryce Durbin / TechCrunch

Can Facebook be trusted to abide by even its own stated standards? In the case of Internet political advertising the social giant wants to be allowed to continue to self regulate — despite the scandal of Russian bought socially divisive ads which (we now know) were tainting democratic discussion during the 2016 US presidential election (and beyond).

Don’t regulate us, we can regulate ourselves — honest!‘ is shaping up to be CEO Mark Zuckerberg’s massively moonshot new year project for 2018.

But results from a new ProPublica investigation suggest the tech giant is failing at even simple self-policing — undermining any claims it can responsibly manage the bad and even out-and-out illegal outcomes that are being enabled via its platform, and bolstering the case for more formal regulation.

Case in point: A year ago Facebook said it would disable ethnic affinity ad targeting for housing, employment and credit-related ads, following a ProPublica investigation that had suggested the platform’s ad-targeting capabilities could be used for discriminatory advertising — particularly in housing and employment, where such practices are illegal.

This month ProPublica checked in again, to see how Facebook is doing — by purchasing dozens of rental housing ads and asking that Facebook’s ad platform exclude groups that are protected from discrimination under the US Federal Fair Housing Act — such as African Americans and Jews.

Its test ads promoted a fictional apartment for rent, targeted at people aged 18 to 65 who were living in New York, house hunting and likely to move — with ProPublica narrowing the audience by excluding certain “Behaviors”, listed in a section Facebook now calls “Multicultural Affinity”, including “Hispanic”, “African American” and “Asian American”.

However instead of the platform blocking the potentially discriminatory ad buys, ProPublica reports that all its ads were approved by Facebook “within minutes” — including an ad that sought to exclude potential renters “interested in Islam, Sunni Islam and Shia Islam”. It says that ad took the longest to approve of all its buys (22 minutes) — but that all the rest were approved within three minutes.

It also successfully bought ads that it judged Facebook’s system should at least flag for self-certification because they were seeking to exclude other members of protected categories. But the platform just accepted housing ads blocked from being shown to categories including ‘soccer moms’, people interested in American sign language, gay men and people interested in wheelchair ramps.

Yet, back in February, Facebook announced new “stronger” anti-discriminatory ad polices, saying it was deploying machine learning tech tools to help it identify ads in the categories of concern.

“We’ve updated our policies to make our existing prohibition against discrimination even stronger. We make it clear that advertisers may not discriminate against people based on personal attributes such as race, ethnicity, color, national origin, religion, age, sex, sexual orientation, gender identity, family status, disability, medical or genetic condition,” it wrote then.

Of the new tech tools, Facebook said: “This will allow us to more quickly provide notices and educational information to advertisers — and more quickly respond to violations of our policy.”

Explaining how the new system would work, Facebook said advertisers who attempt to show “an ad that we identify as offering a housing, employment or credit opportunity” and which “either includes or excludes our multicultural advertising segments — which consist of people interested in seeing content related to the African American, Asian American and US Hispanic communities” will find the platform disapproves the ad.

The new system would also require all advertisers that attempt to buy targeted advertising in the categories of concern to self-certify they are complying with Facebook’s anti-discrimination policies and with “applicable anti-discrimination laws”.

ProPublica says it never even encountered these self-certification screens, as well as never having any of its ad buys blocked.

“Under its own policies, Facebook should have flagged these ads, and prevented the posting of some of them. Its failure to do so revives questions about whether the company is in compliance with federal fair housing rules, as well as about its ability and commitment to police discriminatory advertising on the world’s largest social network,” it writes.

Responding to ProPublica’s findings, Facebook sent a statement attributed to Ami Vora, VP of product management, in which she concedes its system failed in this instance. “This was a failure in our enforcement and we’re disappointed that we fell short of our commitments. The rental housing ads purchased by ProPublica should have but did not trigger the extra review and certifications we put in place due to a technical failure,” said Vora.

She went on to claim Facebook’s anti-discrimination system had “successfully flagged millions of ads” in the credit, employment and housing categories — but also said Facebook will now begin requiring self-certification for ads in all categories that choose to exclude an audience segment.

“Our systems continue to improve but we can do better,” she added.

The latter phrase is now a very familiar refrain from Facebook where content review and moderation is concerned. Aside from socially divisive political disinformation, it has faced growing criticism this year for enabling the spread of content such as extremist propaganda and child exploitation, as well as for multiple incidents of its tools being used to broadcast suicides and murders.

The wider question for governments and regulators is at what point will Facebook’s attempts to ‘do better’ be deemed just not good enough?

Commenting on ProPublica’s findings in a statement, Rachel Goodman, an attorney with the ACLU‘s Racial Justice Program, said: “We’re very, very disappointed to see these significant failures in Facebook’s system for identifying and preventing discrimination in advertisements for rental housing. We and other advocates spent many hours helping Facebook move toward solving the egregious discrimination problem built into its ad targeting business — that advertisers could exclude people from seeing ads based on race, gender, and religion, including in ads for housing, credit, and employment. Facebook’s representations to us indicated that this problem had been substantially solved, but it now seems clear that was not the case.

“While we appreciate that Facebook continues to express a desire to get it right on this important civil rights issue, this story highlights the need for greater transparency and accountability. Had outside researchers been able to see and the system Facebook created to catch these ads, those researchers could have spotted this problem and ended the mechanism for discrimination sooner.”

This story was updated with additional comment from the ACLU

More TechCrunch

Slack is making it difficult for its customers if they want the company to stop using its data for model training.

Slack under attack over sneaky AI training policy

A Texas-based company that provides health insurances and benefit plans disclosed a data breach affecting almost 2.5 million people, some of whom had their Social Security number stolen. WebTPA said…

Healthcare company WebTPA discloses breach affecting 2.5 million people

Featured Article

Microsoft dodges UK antitrust scrutiny over its Mistral AI stake

Microsoft won’t be facing antitrust scrutiny in the U.K. over its recent investment into French AI startup Mistral AI.

43 mins ago
Microsoft dodges UK antitrust scrutiny over its Mistral AI stake

Ember has partnered with HSBC in the U.K. so that the bank’s business customers can access Ember’s services from their online accounts.

Embedded finance is still trendy as accounting automation startup Ember partners with HSBC UK

Kudos uses AI to figure out consumer spending habits so it can then provide more personalized financial advice, like maximizing rewards and utilizing credit effectively.

Kudos lands $10M for an AI smart wallet that picks the best credit card for purchases

The EU’s warning comes after Microsoft failed to respond to a legally binding request for information that focused on its generative AI tools.

EU warns Microsoft it could be fined billions over missing GenAI risk info

The prospects for troubled banking-as-a-service startup Synapse have gone from bad to worse this week after a United States Trustee filed an emergency motion on Wednesday.  The trustee is asking…

A US Trustee wants troubled fintech Synapse to be liquidated via Chapter 7 bankruptcy, cites ‘gross mismanagement’

U.K.-based Seraphim Space is spinning up its 13th accelerator program, with nine participating companies working on a range of tech from propulsion to in-space manufacturing and space situational awareness. The…

Seraphim’s latest space accelerator welcomes nine companies

OpenAI has reached a deal with Reddit to use the social news site’s data for training AI models. In a blog post on OpenAI’s press relations site, the company said…

OpenAI inks deal to train AI on Reddit data

X users will now be able to discover posts from new Communities that are trending directly from an Explore tab within the section.

X pushes more users to Communities

For Mark Zuckerberg’s 40th birthday, his wife got him a photoshoot. Zuckerberg gives the camera a sly smile as he sits amid a carefully crafted re-creation of his childhood bedroom.…

Mark Zuckerberg’s makeover: Midlife crisis or carefully crafted rebrand?

Strava announced a slew of features, including AI to weed out leaderboard cheats, a new ‘family’ subscription plan, dark mode and more.

Strava taps AI to weed out leaderboard cheats, unveils ‘family’ plan, dark mode and more

We all fall down sometimes. Astronauts are no exception. You need to be in peak physical condition for space travel, but bulky space suits and lower gravity levels can be…

Astronauts fall over. Robotic limbs can help them back up.

Microsoft will launch its custom Cobalt 100 chips to customers as a public preview at its Build conference next week, TechCrunch has learned. In an analyst briefing ahead of Build,…

Microsoft’s custom Cobalt chips will come to Azure next week

What a wild week for transportation news! It was a smorgasbord of news that seemed to touch every sector and theme in transportation.

Tesla keeps cutting jobs and the feds probe Waymo

Sony Music Group has sent letters to more than 700 tech companies and music streaming services to warn them not to use its music to train AI without explicit permission.…

Sony Music warns tech companies over ‘unauthorized’ use of its content to train AI

Winston Chi, Butter’s founder and CEO, told TechCrunch that “most parties, including our investors and us, are making money” from the exit.

GrubMarket buys Butter to give its food distribution tech an AI boost

The investor lawsuit is related to Bolt securing a $30 million personal loan to Ryan Breslow, which was later defaulted on.

Bolt founder Ryan Breslow wants to settle an investor lawsuit by returning $37 million worth of shares

Meta, the parent company of Facebook, launched an enterprise version of the prominent social network in 2015. It always seemed like a stretch for a company built on a consumer…

With the end of Workplace, it’s fair to wonder if Meta was ever serious about the enterprise

X, formerly Twitter, turned TweetDeck into X Pro and pushed it behind a paywall. But there is a new column-based social media tool in town, and it’s from Instagram Threads.…

Meta Threads is testing pinned columns on the web, similar to the old TweetDeck

As part of 2024’s Accessibility Awareness Day, Google is showing off some updates to Android that should be useful to folks with mobility or vision impairments. Project Gameface allows gamers…

Google expands hands-free and eyes-free interfaces on Android

A hacker listed the data allegedly breached from Samco on a known cybercrime forum.

Hacker claims theft of India’s Samco account data

A top European privacy watchdog is investigating following the recent breaches of Dell customers’ personal information, TechCrunch has learned.  Ireland’s Data Protection Commission (DPC) deputy commissioner Graham Doyle confirmed to…

Ireland privacy watchdog confirms Dell data breach investigation

Ampere and Qualcomm aren’t the most obvious of partners. Both, after all, offer Arm-based chips for running data center servers (though Qualcomm’s largest market remains mobile). But as the two…

Ampere teams up with Qualcomm to launch an Arm-based AI server

At Google’s I/O developer conference, the company made its case to developers — and to some extent, consumers — why its bets on AI are ahead of rivals. At the…

Google I/O was an AI evolution, not a revolution

TechCrunch Disrupt has always been the ultimate convergence point for all things startup and tech. In the bustling world of innovation, it serves as the “big top” tent, where entrepreneurs,…

Meet the Magnificent Six: A tour of the stages at Disrupt 2024

There’s apparently a lot of demand for an on-demand handyperson. Khosla Ventures and Pear VC have just tripled down on their investment in Honey Homes, which offers up a dedicated…

Khosla Ventures, Pear VC triple down on Honey Homes, a smart way to hire a handyman

TikTok is testing the ability for users to upload 60-minute videos, the company confirmed to TechCrunch on Thursday. The feature is available to a limited group of users in select…

TikTok tests 60-minute video uploads as it continues to take on YouTube

Flock Safety is a multibillion-dollar startup that’s got eyes everywhere. As of Wednesday, with the company’s new Solar Condor cameras, those eyes are solar-powered and use wireless 5G networks to…

Flock Safety’s solar-powered cameras could make surveillance more widespread

Since he was very young, Bar Mor knew that he would inevitably do something with real estate. His family was involved in all types of real estate projects, from ground-up…

Agora raises $34M Series B to keep building the Carta for real estate