Social

Oversight Board calls on Meta to rewrite ‘incoherent’ rules against faked videos

Comment

distorted meta logo and other brands including facebook, instagram, whatsapp, oculus, and messenger
Image Credits: Bryce Durbin / TechCrunch

The Oversight Board, the external advisory group that Meta created to review its moderation decisions on Facebook and Instagram, issued a decision on Monday concerning a doctored seven-second video of President Biden that made the rounds on social media last year.

The original video showed the president accompanying his granddaughter Natalie Biden to cast her ballot during early voting in the 2022 midterm elections. In the video, President Biden pins an “I Voted” sticker on his granddaughter and kisses her on the cheek.

A short, edited version of the video removes visual evidence of the sticker, setting the clip to a song with sexual lyrics and looping it to depict Biden inappropriately touching the young woman. The seven-second clip was uploaded to Facebook in May 2023 with a caption describing Biden as a “sick pedophile.”

In its decision, issued Monday, the Oversight Board agrees with Meta’s choice to leave the video online but calls the relevant policy “incoherent.” Meta’s Oversight Board announced that it would take on the case last October after a Facebook user reported the video and ultimately escalated the case when the platform declined to remove it.

“As it stands, the policy makes little sense,” Oversight Board co-chair Michael McConnell said. “It bans altered videos that show people saying things they do not say, but does not prohibit posts depicting an individual doing something they did not do. It only applies to video created through AI, but lets other fake content off the hook.”

McConnell also pointed to the policy’s failure to address manipulated audio, calling it “one of the most potent forms of electoral disinformation.” While the board’s decision to keep the video online is technically binding,

The Oversight Board’s decision argues that instead of focusing on how a particular piece of content was created, Meta’s rules should be guided by the harms they are designed to prevent. Any changes should be implemented “urgently” in light of global elections, according to the decision, but technically only the board’s decision whether content stays or goes is binding.

Meta created the Oversight Board in 2020. By then, the company still known as Facebook had endured years of scrutiny over the proliferation of disinformation, extremism and other dangerous content on its platforms. While the board can issue final decisions about the individual content moderation cases it reviews — assuming that Meta continues to agree to implement them — the company has only committed to “consider” deeper recommendations to change Facebook and Instagram’s rules.

Beyond expanding its manipulated media policy, the Oversight Board suggested that Meta add labels to altered videos flagging them as such instead of relying on content takedowns initiated by fact-checkers, a process the group criticizes as “asymmetric depending on language and market.” By labeling more content rather than taking it down, the Oversight Board believes that Meta can maximize freedom of expression, mitigate potential harm and provide more context and information for users.

In a statement to TechCrunch, a Meta spokesperson confirmed that the company is “reviewing the Oversight Board’s guidance” and will issue a public response within 60 days.

As the Oversight Board noted when it accepted the Biden “cheap fake” case, Meta stood by its decision to leave the altered video online because its policy on manipulated media — misleadingly altered photos and videos — only applies when AI is used or when the subject of a video is portrayed saying something they didn’t say.

The manipulated media policy, designed with deepfakes in mind, applies only to “videos that have been edited or synthesized… in ways that are not apparent to an average person, and would likely mislead an average person to believe.”

Meanwhile, the altered video continues to circulate on X, formerly Twitter. Last month, a verified X account with 267,000 followers shared the clip with the caption “The media just pretend this isn’t happening.” The video has more than 611,000 views.

The Biden video isn’t the first time that the Oversight Board has instructed Meta to go back to the drawing board for its rules. When the group weighed in on Facebook’s decision to ban former President Trump, it decried the “vague, standardless” nature of the indefinite punishment while ultimately agreeing with the choice to suspend his account. The Oversight Board has generally urged Meta to provide more detail, consistency and transparency in its platform policies, across cases.

The Oversight Board first lumbered into action in late 2020, missing an opportunity for relevance during that year’s U.S. election and attracting skepticism over its unavoidable ties to the company it was created to audit. Ultimately, Meta gets to decide whether it listens to the Oversight Board or not, even as the entity works as a useful shield against political criticism of its content moderation processes.

Critics of Meta’s policy-making experiment have dismissed the self-designed review board as too little, far too late.

Meta may have a standardized content moderation review system in place now, but misinformation and other dangerous content moves more quickly than that appeals process — and much more quickly than the world could have imagined just two U.S. general election cycles ago.

Researchers and watchdog groups are bracing for an onslaught of misleading claims and AI-generated fakes as the 2024 presidential race ramps up. But even as new technologies enable dangerous falsehoods to scale, social media companies have quietly slashed their investments in trust and safety and turned away from what once appeared to be a concerted effort to stamp out misinformation.

“The volume of misleading content is rising, and the quality of tools to create it is rapidly increasing,” McConnell said.

Oversight Board calls on Meta to evaluate its role in spreading violence in Ethiopia

Backlash builds after Elon Musk called an antisemitic conspiracy theory the ‘actual truth’

The Oversight Board’s annual report tracks how often Meta follows its advice

More TechCrunch

Call Arc can help answer immediate and small questions, according to the company. 

Arc Search’s new Call Arc feature lets you ask questions by ‘making a phone call’

After multiple delays, Apple and the Paris area transportation authority rolled out support for Paris transit passes in Apple Wallet. It means that people can now use their iPhone or…

Paris transit passes now available in iPhone’s Wallet app

Redwood Materials, the battery recycling startup founded by former Tesla co-founder JB Straubel, will be recycling production scrap for batteries going into General Motors electric vehicles.  The company announced Thursday…

Redwood Materials is partnering with Ultium Cells to recycle GM’s EV battery scrap

A new startup called Auggie is aiming to give parents a single platform where they can shop for products and connect with each other. The company’s new app, which launched…

Auggie’s new app helps parents find community and shop

Andrej Safundzic, Alan Flores Lopez and Leo Mehr met in a class at Stanford focusing on ethics, public policy and technological change. Safundzic — speaking to TechCrunch — says that…

Lumos helps companies manage their employees’ identities — and access

Remark trains AI models on human product experts to create personas that can answer questions with the same style of their human counterparts.

Remark puts thousands of human product experts into AI form

ZeroPoint claims to have solved compression problems with hyper-fast, low-level memory compression that requires no real changes to the rest of the computing system.

ZeroPoint’s nanosecond-scale memory compression could tame power-hungry AI infrastructure

In 2021, Roi Ravhon, Asaf Liveanu and Yizhar Gilboa came together to found Finout, an enterprise-focused toolset to help manage and optimize cloud costs. (We covered the company’s launch out…

Finout lands cash to grow its cloud spend management platform

On the heels of raising $102 million earlier this year, Bugcrowd is making good on its promise to use some of that funding to make acquisitions to strengthen its security…

Bugcrowd, the crowdsourced white-hat hacker platform, acquires Informer to ramp up its security chops

Google is preparing to build what will be the first subsea fibre optic cable connecting the continents of Africa and Australia. The news comes as the major cloud hyperscalers battle…

Google to build first subsea fibre optic cable connecting Africa with Australia

The Kia EV3 — the new all-electric compact SUV revealed Thursday — illustrates a growing appetite among global automakers to bring generative AI into their vehicles.  The automaker said the…

The new Kia EV3 will have an AI assistant with ChatGPT DNA

Bing, Microsoft’s search engine, isn’t working properly right now. At first, we noticed it wasn’t possible to perform a web search at all. Now it seems search results are loading…

Bing’s API is down, taking Microsoft Copilot, DuckDuckGo and ChatGPT’s web search feature down too

If you thought autonomous driving was just for cars, think again. The so-called ‘autonomous navigation’ market — where ships steer themselves guided by AI, resulting in fuel and time savings…

Autonomous shipping startup Orca AI tops up with $23M led by OCV Partners and MizMaa Ventures

The best known mycoprotein is probably Quorn, a meat substitute that’s fast approaching its 40th birthday. But Finnish biotech startup Enifer is cooking up something even older: Its proprietary single-cell…

Meet the Finnish biotech startup bringing a long lost mycoprotein to your plate

Silo, a Bay Area food supply chain startup, has hit a rough patch. TechCrunch has learned that the company on Tuesday laid off roughly 30% of its staff, or north…

Food supply chain software maker Silo lays off ~30% of staff amid M&A discussions

Featured Article

Meta’s new AI council is composed entirely of white men

Meanwhile, women and people of color are disproportionately impacted by irresponsible AI.

17 hours ago
Meta’s new AI council is composed entirely of white men

If you’ve ever wanted to apply to Y Combinator, here’s some inside scoop on how the iconic accelerator goes about choosing companies.

Garry Tan has revealed his ‘secret sauce’ for getting into Y Combinator

Indian ride-hailing startup BluSmart has started operating in Dubai, TechCrunch has exclusively learned and confirmed with its executive. The move to Dubai, which has been rumored for months, could help…

India’s BluSmart is testing its ride-hailing service in Dubai

Under the envisioned framework, both candidate and issue ads would be required to include an on-air and filed disclosure that AI-generated content was used.

FCC proposes all AI-generated content in political ads must be disclosed

Want to make a founder’s day, week, month, and possibly career? Refer them to Startup Battlefield 200 at Disrupt 2024! Applications close June 10 at 11:59 p.m. PT. TechCrunch’s Startup…

Refer a founder to Startup Battlefield 200 at Disrupt 2024

Social networking startup and X competitor Bluesky is officially launching DMs (direct messages), the company announced on Wednesday. Later, Bluesky plans to “fully support end-to-end encrypted messaging down the line,”…

Bluesky now has DMs

The perception in Silicon Valley is that every investor would love to be in business with Peter Thiel. But the venture capital fundraising environment has become so difficult that even…

Peter Thiel-founded Valar Ventures raised a $300 million fund, half the size of its last one

Featured Article

Spyware found on US hotel check-in computers

Several hotel check-in computers are running a remote access app, which is leaking screenshots of guest information to the internet.

20 hours ago
Spyware found on US hotel check-in computers

Gavet has had a rocky tenure at Techstars and her leadership was the subject of much controversy.

Techstars CEO Maëlle Gavet is out

The struggle isn’t universal, however.

Connected fitness is adrift post-pandemic

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

22 hours ago
A comprehensive list of 2024 tech layoffs

HoundDog actually looks at the code a developer is writing, using both traditional pattern matching and large language models to find potential issues.

HoundDog.ai helps developers prevent personal information from leaking

The changes are designed to enhance the consumer experience of using Google Pay and make it a more competitive option against other payment methods.

Google Pay will now display card perks, BNPL options and more

Few figures in the tech industry have earned the storied reputation of Vinod Khosla, founder and partner at Khosla Ventures. For over 40 years, he has been at the center…

Vinod Khosla is coming to Disrupt to discuss how AI might change the future