Media & Entertainment

Scammers peddling Islamophobic clickbait is business as usual at Facebook

Comment

facebook logo down glitch
Image Credits: Bryce Durbin / TechCrunch

A network of scammers used a ring of established right-wing Facebook pages to stoke Islamophobia and make a quick buck in the process, a new report from the Guardian reveals. But it’s less a vast international conspiracy and more simply that Facebook is unable to police its platform to prevent even the most elementary scams — with serious consequences.

The Guardian’s multi-part report depicts the events like a scheme of grand proportions executed for the express purpose of harassing Representatives Ilhan Omar (D-MI), Rashida Tlaib (D-MN) and other prominent Muslims. But the facts it uncovered point towards this being a run-of-the-mill money-making operation that used tawdry, hateful clickbait and evaded Facebook’s apparently negligible protections against this kind of thing.

The scam basically went like this: an administrator of a popular right-wing Facebook page would get a message from a person claiming to share their values that asked if they could be made an editor. Once granted access, this person would publish clickbait stories — frequently targeting Muslims, and often Rep. Omar, since they reliably led to high engagement. The stories appeared on a handful of ad-saturated websites that were presumably owned by the scammers.

That appears to be the extent of the vast conspiracy, or at least its operations — duping credulous conservatives into clicking through to an ad farm.

Its human cost, however, whether incidental or deliberate, is something else entirely. Rep. Omar is already the target of many coordinated attacks, some from self-proclaimed patriots within this country; just last month, an Islamophobic Trump supporter pleaded guilty in federal court to making death threats against her.

Social media is asymmetric warfare in that a single person can be the focal point for the firepower — figurative but often with the threat of literal — of thousands or millions. That a Member of Congress can be the target of such continuous abuse makes one question the utility of the platform on which that abuse is enabled.

In a searing statement offered to the Guardian, Rep. Omar took Facebook to task:

I’ve said it before and I’ll say it again: Facebook’s complacency is a threat to our democracy. It has become clear that they do not take seriously the degree to which they provide a platform for white nationalist hate and dangerous misinformation in this country and around the world. And there is a clear reason for this: they profit off it. I believe their inaction is a grave threat to people’s lives, to our democracy and to democracy around the world.

Despite the scale of its effect on Rep. Omar and other targets, it’s possible and even likely that this entire thing was carried out by a handful of people. The operation was based in Israel, the report repeatedly mentions, but it isn’t a room of state-sponsored hackers feverishly tapping their keyboards — the guy they tracked down is a jewelry retailer and amateur SEO hustler living in a suburb of Tel Aviv who answered the door in sweatpants and nonchalantly denied all involvement.

The funny thing is that, in a way, this does amount to a vast international conspiracy. On one hand, it’s a guy in sweatpants worming his way into some trashy Facebook pages and mass-posting links to his bunk news sites. But on the other, it’s a coordinated effort to promote Islamophobic, right-wing content that produced millions of interactions and doubtless further fanned the flames of hatred.

Facebook and YouTube’s moderation failure is an opportunity to deplatform the platforms

Why not both? After all, they represent different ways that Facebook fails as a platform to protect its users. “We don’t allow people to misrepresent themselves on Facebook,” the company wrote in a statement to the Guardian. Obviously, that isn’t true. Or rather, perhaps it’s true in the way that running at the pool isn’t allowed. People just do it anyway, because the lifeguards and Facebook don’t do their job.

In the case of the sweatpants-wearing man, there was a failure to detect what must have been a fairly obvious click farm coordinated by a handful of what are likely sockpuppet accounts. This is the kind of behavior that the company has been combating for years, and although it isn’t an exact analogue to what foreign actors are attempting in regards to election manipulation, it’s a close cousin.

Though many of these hateful, scammy posts were being put up simultaneously on more than 20 politically-oriented groups, and all led to the same set of websites, nothing in Facebook’s vaunted automated defense mechanism flagged them. And remember, this wasn’t a one-time thing — it happened for months on end, involving thousands of posts.

If this isn’t “coordinated inauthentic behavior,” what is? And if Facebook has to rely on reporters — over and over, it must be said — to find scammers living and working on its own roof, why should we believe it when it says it “takes this very seriously?”

It’s disheartening and entirely consistent with widespread discontent with Facebook’s inability to police itself that a violation of its rules this obvious could persist for so long. For years Facebook has talked about cracking down on exactly this type of behavior: fake accounts, fake news, fake sites. To be sure we see the occasional blog post about how a network of 200 fake users was taken down. And it may be said that the present network is only obvious in retrospect.

But consider that not only does Facebook have access to enormous amounts of non-public information that should provide the insight it needs to identify and combat this type of abuse, it has spent years — or so it claims — developing tools for exactly this purpose. It would be more disappointing had we not seen failures like this before.

The case of the coordinated hatred is the more depressing one. It seems that the Islamophobia and other vitriol was only being used because that’s what drives traffic. Was the purveyor of this content ideologically driven? It’s certainly possible, but it’s also possible that they simply knew what clicks.

Facebook’s policy on white supremacy plays right into a racist agenda

Bigotry is a powerful motivator, as has been proven over and over again. And Facebook is foremost in allowing such content to flourish and reach those vulnerable to its siren call, or dog whistle, however the case may be, seemingly because it is the kind of thing that drives engagement.

Of course Facebook would deny that it is simply allowing bad actors and objectionable content to live on its platform in order to keep engagement levels high. And yet, it declined to disallow even demonstrably false political ads. It promises better moderation, and yet it won’t hire the full-time workforce necessary to do so. It wants to surface “true” news and demote “false” news, but its deals with fact-checkers fall apart left and right.

Caught in the middle of these promises and the half-hearted attempts to keep them are the users, who, the poor things, don’t always have their own best interests in mind. They create private groups to escape moderation, or tailor their posts carefully to fit neatly in the “allowed” category while remaining obviously hateful or threatening. And so a platform that was once useful in a very real yet somewhat narrow sense has become a minefield of conflict and sabotage.

That one person or a handful of people can, essentially as a byproduct of a tired scam, produce a factory for vile and divisive content, driving millions of interactions and comments that make the world a worse place, is shameful. And it seems to be an inextinguishable part of the Facebook experience — perhaps even its business model.

More TechCrunch

The prospects for troubled banking-as-a-service startup Synapse have gone from bad to worse this week after a United States Trustee filed an emergency motion on Wednesday.  The trustee is asking…

A US Trustee wants troubled fintech Synapse to be liquidated via Chapter 7 bankruptcy, cites ‘gross mismanagement’

U.K.-based Seraphim Space is spinning up its 13th accelerator program, with nine participating companies working on a range of tech from propulsion to in-space manufacturing and space situational awareness. The…

Seraphim’s latest space accelerator welcomes nine companies

OpenAI has reached a deal with Reddit to use the social news site’s data for training AI models. In a blog post on OpenAI’s press relations site, the company said…

OpenAI inks deal to train AI on Reddit data

X users will now be able to discover posts from new Communities that are trending directly from an Explore tab within the section.

X pushes more users to Communities

For Mark Zuckerberg’s 40th birthday, his wife got him a photoshoot. Zuckerberg gives the camera a sly smile as he sits amid a carefully crafted re-creation of his childhood bedroom.…

Mark Zuckerberg’s makeover: Midlife crisis or carefully crafted rebrand?

Strava announced a slew of features, including AI to weed out leaderboard cheats, a new ‘family’ subscription plan, dark mode and more.

Strava taps AI to weed out leaderboard cheats, unveils ‘family’ plan, dark mode and more

We all fall down sometimes. Astronauts are no exception. You need to be in peak physical condition for space travel, but bulky space suits and lower gravity levels can be…

Astronauts fall over. Robotic limbs can help them back up.

Microsoft will launch its custom Cobalt 100 chips to customers as a public preview at its Build conference next week, TechCrunch has learned. In an analyst briefing ahead of Build,…

Microsoft’s custom Cobalt chips will come to Azure next week

What a wild week for transportation news! It was a smorgasbord of news that seemed to touch every sector and theme in transportation.

Tesla keeps cutting jobs and the feds probe Waymo

Sony Music Group has sent letters to more than 700 tech companies and music streaming services to warn them not to use its music to train AI without explicit permission.…

Sony Music warns tech companies over ‘unauthorized’ use of its content to train AI

Winston Chi, Butter’s founder and CEO, told TechCrunch that “most parties, including our investors and us, are making money” from the exit.

GrubMarket buys Butter to give its food distribution tech an AI boost

The investor lawsuit is related to Bolt securing a $30 million personal loan to Ryan Breslow, which was later defaulted on.

Bolt founder Ryan Breslow wants to settle an investor lawsuit by returning $37 million worth of shares

Meta, the parent company of Facebook, launched an enterprise version of the prominent social network in 2015. It always seemed like a stretch for a company built on a consumer…

With the end of Workplace, it’s fair to wonder if Meta was ever serious about the enterprise

X, formerly Twitter, turned TweetDeck into X Pro and pushed it behind a paywall. But there is a new column-based social media tool in town, and it’s from Instagram Threads.…

Meta Threads is testing pinned columns on the web, similar to the old TweetDeck

As part of 2024’s Accessibility Awareness Day, Google is showing off some updates to Android that should be useful to folks with mobility or vision impairments. Project Gameface allows gamers…

Google expands hands-free and eyes-free interfaces on Android

A hacker listed the data allegedly breached from Samco on a known cybercrime forum.

Hacker claims theft of India’s Samco account data

A top European privacy watchdog is investigating following the recent breaches of Dell customers’ personal information, TechCrunch has learned.  Ireland’s Data Protection Commission (DPC) deputy commissioner Graham Doyle confirmed to…

Ireland privacy watchdog confirms Dell data breach investigation

Ampere and Qualcomm aren’t the most obvious of partners. Both, after all, offer Arm-based chips for running data center servers (though Qualcomm’s largest market remains mobile). But as the two…

Ampere teams up with Qualcomm to launch an Arm-based AI server

At Google’s I/O developer conference, the company made its case to developers — and to some extent, consumers — why its bets on AI are ahead of rivals. At the…

Google I/O was an AI evolution, not a revolution

TechCrunch Disrupt has always been the ultimate convergence point for all things startup and tech. In the bustling world of innovation, it serves as the “big top” tent, where entrepreneurs,…

Meet the Magnificent Six: A tour of the stages at Disrupt 2024

There’s apparently a lot of demand for an on-demand handyperson. Khosla Ventures and Pear VC have just tripled down on their investment in Honey Homes, which offers up a dedicated…

Khosla Ventures, Pear VC triple down on Honey Homes, a smart way to hire a handyman

TikTok is testing the ability for users to upload 60-minute videos, the company confirmed to TechCrunch on Thursday. The feature is available to a limited group of users in select…

TikTok tests 60-minute video uploads as it continues to take on YouTube

Flock Safety is a multibillion-dollar startup that’s got eyes everywhere. As of Wednesday, with the company’s new Solar Condor cameras, those eyes are solar-powered and use wireless 5G networks to…

Flock Safety’s solar-powered cameras could make surveillance more widespread

Since he was very young, Bar Mor knew that he would inevitably do something with real estate. His family was involved in all types of real estate projects, from ground-up…

Agora raises $34M Series B to keep building the Carta for real estate

Poshmark, the social commerce site that lets people buy and sell new and used items to each other, launched a paid marketing tool on Thursday, giving sellers the ability to…

Poshmark’s ‘Promoted Closet’ tool lets sellers boost all their listings at once

Google is launching a Gemini add-on for educational institutes through Google Workspace.

Google adds Gemini to its Education suite

More money for the generative AI boom: Y Combinator-backed developer infrastructure startup Recall.ai announced Thursday it has raised a $10 million Series A funding round, bringing its total raised to over…

YC-backed Recall.ai gets $10M Series A to help companies use virtual meeting data

Engineers Adam Keating and Jeremy Andrews were tired of using spreadsheets and screenshots to collab with teammates — so they launched a startup, CoLab, to build a better way. The…

CoLab’s collaborative tools for engineers line up $21M in new funding

Reddit announced on Wednesday that it is reintroducing its awards system after shutting down the program last year. The company said that most of the mechanisms related to awards will…

Reddit reintroduces its awards system

Sigma Computing, a startup building a range of data analytics and business intelligence tools, has raised $200 million in a fresh VC round.

Sigma is building a suite of collaborative data analytics tools