Government & Policy

UK expands Online Safety Bill to criminalize encouraging self harm

Comment

Michelle Donelan, SoS for DCMS
Image Credits: Getty Images under a Leon Neal/Getty Images (opens in a new window) license.

The U.K. government has said it will further expand the scope of online safety legislation by criminalizing the encouragement of self-harm — in a bid to tackle what it describes as “tragic and avoidable deaths caused by people seeing self-harm content online”.

The latest amendment to the controversial but populist Online Safety Bill will mean in-scope platforms will be required to remove content that deliberately encourages somebody to physically injure themselves — or else risk penalties under the legislation.

Individuals posting such content online could also face prosecution under the new offence of encouraging self harm and the secretary of state for digital said the government wants to target “abhorrent trolls encouraging the young and vulnerable to self-harm”.

The government said the maximum penalties will be set out in due course.

It is already illegal to encourage or assist suicide, online or offline, in the U.K. so the creation of the new offence is intended to bring self harm content in line with an existing prohibition on communications encouraging suicide.

The Online Safety Bill’s passage through parliament remains on pause following an interruption this summer linked to political turmoil in the governing Conservative Party. But the reshuffled UK government has said it will bring the bill back to parliament next month after making tweaks to the legislation.

Just last week the Ministry of Justice announced some incoming additions to the Online Safety Bill, which are focused on tackling abuse of intimate imagery. However further changes are slated around ‘legal but harmful’ content so the full shape of the legislation remains tbc.

UK to criminalize deepfake porn sharing without consent

The latest changes — making it illegal to send online communications encouraging self harm — come a few months after the government said it would respond to concerns over the bill’s impact on freedom of expression online, with the (new) secretary of state, Michelle Donelan, saying in September she would be “editing” the bill to reduce concern about its impact on ‘legal but harmful’ speech for adults.

Since then child safety groups, which have been campaigning for years for the government to pass online safety legislation, have raised concerns about the bill being weakened — so the government’s move to make encouraging self harm an offence looks intended to respond to that concern.

Yesterday the BBC reported Donelan saying the latest changes were influenced by the case of Molly Russell: The 14-year-old schoolgirl who took her own life five years ago after viewing thousands of pieces of online content about self-harm and suicide on platforms including Instagram and Pinterest.

An inquest into Russell’s death concluded in September that social media had been a factor in her demise. While, last month, the coroner’s ‘prevention of future deaths’ report recommended a series of measures be taken to regulate and monitor minors’ access to social media content.

Social media a factor in death of UK schoolgirl, inquest finds

The Department for Digital, Culture, Media and Sport said the move to add an offence of encouraging self harm will make illegal “one of the most concerning and pervasive online harms that currently falls below the threshold of criminal behaviour”.

In a statement, Donelan added:

I am determined that the abhorrent trolls encouraging the young and vulnerable to self-harm are brought to justice.

So I am strengthening our online safety laws to make sure these vile acts are stamped out and the perpetrators face jail time.

Social media firms can no longer remain silent bystanders either and they’ll face fines for allowing this abusive and destructive behaviour to continue on their platforms under our laws.

Other priority illegal offences already listed in the bill include hate crimes; provisions around revenge porn (and sharing deepfake porn without content); harassment and cyberstalking.

Following the coroner’s report into Russell’s death, Donelan said measures for safeguarding children would be beefed up as part of tweaks being made to the bill. So by making encouraging self harm illegal the government will — on paper — remove that particular type of problem content out of the ‘legal but harmful’ bucket, which may make it easier for ministers to reduce the level of regulation applied to this type of speech without being accused of undermining essential child protection provisions.

However, regardless of what the bill says on paper, huge questions remain over how platforms will respond to legal duties being placed on them to regulate all sorts of speech — and whether it will boost safety for web users as claimed.

Meanwhile, major freedom of expression concerns remain over a regime with penalties that scale up to 10% of global annual turnover — and even the risk of jail time for non-cooperative senior execs — with critics worried it will have a chilling effect by setting up platforms as defacto speech police and encouraging them to overblock content to shrink their legal risk of a hefty fine.

Since the controversial speech regulation legislation was published in full last year, kicking off over a year of parliamentary scrutiny, the government’s approach has faced plenty of criticism and concern from inside parliament that the bill falls short of its stated aims and claims, even as mainstream child safety groups and campaigners (and a majority of lawmakers on both sides of the house) continue to press for online safety legislation to be passed.

Outside parliament, rights campaigners, legal and technical experts are among those continuing to warn of a looming mess which they argue will apply the biggest penalties to U.K. web users faced with access restrictions like age verification pop-ups and and homegrown startups faced with impossibly fuzzy demands and expensive compliance costs, with many also arguing the bill won’t do what’s claimed and protect kids either.

The a tug of war between controversy over the government’s entire approach and loud populist support for child safety claims attached to the bill has not reduced ministers’ claimed commitment to passing the legislation — despite the rebooted U.K. government expressing some freedom of expression qualms — but it remains to be seen how extensively it will rethink the regulation of ‘legal but harmful’ speech.

The bill is due to return to parliament on Monday December 5.

Another growing controversy attached to the bill relates to the potentially disastrous impact on messaging apps’ use of end-to-end encryption — since another recent government amendment puts a requirement on private messaging apps to be able to detect and remove child sexual exploitation and abuse (CSEA) content in both public and private communications between users which raises questions about how they can do so if they have implemented E2EE on the service — and, therefore, what the legislation will do to the strong security that exists to protect all users?

Last week a legal opinion written by a leading U.K. barrister, commissioned by the free speech campaign group Index on Censorship, also questioned whether the bill is compatible with the U.K.’s human rights obligations — warning over the extent of the proposed surveillance of app users’ communications being mandated on the private sector by a government appointed regulatory body and without independent oversight.

Surveillance powers in UK’s Online Safety Bill are risk to E2EE, warns legal expert

Coroner’s report into UK schoolgirl’s suicide urges social media regulation

More TechCrunch

Elon Musk’s X is preparing to make “Likes” private on the social network, in a change that could potentially confuse users over the difference between something they’ve favorited and something…

X should bring back stars, not hide ‘Likes’

The FCC has proposed a $6 million fine for the scammer who used voice-cloning tech to impersonate President Biden in a series of illegal robocalls during a New Hampshire primary…

$6M fine for robocaller who used AI to clone Biden’s voice

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Is it…

Tesla lobbies for Elon and Kia taps into the GenAI hype

Crowdaa is an app that allows non-developers to easily create and release apps on the mobile store. 

App developer Crowdaa raises €1.2M and plans a US expansion

Back in 2019, Canva, the wildly successful design tool, introduced what the company was calling an enterprise product, but in reality it was more geared toward teams than fulfilling true…

Canva launches a proper enterprise product — and they mean it this time

TechCrunch Disrupt 2024 isn’t just an event for innovation; it’s a platform where your voice matters. With the Disrupt 2024 Audience Choice Program, you have the power to shape the…

2 days left to vote for Disrupt Audience Choice

The United States Department of Justice and 30 state attorneys general filed a lawsuit against Live Nation Entertainment, the parent company of Ticketmaster, for alleged monopolistic practices. Live Nation and…

Ticketmaster is at the heart of a US antitrust lawsuit against parent company Live Nation

The U.K. will shortly get its own rulebook for Big Tech, after peers in the House of Lords agreed Thursday afternoon to pass the Digital Markets, Competition and Consumer bill…

‘Pro-competition’ rules for Big Tech make it through UK’s pre-election wash-up

Spotify’s addition of its AI DJ feature, which introduces personalized song selections to users, was the company’s first step into an AI future. Now, Spotify is developing an alternative version…

Spotify experiments with an AI DJ that speaks Spanish

Call Arc can help answer immediate and small questions, according to the company. 

Arc Search’s new Call Arc feature lets you ask questions by ‘making a phone call’

After multiple delays, Apple and the Paris area transportation authority rolled out support for Paris transit passes in Apple Wallet. It means that people can now use their iPhone or…

Paris transit passes now available in iPhone’s Wallet app

Redwood Materials, the battery recycling startup founded by former Tesla co-founder JB Straubel, will be recycling production scrap for batteries going into General Motors electric vehicles.  The company announced Thursday…

Redwood Materials is partnering with Ultium Cells to recycle GM’s EV battery scrap

A new startup called Auggie is aiming to give parents a single platform where they can shop for products and connect with each other. The company’s new app, which launched…

Auggie’s new app helps parents find community and shop

Andrej Safundzic, Alan Flores Lopez and Leo Mehr met in a class at Stanford focusing on ethics, public policy and technological change. Safundzic — speaking to TechCrunch — says that…

Lumos helps companies manage their employees’ identities — and access

Remark trains AI models on human product experts to create personas that can answer questions with the same style of their human counterparts.

Remark puts thousands of human product experts into AI form

ZeroPoint claims to have solved compression problems with hyper-fast, low-level memory compression that requires no real changes to the rest of the computing system.

ZeroPoint’s nanosecond-scale memory compression could tame power-hungry AI infrastructure

In 2021, Roi Ravhon, Asaf Liveanu and Yizhar Gilboa came together to found Finout, an enterprise-focused toolset to help manage and optimize cloud costs. (We covered the company’s launch out…

Finout lands cash to grow its cloud spend management platform

On the heels of raising $102 million earlier this year, Bugcrowd is making good on its promise to use some of that funding to make acquisitions to strengthen its security…

Bugcrowd, the crowdsourced white-hat hacker platform, acquires Informer to ramp up its security chops

Google is preparing to build what will be the first subsea fiber-optic cable connecting the continents of Africa and Australia. The news comes as the major cloud hyperscalers battle it…

Google to build first subsea fiber-optic cable connecting Africa with Australia

The Kia EV3 — the new all-electric compact SUV revealed Thursday — illustrates a growing appetite among global automakers to bring generative AI into their vehicles.  The automaker said the…

The new Kia EV3 will have an AI assistant with ChatGPT DNA

Bing, Microsoft’s search engine, was working improperly for several hours on Thursday in Europe. At first, we noticed it wasn’t possible to perform a web search at all. Now it…

Bing’s API was down, taking Microsoft Copilot, DuckDuckGo and ChatGPT’s web search feature down too

If you thought autonomous driving was just for cars, think again. The “autonomous navigation” market — where ships steer themselves guided by AI, resulting in fuel and time savings —…

Autonomous shipping startup Orca AI tops up with $23M led by OCV Partners and MizMaa Ventures

The best known mycoprotein is probably Quorn, a meat substitute that’s fast approaching its 40th birthday. But Finnish biotech startup Enifer is cooking up something even older: Its proprietary single-cell…

Meet the Finnish biotech startup bringing a long-lost mycoprotein to your plate

Silo, a Bay Area food supply chain startup, has hit a rough patch. TechCrunch has learned that the company on Tuesday laid off roughly 30% of its staff, or north…

Food supply chain software maker Silo lays off ~30% of staff amid M&A discussions

Featured Article

Meta’s new AI council is composed entirely of white men

Meanwhile, women and people of color are disproportionately impacted by irresponsible AI.

21 hours ago
Meta’s new AI council is composed entirely of white men

If you’ve ever wanted to apply to Y Combinator, here’s some inside scoop on how the iconic accelerator goes about choosing companies.

Garry Tan has revealed his ‘secret sauce’ for getting into Y Combinator

Indian ride-hailing startup BluSmart has started operating in Dubai, TechCrunch has exclusively learned and confirmed with its executive. The move to Dubai, which has been rumored for months, could help…

India’s BluSmart is testing its ride-hailing service in Dubai

Under the envisioned framework, both candidate and issue ads would be required to include an on-air and filed disclosure that AI-generated content was used.

FCC proposes all AI-generated content in political ads must be disclosed

Want to make a founder’s day, week, month, and possibly career? Refer them to Startup Battlefield 200 at Disrupt 2024! Applications close June 10 at 11:59 p.m. PT. TechCrunch’s Startup…

Refer a founder to Startup Battlefield 200 at Disrupt 2024