Government & Policy

EU lawmakers under pressure to fully disclose dealings with child safety tech maker, Thorn

Comment

Thorny branch
Image Credits: Paul Scott (opens in a new window) / Flickr (opens in a new window) under a CC BY-SA 2.0 (opens in a new window) license.

More trouble for European Union lawmakers in a controversial area of tech policymaking — namely the bloc’s proposed legislation to apply surveillance technologies, such as client-side scanning, to digital messaging to try to detect child sexual abuse material (CSAM).

This week the Commission’s ombudsman published details of a finding it made in December of maladministration over a decision by the EU’s executive not to release fuller information pertaining to its communications with a child safety tech maker. Last year the Commission released some documents relating to its exchanges with the company in question but denied access to others.

The recommendation follows a June 2022 complainant to the ombudsman, made by a journalist, who had requested public access to documents sent to the Commission by Thorn, a US entity that sells AI technologies it claims can detect and remove CSAM.

In her recommendation, the EU’s ombudsman, Emily O’Reilly, urges the Commission to “reconsider its decision with a view to giving significantly increased, if not full, public access to the documents at issue”.

“In light of the related ongoing legislative procedure and the resulting time-sensitivity of this case, the ombudsman urged the Commission to implement her recommendation swiftly,” she adds.

The Commission presented its original proposal for a legal framework that could obligate digital services to use automated technologies to detect and report existing or new CSAM, and also identify and report grooming activity targeting kids on their platforms, back in May 2022. But the file remains under active negotiations by its EU co-legislators, the European Parliament and Council — a factor the ombudsman flags as an important consideration for applying transparency to drive accountability around EU lawmaking.

Disclosure of the documents at issue “will enable the public to participate more effectively in a decision-making process that will very likely directly affect citizen’s day-to-day life by limiting their right to privacy,” she suggests. “Secondly, transparency will allow the public to scrutinise who and what informed the legislative proposal in question. Stakeholders who actively provide input should not be allowed to do so behind closed doors.”

Critics have suggested the Commission’s controversial message-scanning proposal has been unduly influenced by lobbyists promoting proprietary child safety tech who stand to benefit commercially from laws mandating automated CSAM checks.

Last fall, a seminar organised by the European Data Protection Supervisor also heard a wide range of concerns that the Commission proposal is likely to be both ineffective as a tool to fight child sexual abuse and a major risk to fundamental freedoms in a democratic society.

Since then, parliamentarians have backed a revised approach for combating CSAM that would remove the requirement for messaging platforms to scan end-to-end encrypted messages, among other limits. But EU legislation is a three way affair — requiring buy in from the Commission and Council, too. So it remains to be seen where the CSAM file will land.

Asked on Monday about the ombudsman’s recommendation that the Commission release more of its exchanges with Thorn the EU’s executive took until today (Wednesday) to send us a brief reply (see below). Its response suggests it plans to take its time to chew over the ombudsman’s finding of maladministration, given it makes a point of flagging a generous deadline for it to respond to her recommendations that’s more than two months hence. Which doesn’t suggest a swift resolution incoming. More it smacks of a can being kicked down the road.

Here’s the statement, attributed to European Commission spokesperson for Home Affairs, Anitta Hipper:

The Commission will provide access to documents as appropriate and within our legal framework. Specifically, as regards the Ombudsman recommendation, the Commission will carefully consider the recommendation of the Ombudsman. A reply is due by March 19.

The legislative proposal has already caused another internal controversy for the Commission. Last year it ran into hot water over microtargeted ads its home affairs division was spotted running on the social network X to promote the legislation — leading to a number of data protection complaints as data used for targeting appeared to include sensitive personal information.

In November, privacy rights group noyb filed a complaint against the Commission over this to its privacy oversight body, the European Data Protection Supervisor.

An internal investigation opened by the Commission in the wake of reporting of the episode, meanwhile, has yet to produce any public results. Each time we’ve asked the Commission about this probe it has said it does not have an update.

However the existence of the internal investigation has had one tangible result: The EU ombudsman declined to open an investigation into the microtargeting following a complaint by MEP Patrick Breyer last October — in her response to the MEP O’Reilly pointed to the Commission’s ongoing probe as “sufficient grounds” for her not to investigate at that point, writing: “I note that the Commission has explained in the media that internal investigations are ongoing. Therefore, for the moment, I do not find sufficient grounds to open an inquiry.”

At the same time, she did agree to open an investigation into the transfer of two staffers from Europol, a pan-EU law enforcement coordinating agency, to Thorn — following another complaint by Breyer over a potential conflict of interest.

“I have decided to open an inquiry to investigate how Europol dealt with the moves of two former staff members to positions related to combatting online child sexual abuse,” she wrote. “As a first step, I have decided that it is necessary to inspect certain documents held by Europol related to these post-service activities. I expect to receive these documents by January 15, 2024.”

It remains to be seen what the ombudsman’s investigation of Europol’s comms with Thorn will conclude. (But there is, perhaps, no small irony that additional controversy around the Commission’s message-scanning proposal is being stoked by access to (and/or, well, lack of it) ‘private’ comms passing between EU institutions and industry lobbyists. Possibly there’s a message in there for policymakers if they could but read it.)

We reached out to Thorn but it did not respond to a request for comment about the ombudsman’s inquiry.

A piece of investigative journalism published by BalkanInsight last fall, looking into Thorn’s lobbying and reporting on comms between the Commission and Thorn that its journalists were able to obtain, questioned the level of influence commercial child safety tech makers that stand to cash in on laws mandating message scanning have acquired over EU policymaking.

“After seven months of communication concerning access to documents and the intervention of the European ombudsman, in early September the Commission finally released a series of email exchanges between Johansson’s Directorate-General for Migration and Home Affairs and Thorn,” its journalists reported. “The emails reveal a continuous and close working relationship between the two sides in the months following the roll out of the CSAM proposal, with the Commission repeatedly facilitating Thorn’s access to crucial decision-making venues attended by ministers and representatives of EU member states.”

The EU commissioner spearheading the CSAM-scanning proposal, home affairs commissioner, Ylva Johansson, has repeatedly rejected claims she allowed industry lobbyists to influence her proposal.

Follow-up reporting by BalkanInsight last year, citing minutes released under freedom of information, found Europol officials had pushed in a meeting with Commission staff for unfiltered access to data which would be obtained under the CSAM-scanning proposal; and for the scanning systems to be used to detect other types of crime, not just child sexual abuse.

Critics of the controversial EU CSAM-scanning proposal have long warned that once surveillance tech is embedded into private messaging infrastructure there will be pressure from law enforcement agencies to expand the scope of what’s being scanned for.

EU commissioner sidesteps MEPs’ questions about CSAM proposal microtargeting

EU faces privacy complaint over CSAM microtargeting ads it ran on X

More TechCrunch

Apple’s annual list of what it considers the best and most innovative software available on its platform is turning its attention to the little guy.

Apple’s Design Awards nominees highlight indies and startups, largely ignore AI (except for Arc)

The spyware maker’s founder, Bryan Fleming, said pcTattletale is “out of business and completely done,” following a data breach.

Spyware maker pcTattletale shutters after data breach

AI models are always surprising us, not just in what they can do, but what they can’t, and why. An interesting new behavior is both superficial and revealing about these…

AI models have favorite numbers, because they think they’re people

On Friday, Pal Kovacs was listening to the long-awaited new album from rock and metal giants Bring Me The Horizon when he noticed a strange sound at the end of…

Rock band’s hidden hacking-themed website gets hacked

Jan Leike, a leading AI researcher who earlier this month resigned from OpenAI before publicly criticizing the company’s approach to AI safety, has joined OpenAI rival Anthropic to lead a…

Anthropic hires former OpenAI safety lead to head up new team

Welcome to TechCrunch Fintech! This week, we’re looking at the long-term implications of Synapse’s bankruptcy on the fintech sector, Majority’s impressive ARR milestone, and more!  To get a roundup of…

The demise of BaaS fintech Synapse could derail the funding prospects for other startups in the space

YouTube’s free Playables don’t directly challenge the app store model or break Apple’s rules. However, they do compete with the App Store’s free games.

YouTube’s free games catalog ‘Playables’ rolls out to all users

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

5 hours ago
A comprehensive list of 2024 tech layoffs

OpenAI has formed a new committee to oversee “critical” safety and security decisions related to the company’s projects and operations. But, in a move that’s sure to raise the ire…

OpenAI’s new safety committee is made up of all insiders

Time is running out for tech enthusiasts and entrepreneurs to secure their early-bird tickets for TechCrunch Disrupt 2024! With only four days left until the May 31 deadline, now is…

Early bird gets the savings — 4 days left for Disrupt sale

AI may not be up to the task of replacing Google Search just yet, but it can be useful in more specific contexts — including handling the drudgery that comes…

Skej’s AI meeting scheduling assistant works like adding an EA to your email

Faircado has built a browser extension that suggests pre-owned alternatives for ecommerce listings.

Faircado raises $3M to nudge people to buy pre-owned goods

Tumblr, the blogging site acquired twice, is launching its “Communities” feature in open beta, the Tumblr Labs division has announced. The feature offers a dedicated space for users to connect…

Tumblr launches its semi-private Communities in open beta

Remittances from workers in the U.S. to their families and friends in Latin America amounted to $155 billion in 2023. With such a huge opportunity, banks, money transfer companies, retailers,…

Félix Pago raises $15.5 million to help Latino workers send money home via WhatsApp

Google said today it’s adding new AI-powered features such as a writing assistant and a wallpaper creator and providing easy access to Gemini chatbot to its Chromebook Plus line of…

Google adds AI-powered features to Chromebook

The dynamic duo behind the Grammy Award–winning music group the Chainsmokers, Alex Pall and Drew Taggart, are set to bring their entrepreneurial expertise to TechCrunch Disrupt 2024. Known for their…

The Chainsmokers light up Disrupt 2024

The deal will give LumApps a big nest egg to make acquisitions and scale its business.

LumApps, the French ‘intranet super app,’ sells majority stake to Bridgepoint in a $650M deal

Featured Article

More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Nubank is taking its first tentative steps into the mobile network realm, as the NYSE-traded Brazilian neobank rolls out an eSIM (embedded SIM) service for travelers. The service will give customers access to 10GB of free roaming internet in more than 40 countries without having to switch out their own existing physical SIM card or…

12 hours ago
More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Infra.Market, an Indian startup that helps construction and real estate firms procure materials, has raised $50M from MARS Unicorn Fund.

MARS doubles down on India’s Infra.Market with new $50M investment

Small operations can lose customers by not offering financing, something the Berlin-based startup wants to change.

Cloover wants to speed solar adoption by helping installers finance new sales

India’s Adani Group is in discussions to venture into digital payments and e-commerce, according to a report.

Adani looks to battle Reliance, Walmart in India’s e-commerce, payments race, report says

Ledger, a French startup mostly known for its secure crypto hardware wallets, has started shipping new wallets nearly 18 months after announcing the latest Ledger Stax devices. The updated wallet…

Ledger starts shipping its high-end hardware crypto wallet

A data protection taskforce that’s spent over a year considering how the European Union’s data protection rulebook applies to OpenAI’s viral chatbot, ChatGPT, reported preliminary conclusions Friday. The top-line takeaway…

EU’s ChatGPT taskforce offers first look at detangling the AI chatbot’s privacy compliance

Here’s a shoutout to LatAm early-stage startup founders! We want YOU to apply for the Startup Battlefield 200 at TechCrunch Disrupt 2024. But you’d better hurry — time is running…

LatAm startups: Apply to Startup Battlefield 200

The countdown to early-bird savings for TechCrunch Disrupt, taking place October 28–30 in San Francisco, continues. You have just five days left to save up to $800 on the price…

5 days left to get your early-bird Disrupt passes

Venture investment into Spanish startups also held up quite well, with €2.2 billion raised across some 850 funding rounds.

Spanish startups reached €100 billion in aggregate value last year

Featured Article

Onyx Motorbikes was in trouble — and then its 37-year-old owner died

James Khatiblou, the owner and CEO of Onyx Motorbikes, was watching his e-bike startup fall apart.  Onyx was being evicted from its warehouse in El Segundo, near Los Angeles. The company’s unpaid bills were stacking up. Its chief operating officer had abruptly resigned. A shipment of around 100 CTY2 dirt bikes from Chinese supplier Suzhou…

1 day ago
Onyx Motorbikes was in trouble — and then its 37-year-old owner died

Featured Article

Iyo thinks its GenAI earbuds can succeed where Humane and Rabbit stumbled

Iyo represents a third form factor in the push to deliver standalone generative AI devices: Bluetooth earbuds.

1 day ago
Iyo thinks its GenAI earbuds can succeed where Humane and Rabbit stumbled

Arati Prabhakar, profiled as part of TechCrunch’s Women in AI series, is director of the White House Office of Science and Technology Policy.

Women in AI: Arati Prabhakar thinks it’s crucial to get AI ‘right’

AniML, the French startup behind a new 3D capture app called Doly, wants to create the Photoroom of product videos, sort of. If you’re selling sneakers on an online marketplace…

Doly lets you generate 3D product videos from your iPhone