AI

Big tech’s ‘blackbox’ algorithms face regulatory oversight under EU plan

Comment

Image Credits: Bryce Durbin / TechCrunch

Major Internet platforms will be required to open up their algorithms to regulatory oversight under proposals European lawmakers are set to introduce next month.

In a speech today Commission EVP Margrethe Vestager suggested algorithmic accountability will be a key plank of the forthcoming legislative digital package — with draft rules incoming that will require platforms to explain how their recommendation systems work as well as offering users more control over them.

“The rules we’re preparing would give all digital services a duty to cooperate with regulators. And the biggest platforms would have to provide more information on the way their algorithms work, when regulators ask for it,” she said, adding that platforms will also “have to give regulators and researchers access to the data they hold — including ad archives”.

While social media platforms like Facebook have set up ad archives ahead of any regulatory requirement to do so there are ongoing complaints from third party researchers about how the information is structured and how (in)accessible it is to independent study.

More information for users around ad targeting is another planned requirement, along with greater reporting requirements for platforms to explain content moderation decisions, per Vestager — who also gave a preview of what’s coming down the pipe in the Digital Services Act and Digital Markets Act in another speech earlier this week.

Europe to limit how big tech can push its own services and use third-party data

Regional lawmakers are responding to concerns that ‘blackbox’ algorithms can have damaging effects on individuals and societies — flowing from how they process data and order and rank information, with risks such as discrimination, amplification of bias and abusive targeting of vulnerable individuals and groups.

The Commission has said it’s working on binding transparency rules with the aim of forcing tech giants to take more responsibility for the content their platforms amplify and monetize. Although the devil will be in both the detail of the requirements and how effectively they will be enforced — but a draft of the plan is due in a month or so.

“One of the main goals of the Digital Services Act that we’ll put forward in December will be to protect our democracy, by making sure that platforms are transparent about the way these algorithms work – and make those platforms more accountable for the decisions they make,” said Vestager in a speech today at an event organized by not-for-profit research advocacy group AlgorithmWatch.

“The proposals that we’re working on would mean platforms have to tell users how their recommender systems decide which content to show – so it’s easier for us to judge whether to trust the picture of the world that they give us or not.”

Under the planned rules the most powerful Internet platforms — so-called ‘gatekeepers’ in EU parlance — will have to provide regular reports on “the content moderation tools they use, and the accuracy and results of those tools”, as Vestager put it.

There will also be specific disclosure requirements for ad targeting that go beyond the current fuzzy disclosures that platforms like Facebook may already offer (in its case via the ‘why am I seeing this ad?’ menu).

“Better information” will have to be provided, she said, such as platforms telling users “who placed a certain ad, and why it’s been targeted at us”. The overarching aim will be to ensure users of such platforms have “a better idea of who’s trying to influence us — and a better chance of spotting when algorithms are discriminating against us,” she added. 

Today a coalition of 46 civic society organizations led by AlgorithmWatch urged the Commission to make sure transparency requirements in the forthcoming legislation are “meaningful” — calling for it to introduce “comprehensive data access frameworks” that provide watchdogs with the tools they need to hold platforms accountable, as well as to enable journalists, academics, and civil society to “challenge and scrutinize power”.

The group’s set of recommendations call for binding disclosure obligations based on the technical functionalities of dominant platforms; a single EU institution “with a clear legal mandate to enable access to data and to enforce transparency obligations”; and provisions to ensure data collection complies with EU data protection rules.

Another way to rebalance the power asymmetry between data-mining platform giants and the individuals who they track, profile and target could involve requirements to let users switch off algorithmic feeds entirely if they wish — opting out of the possibility of data-driven discrimination or manipulation. But it remains to be seen whether EU lawmakers will go that far in the forthcoming legislative proposals.

The only hints Vestager offered on this front was to say that the planned rules “will also give more power to users — so algorithms don’t have the last word about what we get to see, and what we don’t get to see”.

Platforms will also have to give users “the ability to influence the choices that recommender systems make on our behalf”, she also said.

In further remarks she confirmed there will be more detailed reporting requirements for digital services around content moderation and takedowns — saying they will have to tell users when they take content down, and give them “effective rights to challenge that removal”. While there is widespread public support across the bloc for rebooting the rules of play for digital giants there are also strongly held views that regulation should not impinge on online freedom of expression — such as by encouraging platforms to shrink their regulatory risk by applying upload filters or removing controversial content without a valid reason.

The proposals will need the support of EU Member States, via the European Council, and elected representatives in the European parliament.

The latter has already voted in support of tighter rules on ad targeting. MEPs also urged the Commission to reject the use of upload filters or any form of ex-ante content control for harmful or illegal content, saying the final decision on whether content is legal or not should be taken by an independent judiciary.

Simultaneously the Commission is working on shaping rules specifically for applications that use artificial intelligence — but that legislative package is not due until next year.

Vestager confirmed that will be introduced early in 2021 with the aim of creating “an AI ecosystem of trust”.

Europe sets out plan to boost data reuse and regulate ‘high risk’ AIs

More TechCrunch

PayHOA, a previously bootstrapped Kentucky-based startup that offers software for self-managed homeowner associations (HOAs), is an example of how real-world problems can translate into opportunity. It just raised a $27.5…

Meet PayHOA, a profitable and once-bootstrapped SaaS startup that just landed a $27.5M Series A

Restaurant365, which offers a restaurant management suite, has raised a hot $175M from ICONIQ Growth, KKR and L Catterton.

Restaurant365 orders in $175M at $1B+ valuation to supersize its food service software stack 

Venture firm Shilling has launched a €50M fund to support growth-stage startups in its own portfolio and to invest in startups everywhere else. 

Portuguese VC firm Shilling launches €50M opportunity fund to back growth-stage startups

Chang She, previously the VP of engineering at Tubi and a Cloudera veteran, has years of experience building data tooling and infrastructure. But when She began working in the AI…

LanceDB, which counts Midjourney as a customer, is building databases for multimodal AI

Trawa simplifies energy purchasing and management for SMEs by leveraging an AI-powered platform and downstream data from customers. 

Berlin-based trawa raises €10M to use AI to make buying renewable energy easier for SMEs

Lydia is splitting itself into two apps — Lydia for P2P payments and Sumeria for those looking for a mobile-first bank account.

Lydia, the French payments app with 8 million users, launches mobile banking app Sumeria

Cargo ships docking at a commercial port incur costs called “disbursements” and “port call expenses.” This might be port dues, towage, and pilotage fees. It’s a complex patchwork and all…

Shipping logistics startup Harbor Lab raises $16M Series A led by Atomico

AWS has confirmed its European “sovereign cloud” will go live by the end of 2025, enabling greater data residency for the region.

AWS confirms will launch European ‘sovereign cloud’ in Germany by 2025, plans €7.8B investment over 15 years

Go Digit, an Indian insurance startup, has raised $141 million from investors including Goldman Sachs, ADIA, and Morgan Stanley as part of its IPO.

Indian insurance startup Go Digit raises $141M from anchor investors ahead of IPO

Peakbridge intends to invest in between 16 and 20 companies, investing around $10 million in each company. It has made eight investments so far.

Food VC Peakbridge has new $187M fund to transform future of food, like lab-made cocoa

For over six decades, the nonprofit has been active in the financial services sector.

Accion’s new $152.5M fund will back financial institutions serving small businesses globally

Meta’s newest social network, Threads, is starting its own fact-checking program after piggybacking on Instagram and Facebook’s network for a few months.

Threads finally starts its own fact-checking program

Looking Glass makes trippy-looking mixed-reality screens that make things look 3D without the need of special glasses. Today, it launches a pair of new displays, including a 16-inch mode that…

Looking Glass launches new 3D displays

Replacing Sutskever is Jakub Pachocki, OpenAI’s director of research.

Ilya Sutskever, OpenAI co-founder and longtime chief scientist, departs

Intuitive Machines made history when it became the first private company to land a spacecraft on the moon, so it makes sense to adapt that tech for Mars.

Intuitive Machines wants to help NASA return samples from Mars

As Google revamps itself for the AI era, offering AI overviews within its search results, the company is introducing a new way to filter for just text-based links. With the…

Google adds ‘Web’ search filter for showing old-school text links as AI rolls out

Blue Origin’s New Shepard rocket will take a crew to suborbital space for the first time in nearly two years later this month, the company announced on Tuesday.  The NS-25…

Blue Origin to resume crewed New Shepard launches on May 19

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024