AI

Commercial image-generating AI raises all sorts of thorny legal issues

Comment

OpenAI's logo
Image Credits: OpenAI

This week, OpenAI granted users of its image-generating AI system, DALL-E 2, the right to use their generations for commercial projects, like illustrations for children’s books and art for newsletters. The move makes sense, given OpenAI’s own commercial aims — the policy change coincided with the launch of the company’s paid plans for DALL-E 2. But it raises questions about the legal implications of AI like DALL-E 2, trained on public images around the web, and their potential to infringe on existing copyrights.

DALL-E 2 “trained” on approximately 650 million image-text pairs scraped from the internet, learning from that dataset the relationships between images and the words used to describe them. But while OpenAI filtered out images for specific content (e.g. pornography and duplicates) and implemented additional filters at the API level, for example for prominent public figures, the company admits that the system can sometimes create works that include trademarked logos or characters. See:

“OpenAI will evaluate different approaches to handle potential copyright and trademark issues, which may include allowing such generations as part of ‘fair use’ or similar concepts, filtering specific types of content, and working directly with copyright [and] trademark owners on these issues,” the company wrote in an analysis published prior to DALL-E 2’s beta release on Wednesday.

It’s not just a DALL-E 2 problem. As the AI community creates open source implementations of DALL-E 2 and its predecessor, DALL-E, both free and paid services are launching atop models trained on less-carefully filtered datasets. One, Pixelz.ai, which rolled out an image-generating app this week powered by a custom DALL-E model, makes it trivially easy to create photos showing various Pokémon and Disney characters from movies like Guardians of the Galaxy and Frozen.

When contacted for comment, the Pixelz.ai team told TechCrunch that they’ve filtered the model’s training data for profanity, hate speech and “illegal activities” and block users from requesting those types of images at generation time. The company also said that it plans to add a reporting feature that will allow people to submit images that violate the terms of service to a team of human moderators. But where it concerns intellectual property (IP), Pixelz.ai leaves it to users to exercise “responsibility” in using or distributing the images they generate — grey area or no.

“We discourage copyright infringement both in the dataset and our platform’s terms of service,” the team told TechCrunch. “That being said, we provide an open text input and people will always find creative ways to abuse a platform.”

Pixelz.ai
An image of Rocket Racoon from Disney’s/Marvel’s Guardians of the Galaxy, generated by Pixelz.ai’s system. Image Credits: Pixelz.ai

Bradley J. Hulbert, a founding partner at law firm MBHB and an expert in IP law, believes that image-generating systems are problematic from a copyright perspective in several aspects. He noted that artwork that’s “demonstrably derived” from a “protected work” — i.e. a copyrighted character — has generally been found by the courts to be infringing, even if additional elements were added. (Think an image of a Disney princess walking through a gritty New York neighborhood.) In order to be shielded from copyright claims, the work must be “transformative” — in other words, changed to such a degree that the IP isn’t recognizable.

“If a Disney princess is recognizable in an image generated by DALL-E 2, we can safely assume that The Walt Disney Co. will likely assert that the DALL-E 2 image is a derivative work and an infringement of its copyrights on the Disney princess likeness,” Hulbert told TechCrunch via email. “A substantial transformation is also a factor considered when determining whether a copy constitutes ‘fair use.’ But, again, to the extent a Disney princess is recognizable in a later work, assume that Disney will assert later work is a copyright infringement.”

Of course, the battle between IP holders and alleged infringers is hardly new, and the internet has merely acted as an accelerant. In 2020, Warner Bros. Entertainment, which owns the right to film depictions of the Harry Potter universe, had certain fan art removed from social media platforms including Instagram and Etsy. A year earlier, Disney and Lucasfilm petitioned Giphy to take down GIFs of “Baby Yoda.”

But image-generating AI threatens to vastly scale the problem by lowering the barrier to entry. The plights of large corporations aren’t likely to garner sympathy (nor should they), and their efforts to enforce IP often backfire in the court of public opinion. On the other hand, AI-generated artwork that infringes on, say, an independent artist’s characters could threaten a livelihood.

The other thorny legal issue around systems like DALL-E 2 pertains to the content of their training datasets. Did companies like OpenAI violate IP law by using copyrighted images and artwork to develop their system? It’s a question that’s already been raised in the context of Copilot, the commercial code-generating tool developed jointly by OpenAI and GitHub. But unlike Copilot, which was trained on code that GitHub might have the right to use for the purpose under its terms of service (according to one legal analysis), systems like DALL-E 2 source images from countless public websites.

As Dave Gershgorn points out in a recent feature for The Verge, there isn’t a direct legal precedent in the U.S. that upholds publicly available training data as fair use.

One potentially relevant case involves a Lithuanian company called Planner 5D. In 2020, the firm sued Meta (then Facebook) for reportedly stealing thousands of files from Planner 5D’s software, which were made available through a partnership with Princeton to contestants of Meta’s 2019 Scene Understanding and Modeling challenge for computer vision researchers. Planner 5D claimed Princeton, Meta and Oculus, Meta’s VR-focused hardware and software division, could have benefited commercially from the training data that was taken from it.

The case isn’t scheduled to go to trial until March 2023. But last April, the U.S. district judge overseeing the case denied motions by then-Facebook and Princeton to dismiss Planner 5G’s allegations.

Unsurprisingly, rightsholders aren’t swayed by the fair use argument. A spokesperson for Getty Images told IEEE Spectrum in an article that there are “big questions” to be answered about “the rights to the imagery and the people, places, and objects within the imagery that [models like DALL-E 2] were trained on.” Association of Illustrators CEO Rachel Hill, who was also quoted in the piece, brought up the issue of compensation for images in training data.

Hulbert believes it’s unlikely a judge will see the copies of copyrighted works in training datasets as fair use — at least in the case of commercial systems like DALL-E 2. He doesn’t think it’s out of the question that IP holders could come after companies like OpenAI at some point and demand that they license the images used to train their systems.

https://twitter.com/dananthonykelly/status/1550277441721012224?s=21&t=rkD_pYze_IGYFB52YNB-EQ

“The copies … constitute infringement of the copyrights of the original authors. And infringers are liable to the copyright owners for damages,” he added. “[If] DALL-E (or DALL-E 2) and its partners make a copy of a protected work, and the copy was neither approved by the copyright owner nor fair use, the copying constitutes copyright infringement.”

Interestingly, the U.K. is exploring legislation that would remove the current requirement that systems trained through text and data mining, like DALL-E 2, be used strictly for non-commercial purposes. While copyright holders could still ask for payment under the proposed regime by putting their works behind a paywall, it would make the U.K.’s policy one of the most liberal in the world.

The U.S. seems unlikely to follow suit, given the lobbying power of IP holders in the U.S. The issue seems likely to play out in a future lawsuit instead. But time will tell.

More TechCrunch

Jasper Health, a cancer care platform startup, laid off a substantial part of its workforce, TechCrunch has learned.

General Catalyst-backed Jasper Health lays off staff

Live Nation says its Ticketmaster subsidiary was hacked. A hacker claims to be selling 560 million customer records.

Live Nation confirms Ticketmaster was hacked, says personal information stolen in data breach

Featured Article

Inside EV startup Fisker’s collapse: how the company crumbled under its founders’ whims

An autonomous pod. A solid-state battery-powered sports car. An electric pickup truck. A convertible grand tourer EV with up to 600 miles of range. A “fully connected mobility device” for young urban innovators to be built by Foxconn and priced under $30,000. The next Popemobile. Over the past eight years, famed vehicle designer Henrik Fisker…

11 hours ago
Inside EV startup Fisker’s collapse: how the company crumbled under its founders’ whims

Late Friday afternoon, a time window companies usually reserve for unflattering disclosures, AI startup Hugging Face said that its security team earlier this week detected “unauthorized access” to Spaces, Hugging…

Hugging Face says it detected ‘unauthorized access’ to its AI model hosting platform

Featured Article

Hacked, leaked, exposed: Why you should never use stalkerware apps

Using stalkerware is creepy, unethical, potentially illegal, and puts your data and that of your loved ones in danger.

12 hours ago
Hacked, leaked, exposed: Why you should never use stalkerware apps

The design brief was simple: each grind and dry cycle had to be completed before breakfast. Here’s how Mill made it happen.

Mill’s redesigned food waste bin really is faster and quieter than before

Google is embarrassed about its AI Overviews, too. After a deluge of dunks and memes over the past week, which cracked on the poor quality and outright misinformation that arose…

Google admits its AI Overviews need work, but we’re all helping it beta test

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. In…

Startups Weekly: Musk raises $6B for AI and the fintech dominoes are falling

The product, which ZeroMark calls a “fire control system,” has two components: a small computer that has sensors, like lidar and electro-optical, and a motorized buttstock.

a16z-backed ZeroMark wants to give soldiers guns that don’t miss against drones

The RAW Dating App aims to shake up the dating scheme by shedding the fake, TikTok-ified, heavily filtered photos and replacing them with a more genuine, unvarnished experience. The app…

Pitch Deck Teardown: RAW Dating App’s $3M angel deck

Yes, we’re calling it “ThreadsDeck” now. At least that’s the tag many are using to describe the new user interface for Instagram’s X competitor, Threads, which resembles the column-based format…

‘ThreadsDeck’ arrived just in time for the Trump verdict

Japanese crypto exchange DMM Bitcoin confirmed on Friday that it had been the victim of a hack resulting in the theft of 4,502.9 bitcoin, or about $305 million.  According to…

Hackers steal $305M from DMM Bitcoin crypto exchange

This is not a drill! Today marks the final day to secure your early-bird tickets for TechCrunch Disrupt 2024 at a significantly reduced rate. At midnight tonight, May 31, ticket…

Disrupt 2024 early-bird prices end at midnight

Instagram is testing a way for creators to experiment with reels without committing to having them displayed on their profiles, giving the social network a possible edge over TikTok and…

Instagram tests ‘trial reels’ that don’t display to a creator’s followers

U.S. federal regulators have requested more information from Zoox, Amazon’s self-driving unit, as part of an investigation into rear-end crash risks posed by unexpected braking. The National Highway Traffic Safety…

Feds tell Zoox to send more info about autonomous vehicles suddenly braking

You thought the hottest rap battle of the summer was between Kendrick Lamar and Drake. You were wrong. It’s between Canva and an enterprise CIO. At its Canva Create event…

Canva’s rap battle is part of a long legacy of Silicon Valley cringe

Voice cloning startup ElevenLabs introduced a new tool for users to generate sound effects through prompts today after announcing the project back in February.

ElevenLabs debuts AI-powered tool to generate sound effects

We caught up with Antler founder and CEO Magnus Grimeland about the startup scene in Asia, the current tech startup trends in the region and investment approaches during the rise…

VC firm Antler’s CEO says Asia presents ‘biggest opportunity’ in the world for growth

Temu is to face Europe’s strictest rules after being designated as a “very large online platform” under the Digital Services Act (DSA).

Chinese e-commerce marketplace Temu faces stricter EU rules as a ‘very large online platform’

Meta has been banned from launching features on Facebook and Instagram that would have collected data on voters in Spain using the social networks ahead of next month’s European Elections.…

Spain bans Meta from launching election features on Facebook, Instagram over privacy fears

Stripe, the world’s most valuable fintech startup, said on Friday that it will temporarily move to an invite-only model for new account sign-ups in India, calling the move “a tough…

Stripe curbs its India ambitions over regulatory situation

The 2024 election is likely to be the first in which faked audio and video of candidates is a serious factor. As campaigns warm up, voters should be aware: voice…

Voice cloning of political figures is still easy as pie

When Alex Ewing was a kid growing up in Purcell, Oklahoma, he knew how close he was to home based on which billboards he could see out the car window.…

OneScreen.ai brings startup ads to billboards and NYC’s subway

SpaceX’s massive Starship rocket could take to the skies for the fourth time on June 5, with the primary objective of evaluating the second stage’s reusable heat shield as the…

SpaceX sent Starship to orbit — the next launch will try to bring it back

Eric Lefkofsky knows the public listing rodeo well and is about to enter it for a fourth time. The serial entrepreneur, whose net worth is estimated at nearly $4 billion,…

Billionaire Groupon founder Eric Lefkofsky is back with another IPO: AI health tech Tempus

TechCrunch Disrupt showcases cutting-edge technology and innovation, and this year’s edition will not disappoint. Among thousands of insightful breakout session submissions for this year’s Audience Choice program, five breakout sessions…

You’ve spoken! Meet the Disrupt 2024 breakout session audience choice winners

Check Point is the latest security vendor to fix a vulnerability in its technology, which it sells to companies to protect their networks.

Zero-day flaw in Check Point VPNs is ‘extremely easy’ to exploit

Though Spotify never shared official numbers, it’s likely that Car Thing underperformed or was just not worth continued investment in today’s tighter economic market.

Spotify offers Car Thing refunds as it faces lawsuit over bricking the streaming device

The studies, by researchers at MIT, Ben-Gurion University, Cambridge and Northeastern, were independently conducted but complement each other well.

Misinformation works, and a handful of social ‘supersharers’ sent 80% of it in 2020

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Okay, okay…

Tesla shareholder sweepstakes and EV layoffs hit Lucid and Fisker