Enterprise

A startup is charging $1.99 for strings of text to feed to DALL-E 2

Comment

TechCrunch image generator
Image Credits: Bryce Durbin / TechCrunch

Figuring out the right text prompts to yield the best results with AI systems like OpenAI’s DALL-E 2 has become a science in its own right. Now a startup is looking to let “prompt engineers” cash in with an online marketplace that sells these finely tuned phrases.

PromptBase, launched in June, allows users to sell strings of words that net predictable results with particular systems. Priced at $1.99 — PromptBase takes a 20% cut — the content that the prompts generate range from “viral” headlines to pictures of sports team logos, knitted dolls and animals wearing suits.

At the moment, PromptBase hosts only prompts tested on DALL-E 2 and GPT-3. But according to its founder, Ben Stokes, the plan is to expand the platform to additional systems in the future.

“Our ultimate aim is to build tools in order to help support prompt engineers. It’s early days, so we’re currently just trying to spread the word and find prompt engineers to sign up and start listing their prompts for sale on our marketplace,” Stokes told TechCrunch via email. “We’re already seeing big tech companies build their own systems similar to GPT-3 and DALL-E, and I predict many more to come. Different systems will likely be utilized like tools in a toolbelt, similar to how different programming languages are used today, and we plan to accommodate all of them as they gain popularity.”

PromptBase
Users can buy and sell prompts for AI systems on PromptBase’s marketplace. Image Credits: PromptBase

Selling prompts isn’t against any AI provider’s terms of service, but it potentially opens a can of ethical and legal worms depending on the nature of the prompts being sold. Moreover, it reveals the fragility — and unpredictability — of even the most capable AI systems available today.

Prompt engineering

Prompt engineering is a concept in AI that looks to embed the description of a task (like generating art of furry creatures) in text. The idea is to provide an AI system “guidelines” or detailed instructions so that it, drawing on its knowledge of the world, reliably accomplishes the thing being asked of it. In general, the results for a prompt like “Film still of a woman drinking coffee, walking to work, telephoto” will be much more consistent than “A woman walking.”

Prompts can be used to teach an image-generating system to distinguish between “an image containing potatoes” and “a collection of potatoes,” for example. They can also act as “filters” of sorts, creating images with the characteristics of a sketch, painting, texture, animation or even a particular illustrator (e.g., Maurice Sendak). And prompts can portray the same subject in different styles, like “a child’s drawing of a koala riding a bike” versus “an old photograph of a koala riding a bike.”

Prompts can be quite nuanced. Owing to the way AI systems make sense of patterns in images and text, not all of them have a predictable — or even sensible — structure. For example, the prompt “A very beautiful painting of a mountain next to a waterfall” returns worse results with DALL-E 2 compared to “A very very very beautiful painting of a mountain next to a waterfall.” The reason? The system attaches an inordinately high value to the word “very.”

It’s worth noting that the “very” example is specific to a particular iteration of DALL-E 2 and most likely wouldn’t work on another. But that’s a major reason prompt engineering can be valuable: discovering edge cases.

 

In a fascinating study out of the University of Texas at Austin, researchers documented an extensive vocabulary of bizarre prompts that can be used to generate images with DALL-E 2. They discovered that the system understands “Apoploe vesrreaitais” — a gibberish phrase — to mean “birds” and “Contarra ccetnxniams luryca tanniounons” to mean “bugs” or “pests” (sometimes). Giving DALL-E 2 the prompt “Apoploe vesrreaitais eating Contarra ccetnxniams luryca tanniounons” yielded pictures of birds eating bugs.

Although these nonsense words probably correspond with some internal logic in the system, that’s why some data scientists have likened prompts to “incantations” or “magic words” — and why prompt engineering has catalyzed an entire field of academic study.

Problematic prompts

A number of researchers and enthusiasts have released free resources containing prompts for popular AI systems, mostly DALL-E 2. PromptBase is one of the first to monetize the exchange — and it already has critics. There’s a long-running debate within the AI community over which research, if any at all, should or can be commercialized; one Reddit user argues that PromptBase is “starting a trend that threatens the openness and accessibility of AI in general.”

But Stokes defends the model, arguing that many of the prompts on PromptBase represent hours of genuine work and insight by engineers.

“Today we have prompts to generate basic text and images, but it’s not too hard to extrapolate years into the future where we’ll have prompts for generating videos, and maybe one day even feature-length films complete with orchestral scores,” Stokes added. “Those people who can craft the quality prompts required guide the AI to do these things will be extremely valuable. It’s unknown how big the market will be, but I can see it being a key tech skill, if not the future of programming.”

Of course, there’s little to prevent a PromptBase customer from publishing a prompt post-purchase. But that could be the least of PromptBase’s problems.

Studies show that language systems trained on vast swaths of public data, like GPT-3, can “leak” personal information, including names and addresses, when fed certain prompts. Some prompts might encourage copyright infringement, like those instructing DALL-E 2 to generate “3D models of Pokémon.” Others could be used to defeat word-level filters to get an image-generating system to output “restricted” images, researchers theorize — like images of violence (e.g., “a horse lying in a puddle of red liquid”).

Stokes said that PromptBase reviews every listing in the marketplace to ensure they don’t violate any “AI generation rules.” But if the business grows, it could become tougher to maintain that level of scrutiny.

Vagrant Gautam, a computational linguist at Saarland University in Germany, agrees that there’s a potential for misuse. However, Gautam — who goes by the pronoun xe — also notes that the prompt marketplace could present an income opportunity for artists and other folks who are creative or skilled at debugging.

“[It points] to the importance of prompt engineering, as well as the importance of the skills involved in doing this — creativity, time, adversarial thinking, etc. A lot of people who’ve been saying that DALL-E 2 is going to make it so easy for them to generate images or art of whatever they want are discovering that there’s an art to doing this and it often takes many tries,” Gautam said.

These tries can become expensive, given systems like DALL-E 2 aren’t exactly free to use. Stokes himself says he paid a “fortune” trying to figure out a prompt for GPT-3 at another of his ventures, Paper Website.

PromptBase
Image Credits: PromptBase

“People are now also complaining about its monetization because they say there’s too few opportunities to tweak your prompt before you have to start paying,” Gautam continued. “I find it very interesting — this trial-and-error, adversarial approach that people have to take to figure out exactly how to prompt generative models to do what they want.”

It’ll be a while before the dust settles in commercialized prompt engineering. But if nothing else, PromptBase will raise — and already has raised — issues around the AI systems that stand to transform countless industries.

More TechCrunch

After two years of preparation and four delays over the past several months due to technical glitches, Indian space startup Agnikul has successfully launched its first sub-orbital test vehicle, powered…

India’s Agnikul launches 3D-printed rocket in sub-orbital test after initial delays

Struggling EV startup Fisker has laid off hundreds of employees in a bid to stay alive, as it continues to search for funding, a buyout or prepare for bankruptcy. Workers…

Fisker cuts hundreds of workers in bid to keep EV startup alive

Chinese EV manufacturers face a new challenge in their pursuit of U.S. customers: a new House bill that would limit or ban the introduction of their connected vehicles. The bill,…

Chinese EV makers, and their connected vehicles, targeted by new House bill

With the release of iOS 18 later this year, Apple may again borrow ideas third-party apps. This time it’s Arc that could be among those affected.

Is Apple planning to ‘sherlock’ Arc?

TechCrunch Disrupt 2024 will be in San Francisco on October 28–30, and we’re already excited! This is the startup world’s main event, and it’s where you’ll find the knowledge, tools…

Meet Visa, Mercury, Artisan, Golub Capital and more at TC Disrupt 2024

Featured Article

The women in AI making a difference

As a part of a multi-part series, TechCrunch is highlighting women innovators — from academics to policymakers —in the field of AI.

11 hours ago
The women in AI making a difference

Cadillac may seem a bit too traditional to hang its driving cap on EVs. And yet, that hasn’t stopped the GM brand from rolling out — or at least showing…

The Cadillac Optiq EV starts at $54,000 and is designed to hook young hipsters

Ifeel is being offered as part of an employer’s or insurance provider’s healthcare coverage.

Mental health insurance platform ifeel raises a $20 million Series B

Instead of opening the user’s actual browser or a WebView, Custom Tabs let users remain in their app while browsing.

Google Chrome becomes a ‘picture-in-picture’ app

Sanil Chawla remembers the meetings he had with countless artists in college. Those creatives were looking for one thing: sustainable economic infrastructure that could help them scale rather than drown…

Slingshot raises $2.2 million to provide financial services to artists

A startup called Firefly that’s tackling the thorny and growing issue of cloud asset management with an “infrastructure as code” solution has raised $23 million in funding. That comes on…

Firefly forges on after co-founder murdered by Hamas

Mistral, the French AI startup backed by Microsoft and valued at $6 billion, has released its first generative AI model for coding, dubbed Codestral. Like other code-generating models, Codestral is…

Mistral releases Codestral, its first generative AI model for code

Pinterest announced today that it is evolving its Creator Inclusion Fund to now be called the Pinterest Inclusion Fund. Pinterest teamed up with Shopify’s Build Black and Build Native programs…

Pinterest expands its Creator Fund to allow founders

Alex Taub, a longtime founder with multiple exits under his belt, believes it’s time to disrupt the meme industry. “I have this big thesis that meme tech is going to…

This founder says meme tech is the next big thing

Lux, the startup behind popular pro photography app Halide and others, is venturing into video with its latest app launch. On Wednesday, the company announced Kino, a new video capture app…

Kino is a new iPhone app for videographers from the makers of Halide

DevOps startup Harness has shown itself to be an ambitious company, building a broad platform of services while also dabbling in M&A when it made sense to fill in functionality.…

Harness snags Split.io as it goes all in on feature flags and experiments

Microsoft’s Copilot, a generative AI-powered tool that can generate text as well as answer specific questions, is now available as an in-app chatbot on Telegram, the instant messaging app.  Currently…

Microsoft’s Copilot is now on Telegram

HBO’s new documentary, “MoviePass, MovieCrash,” tells a story that many of us know about: how MoviePass, the subscription-based movie ticketing startup, was a catastrophic failure. After a series of mishaps…

MoviePass co-founders speak their truth in HBO’s new documentary 

The watch features a variety of different 3D games, unlocking more play time the more kids move.

Fitbit’s new kid smartwatch is a little Wiimote, a little Tamagotchi

In the video, a crowd is roaring at a packed summer music festival. As a beat starts playing over the speakers, the performer finally walks onstage: It’s the Joker. Clad…

Discord has become an unlikely center for the generative AI boom

After the Wirecard scandal, Germany’s financial regulator BaFin started to look more closely at young fintech startups that wanted to grow at a rapid pace — it’s better to be…

Germany’s financial regulator ends anti-money laundering cap on N26 signups after $10M fine

Among other things, this includes the ability to trace code from source to binary packages across both platforms, single sign-on support and unified project structures.

JFrog and GitHub team up to closely integrate their source code and binary platforms

The company’s public fund disbursement and e-commerce platform makes accepting school tuition and enabling educational enrichment more accessible. 

Tech startup Odyssey goes on journey to help states implement school choice programs

A new startup called Kinnect aims to help people privately save generational memories, traditions, recipes and more. The company’s app, launched this month, lets people create invite-only spaces where they…

Kinnect’s new app aims to help families record and store generational memories

Spotify has hiked its premium subscription in France by an eye-watering €0.13, in response to a new music-streaming tax.

Spotify hikes subscription price in France by 1.2% to match new music-streaming tax

The European Union has taken the wraps off the structure of the new AI Office, the ecosystem-building and oversight body that’s being established under the bloc’s AI Act. The risk-based…

With the EU AI Act incoming this summer, the bloc lays out its plan for AI governance

Solutions by Text, a company that gives people a way to pay their bills and apply for loans via text messaging, has secured $110 million in new growth funding. Edison…

Bootstrapped for over a decade, this Dallas company just secured $110M to help people pay bills by text

Owners of small- and medium-sized businesses check their bank balances daily to make financial decisions. But it’s entrepreneur Yoseph West’s assertion that there’s typically information and functions missing from bank…

Relay raises $32.2 million to help smaller businesses manage their cash flow

When other firms were investing and raising eye-popping sums, Clean Energy Ventures took a different approach. It appears to be paying off.

How Clean Energy Ventures avoided the pandemic bubble and raised a $305M fund

PwC, the management consulting giant, will become OpenAI’s biggest customer to date, covering 100,000 users.

OpenAI signs 100K PwC workers to ChatGPT’s enterprise tier as PwC becomes its first resale partner