Featured Article

With Brain.ai, generative AI is the OS

At MWC this week, the company demoed a device that provides a compelling future for flagging smartphones

Comment

Brain.ai on a smartphone
Image Credits: Brian Heater

The Humane Ai Pin and Rabbit handheld have captured a good bit of press interest for their individual approaches to integrating generative AI with hardware. Humane, in particular, is presenting its wearable as a look at life beyond the smartphone. That naturally prompts the question: What, precisely, is wrong with the smartphone? While it’s true that the form factor has plateaued, these devices are still out in the world, in billions of hands.

Earlier this week, I met with Jerry Yue amid the cacophonous din of Deutsch Telekom’s Mobile World Congress booth. After a product demo and a sit-down conversation, I admit that I’m impressed with the Brain.ai (alternately known as Brain Technologies) founder and CEO’s vision for the future of smartphones. I won’t go so far as saying I’m fully convinced until I’ve had an opportunity to spend more time with the product, but it absolutely paints a compelling picture of how generative AI might be foundational to the next generation of devices.

The whole “future of smartphones” bit may be hyperbolic, but at the very least, I suspect some of the biggest names in the biz are currently studying the way first-party generative AI effectively forms the backbone of the product’s operating system. But while phone companies may see the future, the interface may prove foggier for consumers. The implementation turns the current smartphone operating system paradigm on its head, requiring a demo to fully comprehend how it’s different and why it’s useful. While I admit I wasn’t completely sold by the pitch, watching it in action brings its efficacy into sharp focus.

The OS isn’t wholly disconnected from Google’s open operating system, but only in the sense that it’s built atop the Android kernel. As we’ve seen from the Trump-era development of Huawei’s HarmonyOS, it’s entirely possible to create something distinct from Android using that as a base. Here, generative AI is more than just integrated into the system, it’s the foundation to the way you interact with the device, how it responds and the interface it constructs.

The notion of an “AI phone” isn’t an altogether new one. In fact, it’s a phrase you’re going to hear a lot in the coming years. I guarantee you’ll be sick of it by December. Elements of AI/ML have been integrated into devices in some form for several years now. Among other things, the technology is foundational to computational photography — that is the processing of the data collected by the camera sensor that occurs on the chip.

Earlier this month, however, Samsung became one of the first large companies to really lean into the notion of an “AI phone.” The distinction here is the arrival of generative AI — the technology behind programs like Google Gemini and ChatGPT. Once again, much of the integration happens on the imaging side, but it’s beginning to filter into other aspects, as well.

Image Credits: Brian Heater

Given how big an investment Google has made in Gemini, it stands to reason that this trend will only ramp up in the coming years. Apple, too, will be entering the category at some time later this year. I wouldn’t classify generative AI as a complete gamechanger on these devices just yet, but it’s clear that those companies that don’t embrace it now are going to get left behind in the coming years.

Brain.ai’s use of the technology goes much deeper than other current implementations. From a hardware perspective, however, it’s a standard smartphone. In fact, the Deutsch Telecom deal that found Yue exhibiting in the magenta-laden booth means the operating system will initially see the light of day via the device known as the T-Mobile REVVL here in the States (known as the “T Phone” in international markets like the EU). The precise model, release date and nature of the deal will be revealed “soon,” according to Yue.

The truth, however, is that the Brain interface is designed to be hardware-agnostic, adapting to the form factor it’s been run on. That’s not to say that hardware isn’t important, of course. At its heart, the T-Mobile REVVL Plus, for example, is a budget phone, priced at around $200. It’s not a flagship by any stretch, but it gives you decent bang for your buck, including a Snapdragon 625 processor and dual rear camera at 13- and 15-megapixels, respectively. Although 2GB isn’t much RAM, Yue insists that the Brain.ai’s operating system can do more with less. Also, again, we don’t know what specific specs the device will have at launch.

The interface begins with a static screen. From there, you query things off with either a voice or text prompt. In one example, Yue asks the system to “recommend a gift for my grandma, who can’t get out of bed.” From there, Brain goes to work pulling up not the response to the query, but an interface specific to it — in this case, it’s aggregated e-commerce results. The resulting page is barebones from a design perspective — black text on a white background. Sentences alternate with boxes showcasing results (in this case, blankets and Kindles).

The query sits at the top. This, like much of the interface, is interactive. In this case, you can tap in to modify the search. Tapping on an image, meanwhile, will add it to a shopping cart for the third-party e-commerce site, and you can check out from there. I should note that all of the results in the demo were pulled directly from Amazon. Yue says the system will pull in some 7,000 retail sites at launch, and you can prioritize results by things like retailers and business size (if you’d prefer to support smaller businesses).

Image Credits: Brian Heater

Shopping is the first example Yue shows me, and many of the fundamentals apply across the board. Certainly there’s consistency in design across features. That’s due in large part to the fact that the device is actually devoid of third-party apps. This represents a massive shift from the current smartphone landscape for the past 15-plus years.

“From a privacy and security perspective, we want to give a new level of control that people don’t have right now,” Yue. “The computer’s understanding of you, now it’s aggregated into different apps. These AI models are black boxes — recommendation machines that exploit our attention. We believe in explainable AI. We will be explaining to you, each step of the way, why we are making a recommendation. You have more people owning the AI and not big tech black boxes.”

Adaptability is another big selling point. The model improves recommendations and gets more customized for the user the more queries are run and tweaked. Of course, third parties were the primary reason app stores revolutionized the industry. Suddenly you’ve gone from a single company creating all of your phone’s experiences to a system that harnesses the smarts and creativity of countless developers. Brain’s experience will be a combination of what its 100-person team can produce and what the AI model can dream up. As the model improves, so, too, will its functionality. Brain.ai is relying on its own model for the primary interface, but will pull from third parties like OpenAI and Google when it determines they’re better equipped to answer a specific query.

Image Credits: Brian Heater

There are limitations to what one can discover in a demo like this, so, as with many other elements, I’m going to have to wait until I have a shipping product in my hand to really evaluate the experience. I’m especially interested in how it handles certain applications, like imaging. It’s worth noting that the REVVL line doesn’t sport great cameras, so unless there’s a big upgrade, this won’t be the device for those who prioritize photos/videos.

The camera will also play an important role in search. One example we discussed is taking a photo of a menu in a foreign country. Not only will it translate (à la Google Lens), it will also offer food recommendations based on your tastes. Yue also briefly demonstrated the system’s image generation with a simple request befitting our surroundings: make magenta sneakers. It did so quickly, with the only real bottleneck being convention center connection speeds (ironic, given the settings).

Connectivity is vitally import here. The AI processing is being done off-device. I discussed the potential for adding some on-device processing, but Yue couldn’t confirm what it might look like at launch. Nor did I get an entirely clear answer for the offline experience. I suspect a big part of the reason Deutsch Telekom is so interested in the product is that it’s one that couldn’t exist in the same way without 5G. It recalls Mozilla’s ill-fated Firefox OS and the earliest days of Chrome OS, or any other number of examples of a product that loses significant functionality when offline.

Image Credits: Brian Heater

Yue founded Brain in 2015, and remained its sole employee until hiring a CTO the following year (Yue remains the sole founder). Born in China, he first connected to technology through a love of robotics and participation in the RoboCup robotic soccer tournament. At 18, he founded the Chinese social app, Friendoc. Two years later, he co-founded Benlai.com, which is now one of the country’s largest food delivery apps. Yue has since returned to the Bay Area to run Brain.ai full time. To date, the company has raised $80 million.

After nearly a decade, the Brain interface is almost ready to launch — and it arrives at the perfect moment. The zeitgeist is very much focused on the manner of generative AI that powers the experience, from standalone devices like Rabbit and the Humane Ai Pin to tech giants like Samsung pitching their own “AI phones.”

Read more about MWC 2024 on TechCrunch

More TechCrunch

AI-powered tools like OpenAI’s Whisper have enabled many apps to make transcription an integral part of their feature set for personal note-taking, and the space has quickly flourished as a…

Buymeacoffee’s founder has built an AI-powered voice note app

Airtel, India’s second-largest telco, is partnering with Google Cloud to develop and deliver cloud and GenAI solutions to Indian businesses.

Google partners with Airtel to offer cloud and genAI products to Indian businesses

To give AI-focused women academics and others their well-deserved — and overdue — time in the spotlight, TechCrunch has been publishing a series of interviews focused on remarkable women who’ve contributed to…

Women in AI: Rep. Dar’shun Kendrick wants to pass more AI legislation

We took the pulse of emerging fund managers about what it’s been like for them during these post-ZERP, venture-capital-winter years.

A reckoning is coming for emerging venture funds, and that, VCs say, is a good thing

It’s been a busy weekend for union organizing efforts at U.S. Apple stores, with the union at one store voting to authorize a strike, while workers at another store voted…

Workers at a Maryland Apple store authorize strike

Alora Baby is not just aiming to manufacture baby cribs in an environmentally friendly way but is attempting to overhaul the whole lifecycle of a product

Alora Baby aims to push baby gear away from the ‘landfill economy’

Bumble founder and executive chair Whitney Wolfe Herd raised eyebrows this week with her comments about how AI might change the dating experience. During an onstage interview, Bloomberg’s Emily Chang…

Go on, let bots date other bots

Welcome to Week in Review: TechCrunch’s newsletter recapping the week’s biggest news. This week Apple unveiled new iPad models at its Let Loose event, including a new 13-inch display for…

Why Apple’s ‘Crush’ ad is so misguided

The U.K. Safety Institute, the U.K.’s recently established AI safety body, has released a toolset designed to “strengthen AI safety” by making it easier for industry, research organizations and academia…

U.K. agency releases tools to test AI model safety

AI startup Runway’s second annual AI Film Festival showcased movies that incorporated AI tech in some fashion, from backgrounds to animations.

At the AI Film Festival, humanity triumphed over tech

Rachel Coldicutt is the founder of Careful Industries, which researches the social impact technology has on society.

Women in AI: Rachel Coldicutt researches how technology impacts society

SAP Chief Sustainability Officer Sophia Mendelsohn wants to incentivize companies to be green because it’s profitable, not just because it’s right.

SAP’s chief sustainability officer isn’t interested in getting your company to do the right thing

Here’s what one insider said happened in the days leading up to the layoffs.

Tesla’s profitable Supercharger network is in limbo after Musk axed the entire team

StrictlyVC events deliver exclusive insider content from the Silicon Valley & Global VC scene while creating meaningful connections over cocktails and canapés with leading investors, entrepreneurs and executives. And TechCrunch…

Meesho, a leading e-commerce startup in India, has secured $275 million in a new funding round.

Meesho, an Indian social commerce platform with 150M transacting users, raises $275M

Some Indian government websites have allowed scammers to plant advertisements capable of redirecting visitors to online betting platforms. TechCrunch discovered around four dozen “gov.in” website links associated with Indian states,…

Scammers found planting online betting ads on Indian government websites

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: What we know so far

The deck included some redacted numbers, but there was still enough data to get a good picture.

Pitch Deck Teardown: Cloudsmith’s $15M Series A deck

Unlike ChatGPT, Claude did not become a new App Store hit.

Anthropic’s Claude sees tepid reception on iOS compared with ChatGPT’s debut

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Look,…

Startups Weekly: Trouble in EV land and Peloton is circling the drain

Scarcely five months after its founding, hard tech startup Layup Parts has landed a $9 million round of financing led by Founders Fund to transform composites manufacturing. Lux Capital and Haystack…

Founders Fund leads financing of composites startup Layup Parts

AI startup Anthropic is changing its policies to allow minors to use its generative AI systems — in certain circumstances, at least.  Announced in a post on the company’s official…

Anthropic now lets kids use its AI tech — within limits

Zeekr’s market hype is noteworthy and may indicate that investors see value in the high-quality, low-price offerings of Chinese automakers.

The buzziest EV IPO of the year is a Chinese automaker

Venture capital has been hit hard by souring macroeconomic conditions over the past few years and it’s not yet clear how the market downturn affected VC fund performance. But recent…

VC fund performance is down sharply — but it may have already hit its lowest point

The person who claims to have 49 million Dell customer records told TechCrunch that he brute-forced an online company portal and scraped customer data, including physical addresses, directly from Dell’s…

Threat actor says he scraped 49M Dell customer addresses before the company found out

The social network has announced an updated version of its app that lets you offer feedback about its algorithmic feed so you can better customize it.

Bluesky now lets you personalize main Discover feed using new controls

Microsoft will launch its own mobile game store in July, the company announced at the Bloomberg Technology Summit on Thursday. Xbox president Sarah Bond shared that the company plans to…

Microsoft is launching its mobile game store in July

Smart ring maker Oura is launching two new features focused on heart health, the company announced on Friday. The first claims to help users get an idea of their cardiovascular…

Oura launches two new heart health features

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI considers allowing AI porn