AI

Apple just created, and killed, a generation of AR businesses

Comment

Image Credits:

Two weeks ago, Apple introduced ARKit, its solution for placing 3D objects realistically into a ‘real’ place. Basically, augmented reality.

And it just so happens that the Holy Grail of the home decor and architecture game has been, for years, being able to place decor and furniture inside a customer’s actual space. Over the past decade, as mobile has taken off, that dream has been transferred from the desktop web browser to phones and tablets.

A couple of factors have lined up to allow this category to explode and become, I believe, one of the first big breakout uses of AR in the App Store.

  • First, these kinds of apps need a huge library of 3D models of furniture and accessories. Whole companies were born in the early days that just offered to scan and import these for big companies.
  • The tech that allowed them to accurately perform SLAM (Simultaneous Location And Mapping) calculations in real time is far from trivial. Placing objects into a world required people to build the tech from the ground up by creating models of the rooms as well as the objects themselves.

Both of these points are now moot.

I can’t tell you how many of these kinds of companies I’ve seen over the years. Some of them were not bad at all, some were terrible, all were pretty much held back by the technology it took to map a room and place objects. I’ve written extensively about how Apple’s purchases over the last few years have gotten them to a place where they’re able to pack this into a phone — you can read that here.

The best recent stab I’ve seen at this model is called Modsy. It’s a pretty impressive process that has you take a few smartphone pictures that it stitches together and dresses up on its side, delivering you a fully decorated room a couple of days later. But that’s still far from real-time. ARKit is.

Modsy

 

So now here we are, with the ability for just about anyone to spin up an AR window inside their app. I predict that we’re going to see some real crap over the next few weeks and months as people just “put an AR on it.” But aside from that, we’re going to see a plug unstoppered on industries that needed a reliable version of this kind of AR portal in order to execute on a vision.

IKEA has announced that it is going to be allowing people to see their particular brand of lasts-just-long-enough furniture set into place in their own homes. IKEA won’t be the last though, by far.

It was even pointed out to me on Twitter that Apple probably just sherlocked the Pair app (a 500 Startups alum that we covered last August, incidentally) that was part of its inaugural Planet of the Apps episode.

The years and years of attempts at this, along with the technical pipeline of the modern online retail experience, has led most big furniture and accessory (and fashion btw) distributors to have all of their products modeled. Either from the original designs (all done in 3D now anyway) or scanned afterwards. Most catalog shots and online images are snapshots of what is technically, at the least, a 360 degree model of an object.

This means that there is a big pent up demand and a reservoir of available material to populate AR worlds. Thousands, hundreds of thousands — probably millions of 3D models of real stuff.

And we’ve now removed what was the biggest technical hurdle by divorcing the “room model” from the “object model.” Apple democratized AR to the tune of hundreds of millions of available portals — but it also did it to the tune of billions of points of interest. Every physical “node” of the world is now a potential layering aspect for AR.

https://twitter.com/flyosity/status/876825594553565184

 

This is just a curiosity when it comes to individual experiences, but the potential is ridiculous when you start thinking about it in a persistent way.

So if everyone can do it then the value is diminished, right? Not really. This should just allow designers and developers to move up the stack. Now they’re no longer burdened with adapting an existing AR system to their needs or (shudder) manufacturing them from scratch. The focus can be purely on big idea thinking about how to apply AR, the experience of doing so, and how best to conjoin it with other systems like voice, mapping and photography.

Apple just built the AR industry’s shovel. Now all you have to do is decide where to dig.

The initial wave of AR stuff will be right along the lines of what I discussed above. Furniture placed in the real world to see how it looks; filter; fun tricks; games. After that, we’re going to see some really insane stuff as people see what it means to have 350 million connected AR portals that could open onto the same augmented world.

More TechCrunch

The spam reached Bluesky by first crossing over two other decentralized networks: Mastodon and Nostr.

The ‘vote Trump’ spam that hit Bluesky in May came from decentralized rival Nostr

Welcome to TechCrunch Fintech! This week, we’re looking at the continued fallout from Synapse’s bankruptcy, how Layer wants to disrupt SMB accounting, and much more! To get a roundup of…

There’s a real appetite for a fintech alternative to QuickBooks

The company is hoping to produce electricity at $13 per megawatt hour, which would be more than 50% cheaper than traditional onshore wind.

Bill Gates-backed wind startup AirLoom is raising $12M, filings reveal

Generative AI makes stuff up. It can be biased. Sometimes it spits out toxic text. So can it be “safe”? Rick Caccia, the CEO of WitnessAI, believes it can. “Securing…

WitnessAI is building guardrails for generative AI models

It’s not often that you hear about a seed round above $10 million. H, a startup based in Paris and previously known as Holistic AI, has announced a $220 million…

French AI startup H raises $220M seed round

Hey there, Series A to B startups with $35 million or less in funding — we’ve got an exciting opportunity that’s tailor-made for your growth journey! If you’re looking to…

Boost your startup’s growth with a ScaleUp package at TC Disrupt 2024

TikTok is pulling out all the stops to prevent its impending ban in the United States. Aside from initiating legal challenges against the government, that means shaping up its public…

As a U.S. ban looms, TikTok announces a $1M program for socially driven creators

Microsoft wants to put its Copilot everywhere. It’s only a matter of time before Microsoft renames its annual Build developer conference to Microsoft Copilot. Hopefully, some of those upcoming events…

Microsoft’s Power Automate no-code platform adds AI flows

Build is Microsoft’s largest developer conference and of course, it’s all about AI this year. So it’s no surprise that GitHub’s Copilot, GitHub’s “AI pair programming tool,” is taking center…

GitHub Copilot gets extensions

Microsoft wants to make its brand of generative AI more useful for teams — specifically teams across corporations and large enterprise organizations. This morning at its annual Build dev conference,…

Microsoft intros a Copilot for teams

Microsoft’s big focus at this year’s Build conference is generative AI. And to that end, the tech giant announced a series of updates to its platforms for building generative AI-powered…

Microsoft upgrades its AI app-building platforms

The U.K.’s data protection watchdog has closed an almost year-long investigation of Snap’s AI chatbot, My AI — saying it’s satisfied the social media firm has addressed concerns about risks…

UK data protection watchdog ends privacy probe of Snap’s GenAI chatbot, but warns industry

U.S. cell carrier Patriot Mobile experienced a data breach that included subscribers’ personal information, including full names, email addresses, home ZIP codes and account PINs, TechCrunch has learned. Patriot Mobile,…

Conservative cell carrier Patriot Mobile hit by data breach

It’s been three years since Spotify acquired live audio startup Betty Labs, and yet the music streaming service isn’t leveraging the technology to its fullest potential — at least not…

Spotify’s ‘Listening Party’ feature falls short of expectations

Alchemist Accelerator has a new pile of AI-forward companies demoing their wares today, if you care to watch, and the program itself is making some international moves into Tokyo and…

Alchemist’s latest batch puts AI to work as accelerator expands to Tokyo, Doha

“Late Pledge” allows campaign creators to continue collecting money even after the campaign has closed.

Kickstarter now lets you pledge after a campaign closes

Stack AI’s co-founders, Antoni Rosinol and Bernardo Aceituno, were PhD students at MIT wrapping up their degrees in 2022 just as large language models were becoming more mainstream. ChatGPT would…

Stack AI wants to make it easier to build AI-fueled workflows

Pinecone, the vector database startup founded by Edo Liberty, the former head of Amazon’s AI Labs, has long been at the forefront of helping businesses augment large language models (LLMs)…

Pinecone launches its serverless vector database out of preview

Young geothermal energy wells can be like budding prodigies, each brimming with potential to outshine their peers. But like people, most decline with age. In California, for example, the amount…

Special mud helps XGS Energy get more power out of geothermal wells

Featured Article

Sonos finally made some headphones

The market play is clear from the outset: The $449 headphones are firmly targeted at an audience that would otherwise be purchasing the Bose QC Ultra or Apple AirPods Max.

5 hours ago
Sonos finally made some headphones

Adobe says the feature is up to the task, regardless of how complex of a background the object is set against.

Adobe brings Firefly AI-powered Generative Remove to Lightroom

All cars suffer when the mercury drops, but electric vehicles suffer more than most as heaters draw more power and batteries charge more slowly as the liquid electrolyte inside thickens.…

Porsche Ventures invests in battery startup South 8 to boost cold-weather EV performance

Scale AI has raised a $1 billion Series F round from a slew of big-name institutional and corporate investors including Amazon and Meta.

Data-labeling startup Scale AI raises $1B as valuation doubles to $13.8B

The new coalition, Tech Against Scams, will work together to find ways to fight back against the tools used by scammers and to better educate the public against financial scams.

Meta, Match, Coinbase and others team up to fight online fraud and crypto scams

It’s a wrap: European Union lawmakers have given the final approval to set up the bloc’s flagship, risk-based regulations for artificial intelligence.

EU Council gives final nod to set up risk-based regulations for AI

London-based fintech Vitesse has closed a $93 million Series C round of funding led by investment giant KKR.

Vitesse, a payments and treasury management platform for insurers, raises $93M to fuel US expansion

Zen Educate, an online marketplace that connects schools with teachers, has raised $37 million in a Series B round of funding. The raise comes amid a growing teacher shortage crisis…

Zen Educate raises $37M and acquires Aquinas Education as it tries to address the teacher shortage

“When I heard the released demo, I was shocked, angered and in disbelief that Mr. Altman would pursue a voice that sounded so eerily similar to mine.”

Scarlett Johansson says that OpenAI approached her to use her voice

A new self-driving truck — manufactured by Volvo and loaded with autonomous vehicle tech developed by Aurora Innovation — could be on public highways as early as this summer.  The…

Aurora and Volvo unveil self-driving truck designed for a driverless future

The European venture capital firm raised its fourth fund as fund as climate tech “comes of age.”

ETF Partners raises €285M for climate startups that will be effective quickly — not 20 years down the road