AI

Apple just created, and killed, a generation of AR businesses

Comment

Image Credits:

Two weeks ago, Apple introduced ARKit, its solution for placing 3D objects realistically into a ‘real’ place. Basically, augmented reality.

And it just so happens that the Holy Grail of the home decor and architecture game has been, for years, being able to place decor and furniture inside a customer’s actual space. Over the past decade, as mobile has taken off, that dream has been transferred from the desktop web browser to phones and tablets.

A couple of factors have lined up to allow this category to explode and become, I believe, one of the first big breakout uses of AR in the App Store.

  • First, these kinds of apps need a huge library of 3D models of furniture and accessories. Whole companies were born in the early days that just offered to scan and import these for big companies.
  • The tech that allowed them to accurately perform SLAM (Simultaneous Location And Mapping) calculations in real time is far from trivial. Placing objects into a world required people to build the tech from the ground up by creating models of the rooms as well as the objects themselves.

Both of these points are now moot.

I can’t tell you how many of these kinds of companies I’ve seen over the years. Some of them were not bad at all, some were terrible, all were pretty much held back by the technology it took to map a room and place objects. I’ve written extensively about how Apple’s purchases over the last few years have gotten them to a place where they’re able to pack this into a phone — you can read that here.

The best recent stab I’ve seen at this model is called Modsy. It’s a pretty impressive process that has you take a few smartphone pictures that it stitches together and dresses up on its side, delivering you a fully decorated room a couple of days later. But that’s still far from real-time. ARKit is.

Modsy

 

So now here we are, with the ability for just about anyone to spin up an AR window inside their app. I predict that we’re going to see some real crap over the next few weeks and months as people just “put an AR on it.” But aside from that, we’re going to see a plug unstoppered on industries that needed a reliable version of this kind of AR portal in order to execute on a vision.

IKEA has announced that it is going to be allowing people to see their particular brand of lasts-just-long-enough furniture set into place in their own homes. IKEA won’t be the last though, by far.

It was even pointed out to me on Twitter that Apple probably just sherlocked the Pair app (a 500 Startups alum that we covered last August, incidentally) that was part of its inaugural Planet of the Apps episode.

The years and years of attempts at this, along with the technical pipeline of the modern online retail experience, has led most big furniture and accessory (and fashion btw) distributors to have all of their products modeled. Either from the original designs (all done in 3D now anyway) or scanned afterwards. Most catalog shots and online images are snapshots of what is technically, at the least, a 360 degree model of an object.

This means that there is a big pent up demand and a reservoir of available material to populate AR worlds. Thousands, hundreds of thousands — probably millions of 3D models of real stuff.

And we’ve now removed what was the biggest technical hurdle by divorcing the “room model” from the “object model.” Apple democratized AR to the tune of hundreds of millions of available portals — but it also did it to the tune of billions of points of interest. Every physical “node” of the world is now a potential layering aspect for AR.

https://twitter.com/flyosity/status/876825594553565184

 

This is just a curiosity when it comes to individual experiences, but the potential is ridiculous when you start thinking about it in a persistent way.

So if everyone can do it then the value is diminished, right? Not really. This should just allow designers and developers to move up the stack. Now they’re no longer burdened with adapting an existing AR system to their needs or (shudder) manufacturing them from scratch. The focus can be purely on big idea thinking about how to apply AR, the experience of doing so, and how best to conjoin it with other systems like voice, mapping and photography.

Apple just built the AR industry’s shovel. Now all you have to do is decide where to dig.

The initial wave of AR stuff will be right along the lines of what I discussed above. Furniture placed in the real world to see how it looks; filter; fun tricks; games. After that, we’re going to see some really insane stuff as people see what it means to have 350 million connected AR portals that could open onto the same augmented world.

More TechCrunch

The AI industry moves faster than the rest of the technology sector, which means it outpaces the federal government by several orders of magnitude.

Senate study proposes ‘at least’ $32B yearly for AI programs

The FBI along with a coalition of international law enforcement agencies seized the notorious cybercrime forum BreachForums on Wednesday.  For years, BreachForums has been a popular English-language forum for hackers…

FBI seizes hacking forum BreachForums — again

The announcement signifies a significant shake-up in the streaming giant’s advertising approach.

Netflix to take on Google and Amazon by building its own ad server

It’s tough to say that a $100 billion business finds itself at a critical juncture, but that’s the case with Amazon Web Services, the cloud arm of Amazon, and the…

Matt Garman taking over as CEO with AWS at crossroads

Back in February, Google paused its AI-powered chatbot Gemini’s ability to generate images of people after users complained of historical inaccuracies. Told to depict “a Roman legion,” for example, Gemini would show…

Google still hasn’t fixed Gemini’s biased image generator

A feature Google demoed at its I/O confab yesterday, using its generative AI technology to scan voice calls in real time for conversational patterns associated with financial scams, has sent…

Google’s call-scanning AI could dial up censorship by default, privacy experts warn

Google’s going all in on AI — and it wants you to know it. During the company’s keynote at its I/O developer conference on Tuesday, Google mentioned “AI” more than…

The top AI announcements from Google I/O

Uber is taking a shuttle product it developed for commuters in India and Egypt and converting it for an American audience. The ride-hail and delivery giant announced Wednesday at its…

Uber has a new way to solve the concert traffic problem

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

Google is preparing to launch a new system to help address the problem of malware on Android. Its new live threat detection service leverages Google Play Protect’s on-device AI to…

Google takes aim at Android malware with an AI-powered live threat detection service

Users will be able to access the AR content by first searching for a location in Google Maps.

Google Maps is getting geospatial AR content later this year

The heat pump startup unveiled its first products and revealed details about performance, pricing and availability.

Quilt heat pump sports sleek design from veterans of Apple, Tesla and Nest

The space is available from the launcher and can be locked as a second layer of authentication.

Google’s new Private Space feature is like Incognito Mode for Android

Gemini, the company’s family of generative AI models, will enhance the smart TV operating system so it can generate descriptions for movies and TV shows.

Google TV to launch AI-generated movie descriptions

When triggered, the AI-powered feature will automatically lock the device down.

Android’s new Theft Detection Lock helps deter smartphone snatch and grabs

The company said it is increasing the on-device capability of its Google Play Protect system to detect fraudulent apps trying to breach sensitive permissions.

Google adds live threat detection and screen-sharing protection to Android

This latest release, one of many announcements from the Google I/O 2024 developer conference, focuses on improved battery life and other performance improvements, like more efficient workout tracking.

Wear OS 5 hits developer preview, offering better battery life

For years, Sammy Faycurry has been hearing from his registered dietitian (RD) mom and sister about how poorly many Americans eat and their struggles with delivering nutritional counseling. Although nearly…

Dietitian startup Fay has been booming from Ozempic patients and emerges from stealth with $25M from General Catalyst, Forerunner

Apple is bringing new accessibility features to iPads and iPhones, designed to cater to a diverse range of user needs.

Apple announces new accessibility features for iPhone and iPad users

TechCrunch Disrupt, our flagship startup event held annually in San Francisco, is back on October 28-30 — and you can expect a bustling crowd of thousands of startup enthusiasts. Exciting…

Startup Blueprint: TC Disrupt 2024 Builders Stage agenda sneak peek!

Mike Krieger, one of the co-founders of Instagram and, more recently, the co-founder of personalized news app Artifact (which TechCrunch corporate parent Yahoo recently acquired), is joining Anthropic as the…

Anthropic hires Instagram co-founder as head of product

Seven orgs so far have signed on to standardize the way data is collected and shared.

Venture orgs form alliance to standardize data collection

As cloud adoption continues to surge toward the $1 trillion mark in annual spend, we’re seeing a wave of enterprise startups gaining traction with customers and investors for tools to…

Alkira connects with $100M for a solution that connects your clouds

Charging has long been the Achilles’ heel of electric vehicles. One startup thinks it has a better way for apartment dwelling EV drivers to charge overnight.

Orange Charger thinks a $750 outlet will solve EV charging for apartment dwellers

So did investors laugh them out of the room when they explained how they wanted to replace Quickbooks? Kind of.

Embedded accounting startup Layer secures $2.3M toward goal of replacing QuickBooks

While an increasing number of companies are investing in AI, many are struggling to get AI-powered projects into production — much less delivering meaningful ROI. The challenges are many. But…

Weka raises $140M as the AI boom bolsters data platforms

PayHOA, a previously bootstrapped Kentucky-based startup that offers software for self-managed homeowner associations (HOAs), is an example of how real-world problems can translate into opportunity. It just raised a $27.5…

Meet PayHOA, a profitable and once-bootstrapped SaaS startup that just landed a $27.5M Series A

Restaurant365, which offers a restaurant management suite, has raised a hot $175M from ICONIQ Growth, KKR and L Catterton.

Restaurant365 orders in $175M at $1B+ valuation to supersize its food service software stack 

Venture firm Shilling has launched a €50M fund to support growth-stage startups in its own portfolio and to invest in startups everywhere else. 

Portuguese VC firm Shilling launches €50M opportunity fund to back growth-stage startups

Chang She, previously the VP of engineering at Tubi and a Cloudera veteran, has years of experience building data tooling and infrastructure. But when She began working in the AI…

LanceDB, which counts Midjourney as a customer, is building databases for multimodal AI