AI

Apple just created, and killed, a generation of AR businesses

Comment

Image Credits:

Two weeks ago, Apple introduced ARKit, its solution for placing 3D objects realistically into a ‘real’ place. Basically, augmented reality.

And it just so happens that the Holy Grail of the home decor and architecture game has been, for years, being able to place decor and furniture inside a customer’s actual space. Over the past decade, as mobile has taken off, that dream has been transferred from the desktop web browser to phones and tablets.

A couple of factors have lined up to allow this category to explode and become, I believe, one of the first big breakout uses of AR in the App Store.

  • First, these kinds of apps need a huge library of 3D models of furniture and accessories. Whole companies were born in the early days that just offered to scan and import these for big companies.
  • The tech that allowed them to accurately perform SLAM (Simultaneous Location And Mapping) calculations in real time is far from trivial. Placing objects into a world required people to build the tech from the ground up by creating models of the rooms as well as the objects themselves.

Both of these points are now moot.

I can’t tell you how many of these kinds of companies I’ve seen over the years. Some of them were not bad at all, some were terrible, all were pretty much held back by the technology it took to map a room and place objects. I’ve written extensively about how Apple’s purchases over the last few years have gotten them to a place where they’re able to pack this into a phone — you can read that here.

The best recent stab I’ve seen at this model is called Modsy. It’s a pretty impressive process that has you take a few smartphone pictures that it stitches together and dresses up on its side, delivering you a fully decorated room a couple of days later. But that’s still far from real-time. ARKit is.

Modsy

 

So now here we are, with the ability for just about anyone to spin up an AR window inside their app. I predict that we’re going to see some real crap over the next few weeks and months as people just “put an AR on it.” But aside from that, we’re going to see a plug unstoppered on industries that needed a reliable version of this kind of AR portal in order to execute on a vision.

IKEA has announced that it is going to be allowing people to see their particular brand of lasts-just-long-enough furniture set into place in their own homes. IKEA won’t be the last though, by far.

It was even pointed out to me on Twitter that Apple probably just sherlocked the Pair app (a 500 Startups alum that we covered last August, incidentally) that was part of its inaugural Planet of the Apps episode.

The years and years of attempts at this, along with the technical pipeline of the modern online retail experience, has led most big furniture and accessory (and fashion btw) distributors to have all of their products modeled. Either from the original designs (all done in 3D now anyway) or scanned afterwards. Most catalog shots and online images are snapshots of what is technically, at the least, a 360 degree model of an object.

This means that there is a big pent up demand and a reservoir of available material to populate AR worlds. Thousands, hundreds of thousands — probably millions of 3D models of real stuff.

And we’ve now removed what was the biggest technical hurdle by divorcing the “room model” from the “object model.” Apple democratized AR to the tune of hundreds of millions of available portals — but it also did it to the tune of billions of points of interest. Every physical “node” of the world is now a potential layering aspect for AR.

https://twitter.com/flyosity/status/876825594553565184

 

This is just a curiosity when it comes to individual experiences, but the potential is ridiculous when you start thinking about it in a persistent way.

So if everyone can do it then the value is diminished, right? Not really. This should just allow designers and developers to move up the stack. Now they’re no longer burdened with adapting an existing AR system to their needs or (shudder) manufacturing them from scratch. The focus can be purely on big idea thinking about how to apply AR, the experience of doing so, and how best to conjoin it with other systems like voice, mapping and photography.

Apple just built the AR industry’s shovel. Now all you have to do is decide where to dig.

The initial wave of AR stuff will be right along the lines of what I discussed above. Furniture placed in the real world to see how it looks; filter; fun tricks; games. After that, we’re going to see some really insane stuff as people see what it means to have 350 million connected AR portals that could open onto the same augmented world.

More TechCrunch

Venture firm Shilling has launched a €50M fund to support growth-stage startups in its own portfolio and to invest in startups everywhere else. 

Portuguese VC firm Shilling launches €50M opportunity fund to back growth-stage startups

Chang She, previously the VP of engineering at Tubi and a Cloudera veteran, has years of experience building data tooling and infrastructure. But when She began working in the AI…

LanceDB, which counts Midjourney as a customer, is building databases for multimodal AI

Trawa simplifies energy purchasing and management for SMEs by leveraging an AI-powered platform and downstream data from customers. 

Berlin-based trawa raises €10M to use AI to make buying renewable energy easier for SMEs

Lydia is splitting itself into two apps — Lydia for P2P payments and Sumeria for those looking for a mobile-first bank account.

Lydia, the French payments app with 8 million users, launches mobile banking app Sumeria

Cargo ships docking at a commercial port incur costs called “disbursements” and “port call expenses.” This might be port dues, towage, and pilotage fees. It’s a complex patchwork and all…

Shipping logistics startup Harbor Lab raises $16M Series A led by Atomico

AWS has confirmed its European “sovereign cloud” will go live by the end of 2025, enabling greater data residency for the region.

AWS confirms will launch European ‘sovereign cloud’ in Germany by 2025, plans €7.8B investment over 15 years

Go Digit, an Indian insurance startup, has raised $141 million from investors including Goldman Sachs, ADIA, and Morgan Stanley as part of its IPO.

Indian insurance startup Go Digit raises $141M from anchor investors ahead of IPO

Peakbridge intends to invest in between 16 and 20 companies, investing around $10 million in each company. It has made eight investments so far.

Food VC Peakbridge has new $187M fund to transform future of food, like lab-made cocoa

For over six decades, the nonprofit has been active in the financial services sector.

Accion’s new $152.5M fund will back financial institutions serving small businesses globally

Meta’s newest social network, Threads, is starting its own fact-checking program after piggybacking on Instagram and Facebook’s network for a few months.

Threads finally starts its own fact-checking program

Looking Glass makes trippy-looking mixed-reality screens that make things look 3D without the need of special glasses. Today, it launches a pair of new displays, including a 16-inch mode that…

Looking Glass launches new 3D displays

Replacing Sutskever is Jakub Pachocki, OpenAI’s director of research.

Ilya Sutskever, OpenAI co-founder and longtime chief scientist, departs

Intuitive Machines made history when it became the first private company to land a spacecraft on the moon, so it makes sense to adapt that tech for Mars.

Intuitive Machines wants to help NASA return samples from Mars

As Google revamps itself for the AI era, offering AI overviews within its search results, the company is introducing a new way to filter for just text-based links. With the…

Google adds ‘Web’ search filter for showing old-school text links as AI rolls out

Blue Origin’s New Shepard rocket will take a crew to suborbital space for the first time in nearly two years later this month, the company announced on Tuesday.  The NS-25…

Blue Origin to resume crewed New Shepard launches on May 19

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to Google Maps Platform