AI

Snap’s new AR tools turn photos into 3D assets, let retailers use Snap’s AR tech in their own apps

Comment

Image Credits: Snap

At Snap’s Partner Summit on Thursday, the Snapchat maker announced a number of new initiatives focused on using its AR technology to aid with online shopping. Most notably, the company is introducing a new in-app destination within Snapchat called “Dress Up” that will feature AR fashion and virtual try-on experiences, and it’s launching tools that will allow retailers to integrate with Snapchat’s AR shopping technology within their own websites and apps, among other updates designed to ease the process of AR asset creation.

The company has been making strides with AR-powered e-commerce over the past year, having given its computer vision-based “Scan” feature a more prominent placement inside the Camera section of the app and upgrading it with commerce capabilities. Earlier in 2022, Snap also rolled out support for real-time pricing and product details to enhance its AR shopping listings.

These improvements have yielded increased consumer engagement with AR commerce, Snap says. Since January 2021, more than 250 million Snapchat users have engaged with AR shopping Lenses more than 5 billion times, the company notes.

Today, Snap announced it will put AR technology more directly into retailers’ own hands by allowing them to use Snap’s AR try-on technology within their own mobile apps and websites, with Camera Kit for AR Shopping.

This AR SDK (software development kit) will bring catalog-powered shopping lenses into the retailer’s own product pages to allow their customers to virtually try on their clothing, accessories, shoes and more. At launch, the feature works on iOS and Android apps, but Snap says it will work “soon” on websites, as well.

Its first global partner to use the technology is Puma, which will allow shoppers to virtually try on its sneakers using the Camera Kit integration. Shoppers would simply point their phone at their feet to see the sneakers they’re considering appear in an AR view.

Retailers will also gain access to a new AR Image Processing technology in Snap’s 3D asset manager, which Snap says will make it easier and faster to build augmented reality shopping experiences. Through a web interface, brands will be able to select their product SKUs and then turn them into Shopping Lenses, allowing them to create new Lenses in seconds, and for no additional cost, Snap claims.

To do so, partners will upload their existing product photography for the SKUs they sell, which Snap’s tech will then process using a deep-learning module that turns them into AR Image assets. This process uses AI to segment the garment from the brand’s model photography, essentially turning standard photos into AR assets.

These assets can then be used to create new try-on Lenses which can be used by shoppers at home who take a full-body selfie photo.

Virtual try-on using full-body images. Image Credits: Snap

The company is also adding new AR Shopping templates in its Lens Web Builder to turn those assets into Lense more quickly, without the need to understand AR development. Select partners in apparel, eyewear and footwear can try this out in beta today, and Snap will later expand the feature to include furniture and handbags.

Related to this, Snap is giving AR shopping a bigger spot within its own app for consumers.

Snapchat will introduce a new in-app destination called “Dress Up,” where users can browse and discover new try-on experiences from creators, retailers and fashion brands in one place. “Dress Up” will be first available in Lens Explorer, but will soon be added one tap away from the Camera in the AR Bar.

Snap’s Dress Up feature. Image Credits: Snap

Users will be able to return to outfits and other products they liked by navigating to a new shopping section from within their Profile, where they can view the items they’ve favorited, recently viewed and added to a cart.

As another example, Snap says that Zenni Optical’s AR Lenses have been tried on over 60 million times by users, and Lenses that used Snap’s “true size” technology were shown to have driven a 42% higher return on ad spend compared to Lenses without the feature.

Finally, in the realm of virtual fashion, Snap’s Bitmoji is getting an update, too. There are now over 1 billion of these mini avatars created to date, which people like to dress up in virtual fashion items. Snap says fashion brand partners will now be able to drop “Limited Edition” fashion items for Bitmoji exclusively for Snapchat users.

More TechCrunch

Call Arc can help answer immediate and small questions, according to the company. 

Arc Search’s new Call Arc feature lets you ask questions by ‘making a phone call’

After multiple delays, Apple and the Paris area transportation authority rolled out support for Paris transit passes in Apple Wallet. It means that people can now use their iPhone or…

Paris transit passes now available in iPhone’s Wallet app

Redwood Materials, the battery recycling startup founded by former Tesla co-founder JB Straubel, will be recycling production scrap for batteries going into General Motors electric vehicles.  The company announced Thursday…

Redwood Materials is partnering with Ultium Cells to recycle GM’s EV battery scrap

A new startup called Auggie is aiming to give parents a single platform where they can shop for products and connect with each other. The company’s new app, which launched…

Auggie’s new app helps parents find community and shop

Andrej Safundzic, Alan Flores Lopez and Leo Mehr met in a class at Stanford focusing on ethics, public policy and technological change. Safundzic — speaking to TechCrunch — says that…

Lumos helps companies manage their employees’ identities — and access

Remark trains AI models on human product experts to create personas that can answer questions with the same style of their human counterparts.

Remark puts thousands of human product experts into AI form

ZeroPoint claims to have solved compression problems with hyper-fast, low-level memory compression that requires no real changes to the rest of the computing system.

ZeroPoint’s nanosecond-scale memory compression could tame power-hungry AI infrastructure

In 2021, Roi Ravhon, Asaf Liveanu and Yizhar Gilboa came together to found Finout, an enterprise-focused toolset to help manage and optimize cloud costs. (We covered the company’s launch out…

Finout lands cash to grow its cloud spend management platform

On the heels of raising $102 million earlier this year, Bugcrowd is making good on its promise to use some of that funding to make acquisitions to strengthen its security…

Bugcrowd, the crowdsourced white-hat hacker platform, acquires Informer to ramp up its security chops

Google is preparing to build what will be the first subsea fibre optic cable connecting the continents of Africa and Australia. The news comes as the major cloud hyperscalers battle…

Google to build first subsea fibre optic cable connecting Africa with Australia

The Kia EV3 — the new all-electric compact SUV revealed Thursday — illustrates a growing appetite among global automakers to bring generative AI into their vehicles.  The automaker said the…

The new Kia EV3 will have an AI assistant with ChatGPT DNA

Bing, Microsoft’s search engine, isn’t working properly right now. At first, we noticed it wasn’t possible to perform a web search at all. Now it seems search results are loading…

Bing’s API is down, taking Microsoft Copilot, DuckDuckGo and ChatGPT’s web search feature down too

If you thought autonomous driving was just for cars, think again. The so-called ‘autonomous navigation’ market — where ships steer themselves guided by AI, resulting in fuel and time savings…

Autonomous shipping startup Orca AI tops up with $23M led by OCV Partners and MizMaa Ventures

The best known mycoprotein is probably Quorn, a meat substitute that’s fast approaching its 40th birthday. But Finnish biotech startup Enifer is cooking up something even older: Its proprietary single-cell…

Meet the Finnish biotech startup bringing a long lost mycoprotein to your plate

Silo, a Bay Area food supply chain startup, has hit a rough patch. TechCrunch has learned that the company on Tuesday laid off roughly 30% of its staff, or north…

Food supply chain software maker Silo lays off ~30% of staff amid M&A discussions

Featured Article

Meta’s new AI council is composed entirely of white men

Meanwhile, women and people of color are disproportionately impacted by irresponsible AI.

17 hours ago
Meta’s new AI council is composed entirely of white men

If you’ve ever wanted to apply to Y Combinator, here’s some inside scoop on how the iconic accelerator goes about choosing companies.

Garry Tan has revealed his ‘secret sauce’ for getting into Y Combinator

Indian ride-hailing startup BluSmart has started operating in Dubai, TechCrunch has exclusively learned and confirmed with its executive. The move to Dubai, which has been rumored for months, could help…

India’s BluSmart is testing its ride-hailing service in Dubai

Under the envisioned framework, both candidate and issue ads would be required to include an on-air and filed disclosure that AI-generated content was used.

FCC proposes all AI-generated content in political ads must be disclosed

Want to make a founder’s day, week, month, and possibly career? Refer them to Startup Battlefield 200 at Disrupt 2024! Applications close June 10 at 11:59 p.m. PT. TechCrunch’s Startup…

Refer a founder to Startup Battlefield 200 at Disrupt 2024

Social networking startup and X competitor Bluesky is officially launching DMs (direct messages), the company announced on Wednesday. Later, Bluesky plans to “fully support end-to-end encrypted messaging down the line,”…

Bluesky now has DMs

The perception in Silicon Valley is that every investor would love to be in business with Peter Thiel. But the venture capital fundraising environment has become so difficult that even…

Peter Thiel-founded Valar Ventures raised a $300 million fund, half the size of its last one

Featured Article

Spyware found on US hotel check-in computers

Several hotel check-in computers are running a remote access app, which is leaking screenshots of guest information to the internet.

20 hours ago
Spyware found on US hotel check-in computers

Gavet has had a rocky tenure at Techstars and her leadership was the subject of much controversy.

Techstars CEO Maëlle Gavet is out

The struggle isn’t universal, however.

Connected fitness is adrift post-pandemic

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

22 hours ago
A comprehensive list of 2024 tech layoffs

HoundDog actually looks at the code a developer is writing, using both traditional pattern matching and large language models to find potential issues.

HoundDog.ai helps developers prevent personal information from leaking

The changes are designed to enhance the consumer experience of using Google Pay and make it a more competitive option against other payment methods.

Google Pay will now display card perks, BNPL options and more

Few figures in the tech industry have earned the storied reputation of Vinod Khosla, founder and partner at Khosla Ventures. For over 40 years, he has been at the center…

Vinod Khosla is coming to Disrupt to discuss how AI might change the future