Fb Messenger’s Facial Recognition “Photo Magic” Reminds You To Send Friends Photos Of Them

Comment

Image Credits:

We are busy and lazy, so we forget to send friends the photos we take of them. But Facebook Messenger‘s newest feature Photo Magic scans your newly taken photos with facial recognition, and immediately notifies you with an option to send pics to friends that are in them. The test is rolling out in Australia today on Android and later this week on iOS, before reaching other countries if people enjoy it. Chief Messenger David Marcus says it will be available in the US soon.

03. NUX Suggestion“What we’ve seen is that private sending of photos in Messenger is really popular. About 9.5 billion photos were sent inside Messenger in the last month” Director Of Product Management Peter Martinazzi tells me. “It’s growing even faster than Messenger over all, which is growing really fast.” It’s an especially important use case for Messenger because it directly competes with one of Facebook’s few true rivals in social: Snapchat.

So Facebook used the same facial recognition technology that powers its photo tag suggestions and standalone Moments app to stoke this trend with Photo Magic. If you don’t want to be recognized, you can opt out with the same privacy control to turn off tag suggestions.

But if the tests rolls out more widely and people leave it on, the feature could kick off conversations with a photo. This gives people a rich way to connect while drawing them into Messenger and away from SMS or other chat apps. That in turn drives lock-in for Facebook’s ecosystem, boosting the likelihood that people use its main app where they’ll see News Feed ads.

Selfies, What’s Up, And Friends

Facebook researched the most common types of photos people were sending through Messenger, and they broke down into three main categories:

  • Selfies – where people give their current status or emotional reaction to a message by sending a photo of themselves
  • What’s Up – in which users snap a quick pic of what’s going on around them, giving someone a window into their world
  • Friends – where people take a photo of their friends and then share it to those people so they have it too

But it’s that last category that involves Facebook’s arch-nemesis: friction. Because we’re with friends, we’re often distracted and want to keep living the moment. We put off going through the hassle of opening the camera roll, selecting the photo, passing it over to a messaging app, manually selecting the people in the pic as recipients, and sending it.

Martinazzi gripes that this flow meant “I have to pause whatever i’m doing.” Product manager Lexy Franklin says the team asked “How can we make this faster and simpler? What’s magical is what it’s like in the real world.”

Making Friction Disappear

When users first see the funny little Photo Magic elves introducing the new feature and turn it on, Facebook gives them a wet onboarding experience to show them how it works.

Facebook Photo Magic

Facebook will scan back in their camera roll until it finds a photo that includes their friends, and suggest they send it to those people. A preview window with the photo, the recipients, and an option to include an accompanying message appears with buttons to send or cancel. If sent, Photo Magic sends the photo as a Messenger group thread to everyone in the pic.

From then on, Messenger will pop up a push notification within seconds of a user taking a photo that includes their friends. They can send right from the alert, or dig in before deciding to send the photo or ignore the message. Android’s more flexible system architecture means the notifications will always happen instantly. On iOS you might have a few minutes delay if you take a photo of friends but haven’t opened Messenger recently so it’s not running in the background.

Last weekend, Martinazzi himself proved just how bad people are at sharing photos. Him and his roommate decided to cut each other’s hair and take photos along the way, but Martinazzi never got the shots of his mangled locks because his buddy “still had the razor in hand”. Photo Magic would have let his roommate share each photo with one tap and get back to playing barber.

Screen Shot 2015-11-09 at 12.04.59 PM

Franklin insists that “we really built the entire Photo Magic experience so you’re in full control.” You can opt out of having your face recognized, or turn the notification off. That’s one benefit of Facebook’s standalone app strategy: it can pull the best features back into its core Facebook and Messenger apps with an idea of how people will want to use them.

Yes, Photo Magic will only save a few seconds at a time. But if you want a staggering gut check about Facebook’s scale, think of it this way. Even if Photo Magic only saves 5 seconds per photo on one third of the photos sent through Messenger, it would save people 500 years of time per month.

Engineering Cool

Facebook launched its Moments app in June, which scans all your old photos with facial recognition, bundles them up by who is in each, and suggests you send people all the photos you have of them. Photo Magic is more temporal, dealing only with the last photo you took.

Facebook Photo Magic SettingsBut through Moments, Facebook learned about how private photo sharing should work, and that ensuring no one gets sent the wrong photos is a top priority. It’s a coming of age moment for Messenger and its 700 million users. Once upon a time, when Messenger was considered a supplementary app, Facebook cribbed features from it like Stickers for its main app. But now Messenger is mandatory on mobile, and it’s getting features from Facebook’s farm team of younger standalones.

Photo Magic does have limitations. Many people use burst fire or shoot a stream of photos and send the best ones. Photo Magic will only scan and suggest you send the last one. One worry is that Photo Magic might annoy you with notifications while you’re continuing to shoot photos, but the team says its thinking about how to improve these situations, such as by holding back notifications when appropriate.

Facebook Peter and Lexy
I forced Facebook’s Peter Martinazzi and Lexy Franklin (from left) into the same pose from the product screenshots

Fast-photo sharing is one thing SMS is terrible at. While Facebook might have competitors in messaging, none are as strong as the old default. Photo Magic makes it clear that people should be communicating with something more modern.

And though Snapchat has become THE visual communication method for a younger generation, and Google Photos makes storage free, Facebook is leaning on its strengths engineering and personal data to fight them off.

Google might know what is in your photos, but it doesn’t know who. Snapchat might be cool, but it can’t tie together names, faces, and social connections. Facebook is using these advantages to make photo sharing less interruptive. And really, what’s cooler than getting back to real life?

More TechCrunch

On Friday, Pal Kovacs was listening to the long-awaited new album from rock and metal giants Bring Me The Horizon when he noticed a strange sound at the end of…

Rock band’s hidden hacking-themed website gets hacked

Jan Leike, a leading AI researcher who earlier this month resigned from OpenAI before publicly criticizing the company’s approach to AI safety, has joined OpenAI rival Anthropic to lead a…

Anthropic hires former OpenAI safety lead to head up new team

Welcome to TechCrunch Fintech! This week, we’re looking at the long-term implications of Synapse’s bankruptcy on the fintech sector, Majority’s impressive ARR milestone, and more!  To get a roundup of…

The demise of BaaS fintech Synapse could derail the funding prospects for other startups in the space

YouTube’s free Playables don’t directly challenge the app store model or break Apple’s rules. However, they do compete with the App Store’s free games.

YouTube’s free games catalog ‘Playables’ rolls out to all users

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the first months of 2024. Smaller-sized…

2 hours ago
A comprehensive list of 2024 tech layoffs

OpenAI has formed a new committee to oversee “critical” safety and security decisions related to the company’s projects and operations. But, in a move that’s sure to raise the ire…

OpenAI’s new safety committee is made up of all insiders

Time is running out for tech enthusiasts and entrepreneurs to secure their early-bird tickets for TechCrunch Disrupt 2024! With only four days left until the May 31 deadline, now is…

Early bird gets the savings — 4 days left for Disrupt sale

AI may not be up to the task of replacing Google Search just yet, but it can be useful in more specific contexts — including handling the drudgery that comes…

Skej’s AI meeting scheduling assistant works like adding an EA to your email

Faircado has built a browser extension that suggests pre-owned alternatives for ecommerce listings.

Faircado raises $3M to nudge people to buy pre-owned goods

Tumblr, the blogging site acquired twice, is launching its “Communities” feature in open beta, the Tumblr Labs division has announced. The feature offers a dedicated space for users to connect…

Tumblr launches its semi-private Communities in open beta

Remittances from workers in the U.S. to their families and friends in Latin America amounted to $155 billion in 2023. With such a huge opportunity, banks, money transfer companies, retailers,…

Félix Pago raises $15.5 million to help Latino workers send money home via WhatsApp

Google said today it’s adding new AI-powered features such as a writing assistant and a wallpaper creator and providing easy access to Gemini chatbot to its Chromebook Plus line of…

Google adds AI-powered features to Chromebook

The dynamic duo behind the Grammy Award–winning music group the Chainsmokers, Alex Pall and Drew Taggart, are set to bring their entrepreneurial expertise to TechCrunch Disrupt 2024. Known for their…

The Chainsmokers light up Disrupt 2024

The deal will give LumApps a big nest egg to make acquisitions and scale its business.

LumApps, the French ‘intranet super app,’ sells majority stake to Bridgepoint in a $650M deal

Featured Article

More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Nubank is taking its first tentative steps into the mobile network realm, as the NYSE-traded Brazilian neobank rolls out an eSIM (embedded SIM) service for travelers. The service will give customers access to 10GB of free roaming internet in more than 40 countries without having to switch out their own existing physical SIM card or…

9 hours ago
More neobanks are becoming mobile networks — and Nubank wants a piece of the action

Infra.Market, an Indian startup that helps construction and real estate firms procure materials, has raised $50M from MARS Unicorn Fund.

MARS doubles down on India’s Infra.Market with new $50M investment

Small operations can lose customers by not offering financing, something the Berlin-based startup wants to change.

Cloover wants to speed solar adoption by helping installers finance new sales

India’s Adani Group is in discussions to venture into digital payments and e-commerce, according to a report.

Adani looks to battle Reliance, Walmart in India’s e-commerce, payments race, report says

Ledger, a French startup mostly known for its secure crypto hardware wallets, has started shipping new wallets nearly 18 months after announcing the latest Ledger Stax devices. The updated wallet…

Ledger starts shipping its high-end hardware crypto wallet

A data protection taskforce that’s spent over a year considering how the European Union’s data protection rulebook applies to OpenAI’s viral chatbot, ChatGPT, reported preliminary conclusions Friday. The top-line takeaway…

EU’s ChatGPT taskforce offers first look at detangling the AI chatbot’s privacy compliance

Here’s a shoutout to LatAm early-stage startup founders! We want YOU to apply for the Startup Battlefield 200 at TechCrunch Disrupt 2024. But you’d better hurry — time is running…

LatAm startups: Apply to Startup Battlefield 200

The countdown to early-bird savings for TechCrunch Disrupt, taking place October 28–30 in San Francisco, continues. You have just five days left to save up to $800 on the price…

5 days left to get your early-bird Disrupt passes

Venture investment into Spanish startups also held up quite well, with €2.2 billion raised across some 850 funding rounds.

Spanish startups reached €100 billion in aggregate value last year

Featured Article

Onyx Motorbikes was in trouble — and then its 37-year-old owner died

James Khatiblou, the owner and CEO of Onyx Motorbikes, was watching his e-bike startup fall apart.  Onyx was being evicted from its warehouse in El Segundo, Los Angeles. The company’s unpaid bills were stacking up. His chief operating officer had abruptly resigned. A shipment of around 100 CTY2 dirt bikes from Chinese supplier Suzhou Jindao…

1 day ago
Onyx Motorbikes was in trouble — and then its 37-year-old owner died

Featured Article

Iyo thinks its gen AI earbuds can succeed where Humane and Rabbit stumbled

Iyo represents a third form factor in the push to deliver standalone generative AI devices: Bluetooth earbuds.

1 day ago
Iyo thinks its gen AI earbuds can succeed where Humane and Rabbit stumbled

Arati Prabhakar, profiled as part of TechCrunch’s Women in AI series, is director of the White House Office of Science and Technology Policy.

Women in AI: Arati Prabhakar thinks it’s crucial to get AI ‘right’

AniML, the French startup behind a new 3D capture app called Doly, wants to create the PhotoRoom of product videos, sort of. If you’re selling sneakers on an online marketplace…

Doly lets you generate 3D product videos from your iPhone

Elon Musk’s AI startup, xAI, has raised $6 billion in a new funding round, it said today, as Musk shores up capital to aggressively compete with rivals including OpenAI, Microsoft,…

Elon Musk’s xAI raises $6B from Valor, a16z, and Sequoia

Indian startup Zypp Electric plans to use fresh investment from Japanese oil and energy conglomerate ENEOS to take its EV rental service into Southeast Asia early next year, TechCrunch has…

Indian EV startup Zypp Electric secures backing to fund expansion to Southeast Asia

Last month, one of the Bay Area’s better-known early-stage venture capital firms, Uncork Capital, marked its 20th anniversary with a party in a renovated church in San Francisco’s SoMa neighborhood,…

A venture capital firm looks back on changing norms, from board seats to backing rival startups