Fb Messenger’s Facial Recognition “Photo Magic” Reminds You To Send Friends Photos Of Them

Comment

Image Credits:

We are busy and lazy, so we forget to send friends the photos we take of them. But Facebook Messenger‘s newest feature Photo Magic scans your newly taken photos with facial recognition, and immediately notifies you with an option to send pics to friends that are in them. The test is rolling out in Australia today on Android and later this week on iOS, before reaching other countries if people enjoy it. Chief Messenger David Marcus says it will be available in the US soon.

03. NUX Suggestion“What we’ve seen is that private sending of photos in Messenger is really popular. About 9.5 billion photos were sent inside Messenger in the last month” Director Of Product Management Peter Martinazzi tells me. “It’s growing even faster than Messenger over all, which is growing really fast.” It’s an especially important use case for Messenger because it directly competes with one of Facebook’s few true rivals in social: Snapchat.

So Facebook used the same facial recognition technology that powers its photo tag suggestions and standalone Moments app to stoke this trend with Photo Magic. If you don’t want to be recognized, you can opt out with the same privacy control to turn off tag suggestions.

But if the tests rolls out more widely and people leave it on, the feature could kick off conversations with a photo. This gives people a rich way to connect while drawing them into Messenger and away from SMS or other chat apps. That in turn drives lock-in for Facebook’s ecosystem, boosting the likelihood that people use its main app where they’ll see News Feed ads.

Selfies, What’s Up, And Friends

Facebook researched the most common types of photos people were sending through Messenger, and they broke down into three main categories:

  • Selfies – where people give their current status or emotional reaction to a message by sending a photo of themselves
  • What’s Up – in which users snap a quick pic of what’s going on around them, giving someone a window into their world
  • Friends – where people take a photo of their friends and then share it to those people so they have it too

But it’s that last category that involves Facebook’s arch-nemesis: friction. Because we’re with friends, we’re often distracted and want to keep living the moment. We put off going through the hassle of opening the camera roll, selecting the photo, passing it over to a messaging app, manually selecting the people in the pic as recipients, and sending it.

Martinazzi gripes that this flow meant “I have to pause whatever i’m doing.” Product manager Lexy Franklin says the team asked “How can we make this faster and simpler? What’s magical is what it’s like in the real world.”

Making Friction Disappear

When users first see the funny little Photo Magic elves introducing the new feature and turn it on, Facebook gives them a wet onboarding experience to show them how it works.

Facebook Photo Magic

Facebook will scan back in their camera roll until it finds a photo that includes their friends, and suggest they send it to those people. A preview window with the photo, the recipients, and an option to include an accompanying message appears with buttons to send or cancel. If sent, Photo Magic sends the photo as a Messenger group thread to everyone in the pic.

From then on, Messenger will pop up a push notification within seconds of a user taking a photo that includes their friends. They can send right from the alert, or dig in before deciding to send the photo or ignore the message. Android’s more flexible system architecture means the notifications will always happen instantly. On iOS you might have a few minutes delay if you take a photo of friends but haven’t opened Messenger recently so it’s not running in the background.

Last weekend, Martinazzi himself proved just how bad people are at sharing photos. Him and his roommate decided to cut each other’s hair and take photos along the way, but Martinazzi never got the shots of his mangled locks because his buddy “still had the razor in hand”. Photo Magic would have let his roommate share each photo with one tap and get back to playing barber.

Screen Shot 2015-11-09 at 12.04.59 PM

Franklin insists that “we really built the entire Photo Magic experience so you’re in full control.” You can opt out of having your face recognized, or turn the notification off. That’s one benefit of Facebook’s standalone app strategy: it can pull the best features back into its core Facebook and Messenger apps with an idea of how people will want to use them.

Yes, Photo Magic will only save a few seconds at a time. But if you want a staggering gut check about Facebook’s scale, think of it this way. Even if Photo Magic only saves 5 seconds per photo on one third of the photos sent through Messenger, it would save people 500 years of time per month.

Engineering Cool

Facebook launched its Moments app in June, which scans all your old photos with facial recognition, bundles them up by who is in each, and suggests you send people all the photos you have of them. Photo Magic is more temporal, dealing only with the last photo you took.

Facebook Photo Magic SettingsBut through Moments, Facebook learned about how private photo sharing should work, and that ensuring no one gets sent the wrong photos is a top priority. It’s a coming of age moment for Messenger and its 700 million users. Once upon a time, when Messenger was considered a supplementary app, Facebook cribbed features from it like Stickers for its main app. But now Messenger is mandatory on mobile, and it’s getting features from Facebook’s farm team of younger standalones.

Photo Magic does have limitations. Many people use burst fire or shoot a stream of photos and send the best ones. Photo Magic will only scan and suggest you send the last one. One worry is that Photo Magic might annoy you with notifications while you’re continuing to shoot photos, but the team says its thinking about how to improve these situations, such as by holding back notifications when appropriate.

Facebook Peter and Lexy
I forced Facebook’s Peter Martinazzi and Lexy Franklin (from left) into the same pose from the product screenshots

Fast-photo sharing is one thing SMS is terrible at. While Facebook might have competitors in messaging, none are as strong as the old default. Photo Magic makes it clear that people should be communicating with something more modern.

And though Snapchat has become THE visual communication method for a younger generation, and Google Photos makes storage free, Facebook is leaning on its strengths engineering and personal data to fight them off.

Google might know what is in your photos, but it doesn’t know who. Snapchat might be cool, but it can’t tie together names, faces, and social connections. Facebook is using these advantages to make photo sharing less interruptive. And really, what’s cooler than getting back to real life?

More TechCrunch

Government officials and AI industry executives agreed on Tuesday to apply elementary safety measures in the fast-moving field and establish an international safety research network. Nearly six months after the…

In Seoul summit, heads of states and companies commit to AI safety

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Some startups choose to bootstrap from the beginning while others find themselves forced into self funding by a lack of investor interest or a business model that doesn’t fit traditional…

VCs wanted FarmboxRx to become a meal kit, the company bootstrapped instead

Uber and Lyft drivers in Minnesota will see higher pay thanks to a deal between the state and the country’s two largest ride-hailing companies. The upshot: a new law that…

Uber’s and Lyft’s ride-hailing deal with Minnesota comes at a cost

Andreessen Horowitz’s American Dynamism fund has established a new fellowship program aimed at introducing top engineers and technologists to venture investing, a move that could help the firm identify less…

a16z’s American Dynamism team launches program to introduce technical minds to VC

Another fintech startup, and its customers, has been gravely impacted by the implosion of banking-as-a-service startup Synapse. Copper Banking, a digital banking service aimed at teens, notified its customers on…

Teen fintech Copper had to abruptly discontinue its banking, debit products

Autodesk — the 3D tools behemoth — has acquired Wonder Dynamics, a startup that lets creators quickly and easily make complex characters and visual effects using AI-powered image analysis. The…

Autodesk acquires AI-powered VFX startup Wonder Dynamics

Farcaster, a blockchain-based social protocol founded by two Coinbase alumni, announced on Tuesday that it closed a $150 million fundraise. Led by Paradigm, the platform also raised money from a16z…

Farcaster, a crypto-based social network, raised $150M with just 80K daily users

Microsoft announced on Tuesday during its annual Build conference that it’s bringing “Windows Volumetric Apps” to Meta Quest headsets. The partnership will allow Microsoft to bring Windows 365 and local…

Microsoft’s new ‘Volumetric Apps’ for Quest headsets extend Windows apps into the 3D space

The spam reached Bluesky by first crossing over two other decentralized networks: Mastodon and Nostr.

The ‘vote Trump’ spam that hit Bluesky in May came from decentralized rival Nostr

Welcome to TechCrunch Fintech! This week, we’re looking at the continued fallout from Synapse’s bankruptcy, how Layer wants to disrupt SMB accounting, and much more! To get a roundup of…

There’s a real appetite for a fintech alternative to QuickBooks

The company is hoping to produce electricity at $13 per megawatt hour, which would be more than 50% cheaper than traditional onshore wind.

Bill Gates-backed wind startup AirLoom is raising $12M, filings reveal

Generative AI makes stuff up. It can be biased. Sometimes it spits out toxic text. So can it be “safe”? Rick Caccia, the CEO of WitnessAI, believes it can. “Securing…

WitnessAI is building guardrails for generative AI models

It’s not often that you hear about a seed round above $10 million. H, a startup based in Paris and previously known as Holistic AI, has announced a $220 million…

French AI startup H raises $220M seed round

Hey there, Series A to B startups with $35 million or less in funding — we’ve got an exciting opportunity that’s tailor-made for your growth journey! If you’re looking to…

Boost your startup’s growth with a ScaleUp package at TC Disrupt 2024

TikTok is pulling out all the stops to prevent its impending ban in the United States. Aside from initiating legal action against the U.S. government, that means shaping up its…

As a US ban looms, TikTok announces a $1M program for socially driven creators

Microsoft wants to put its Copilot everywhere. It’s only a matter of time before Microsoft renames its annual Build developer conference to Microsoft Copilot. Hopefully, some of those upcoming events…

Microsoft’s Power Automate no-code platform adds AI flows

Build is Microsoft’s largest developer conference and of course, it’s all about AI this year. So it’s no surprise that GitHub’s Copilot, GitHub’s “AI pair programming tool,” is taking center…

GitHub Copilot gets extensions

Microsoft wants to make its brand of generative AI more useful for teams — specifically teams across corporations and large enterprise organizations. This morning at its annual Build dev conference,…

Microsoft intros a Copilot for teams

Microsoft’s big focus at this year’s Build conference is generative AI. And to that end, the tech giant announced a series of updates to its platforms for building generative AI-powered…

Microsoft upgrades its AI app-building platforms

The U.K.’s data protection watchdog has closed an almost year-long investigation of Snap’s AI chatbot, My AI — saying it’s satisfied the social media firm has addressed concerns about risks…

UK data protection watchdog ends privacy probe of Snap’s GenAI chatbot, but warns industry

U.S. cell carrier Patriot Mobile experienced a data breach that included subscribers’ personal information, including full names, email addresses, home ZIP codes and account PINs, TechCrunch has learned. Patriot Mobile,…

Conservative cell carrier Patriot Mobile hit by data breach

It’s been three years since Spotify acquired live audio startup Betty Labs, and yet the music streaming service isn’t leveraging the technology to its fullest potential — at least not…

Spotify’s ‘Listening Party’ feature falls short of expectations

Alchemist Accelerator has a new pile of AI-forward companies demoing their wares today, if you care to watch, and the program itself is making some international moves into Tokyo and…

Alchemist’s latest batch puts AI to work as accelerator expands to Tokyo, Doha

“Late Pledge” allows campaign creators to continue collecting money even after the campaign has closed.

Kickstarter now lets you pledge after a campaign closes

Stack AI’s co-founders, Antoni Rosinol and Bernardo Aceituno, were PhD students at MIT wrapping up their degrees in 2022 just as large language models were becoming more mainstream. ChatGPT would…

Stack AI wants to make it easier to build AI-fueled workflows

Pinecone, the vector database startup founded by Edo Liberty, the former head of Amazon’s AI Labs, has long been at the forefront of helping businesses augment large language models (LLMs)…

Pinecone launches its serverless vector database out of preview

Young geothermal energy wells can be like budding prodigies, each brimming with potential to outshine their peers. But like people, most decline with age. In California, for example, the amount…

Special mud helps XGS Energy get more power out of geothermal wells

Featured Article

Sonos finally made some headphones

The market play is clear from the outset: The $449 headphones are firmly targeted at an audience that would otherwise be purchasing the Bose QC Ultra or Apple AirPods Max.

12 hours ago
Sonos finally made some headphones

Adobe says the feature is up to the task, regardless of how complex of a background the object is set against.

Adobe brings Firefly AI-powered Generative Remove to Lightroom