Hardware

Zuckerberg Confirms Facebook Is Working On Augmented Reality

Comment

Image Credits:

“Yeah!” Facebook CEO Mark Zuckerberg said excitedly in response to a big question for his company: is Facebook working on augmented reality? “It’s a bit further out,” he followed up during a talk about virtual reality at the Vanity Fair New Establishment Summit in San Francisco.

Facebook’s intentions in virtual reality were already clear after buying Oculus, which is already shipping units in partnership with Samsung and is prepping the launch of its flagship headset. Facebook’s Michael Abrash said virtual reality is already “past the knee of the curve,” and has basically arrived. But augmented reality, by its nature, presents a new type of problems, Abrash said — hence it taking a little longer for it to become as feasible as virtual reality.

“It’s very interesting; it’s something we’d all use if it worked well,” Abrash said. “It’s kind of seamless. Maybe it’ll be contacts [or glasses]. You’ll have something on and it’ll be VR and AR as you choose. But right now the VR tech is past the knee of the curve. For AR, it’s harder. There are a whole host of challenges — how you do the optics and displays and get photos onto the eyes, how you have something that’s socially acceptable and comfortable all day. I think VR is here now, I think AR will be here, but it’s a long road to get there.”

Augmented reality represents a different opportunity for Facebook than virtual reality. With VR as is, the Oculus Rift is designed to be an immersive experience that essentially helps the user shut out the rest of the world and focus only on the experience. It will let people experience intimate moments. An example Zuckerberg gave was giving family members the opportunity to watch a child take its first steps.

“It’s very interesting; it’s something we’d all use if it worked well.” Michael Abrash
“What Facebook is, is a way to give people a voice to share anything that they want in any form of medium with any audience they want,” Zuckerberg said. “Certainly this more immersive content will be an increasing portion of what gets shared. But another part of the beauty of Internet communication is it’s asynchronous. [But there will be] use cases where you can be in person with someone, doing surgery remotely, that you very much need to be synchronous.”

12027093_10102388426141661_6188485856299985289_o

AR, however, is about keeping a connection with the world around the user. The implications for a Facebook-driven AR system are pretty obvious. Imagine, maybe, walking down the street and getting a heads-up display for the number of likes a business has. By definition, AR is supposed to augment a user’s vision and give them the capability to do more with the world around them, and Facebook can use that to power a whole suite of new experiences.

Facebook won’t be the only company working on augmented reality, but it certainly has the ability to become a juggernaut in the space. There’s also the looming presence of the notoriously quiet augmented reality startup Magic Leap, which received a massive investment from Google. And of course, the classic problem case here was Google Glass, which ended up with social backlash rather than acceptance of the new technology.

So while Zuck and Abrash gave few details on exactly how Facebook’s AR dreams will be delivered, the mere confirmation that it’s looking beyond VR is important. Its facial recognition combined with AR could have wide-ranging use cases. Facebook knows more about people and the world they live in than almost any company. Eventually, it could overlay that information right on the world itself so you can look up from your screen, and instead look through it.

Zuckerberg earlier explained “If you think about phones, it’s still a little awkward to take it out of your pocket. In the future, if you want to look around you should be able to look around. If you want to select something, you should be able to look at it.”

More TechCrunch

Google’s gunning for OpenAI’s Sora with Veo, an AI model that can create 1080p video clips around a minute long given a text prompt.  Unveiled on Tuesday at Google’s I/O 2024 developer…

Google gets serious about AI-generated video at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to the Google Maps platform

Google says that over 100,000 developers already tried the service.

Project IDX, Google’s next-gen IDE, is now in open beta

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Everything announced so far

The system effectively listens for “conversation patterns commonly associated with scams” in-real time. 

Google will use Gemini to detect scams during calls

The standard Gemma models were only available in 2 billion and 7 billion parameter versions, making this quite a step up.

Google announces Gemma 2, a 27B-parameter version of its open model, launching in June

This is a great example of a company using generative AI to open its software to more users.

Google TalkBack will use Gemini to describe images for blind people

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

Google’s Circle to Search feature will now be able to solve more complex problems across psychics and math word problems. 

Circle to Search is now a better homework helper

People can now search using a video they upload combined with a text query to get an AI overview of the answers they need.

Google experiments with using video to search, thanks to Gemini AI

A search results page based on generative AI as its ranking mechanism will have wide-reaching consequences for online publishers.

Google will soon start using GenAI to organize some search results pages

Google has built a custom Gemini model for search to combine real-time information, Google’s ranking, long context and multimodal features.

Google is adding more AI to its search results

At its Google I/O developer conference, Google on Tuesday announced the next generation of its Tensor Processing Units (TPU) AI chips.

Google’s next-gen TPUs promise a 4.7x performance boost

Google is upgrading Gemini, its AI-powered chatbot, with features aimed at making the experience more ambient and contextually useful.

Google reveals plans for upgrading AI in the real world through Gemini Live at Google I/O 2024

Veo can generate few-seconds-long 1080p video clips given a text prompt.

Google’s image-generating AI gets an upgrade

At Google I/O, Google announced upgrades to Gemini 1.5 Pro, including a bigger context window. .

Google’s generative AI can now analyze hours of video

The AI upgrade will make finding the right content more intuitive and less of a manual search process.

Google Photos introduces an AI search feature, ‘Ask Photos’

Apple released new data about anti-fraud measures related to its operation of the iOS App Store on Tuesday morning, trumpeting a claim that it stopped over $7 billion in “potentially…

Apple touts stopping $1.8BN in App Store fraud last year in latest pitch to developers

Online travel agency Expedia is testing an AI assistant that bolsters features like search, itinerary building, trip planning, and real-time travel updates.

Expedia starts testing AI-powered features for search and travel planning

Welcome to TechCrunch Fintech! This week, we look at the drama around TabaPay deciding to not buy Synapse’s assets, as well as stocks dropping for a couple of fintechs, Monzo raising…

Inside TabaPay’s drama-filled decision to abandon its plans to buy Synapse’s assets

The person who claimed to have stolen the physical addresses of 49 million Dell customers appears to have taken more data from a different Dell portal, TechCrunch has learned. The…

Threat actor scraped Dell support tickets, including customer phone numbers

If you write the words “cis” or “cisgender” on X, you might be served this full-screen message: “This post contains language that may be considered a slur by X and…

On Elon’s whim, X now treats ‘cisgender’ as a slur

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch the AI reveals live

Facebook once had big ambitions to be a major player in enterprise communication and productivity, but today the social network’s parent company Meta will be closing a very significant chapter…

Meta is shutting down Workplace, its enterprise communications business

The Oversight Board has overturned Meta’s decision to take down a documentary revealing the identities of child abuse victims in Pakistan.

Meta’s Oversight Board overturns takedown decision for Pakistan child abuse documentary

Adam Selipsky is stepping down from his role as CEO of Amazon Web Services, Amazon has confirmed to TechCrunch.  In a memo shared internally by Amazon CEO Andy Jassy and…

AWS CEO Adam Selipsky steps down

VC and podcaster David Sacks has revealed a new AI chat app called Glue that fixes “Slack channel fatigue,” he says.

David Sacks reveals Glue, the AI company he’s been teasing on his All In podcast

Harness isn’t founder Jyoti Bansal’s first startup. He sold AppDynamics to Cisco for $3.7 billion in 2017, the week it was supposed to go public. His latest venture has raised…

After surpassing $100M in ARR, Harness grabs a $150M line of credit