AI

Beyond Siri: The AI revolution coming from the web

Comment

Image Credits: Aniwhite (opens in a new window) / Shutterstock (opens in a new window)

Eric Poindessault

Contributor

Eric Poindessault is founder and CEO at Biggerpan.

From HAL in 2001: A Space Odyssey to Samantha in Spike Jonze’s Her, for decades we have been obsessed with the idea that artificial intelligence powered-computers will one day be able to interact with people, follow spoken instructions and make decisions independently, like a human would.

Since Siri hit our screens on the iPhone 4, Google, Facebook, Amazon, Microsoft and Baidu have entered the playing field, too. But while each new generation brings its lot of interesting new features or use cases, they are still far off from the AI representations in movies. It’s hard to imagine anyone engaging in a romantic relationship with Siri, or NASA putting Alexa in control of a spacecraft just yet.

Movies have set the bar pretty high, and we are still waiting for such ubiquitous voice-controlled AI assistants to enter the real world. However, the era of an intelligent assistant that can really help us in our day-to-day lives is certainly closer than we may think.

Passive assistants that rely on user input

When talking about intelligent personal assistants, people tend to think about Siri, Cortana or Amazon Echo. More tech-savvy users might also have heard of Viv from the founders of Siri, Facebook’s recent contribution M and other messaging-based AI tools like Operator or Magic. However, while these new tools have been getting a lot of hype lately, when it comes to their use cases, most of them are still stuck in the realm of glorified Q&As.

Over the last couple of years there have been a number of signals that tech forerunners are serious about taking AI to the next level. Google acquired the London-based deep learning research group DeepMind for half a billion dollars in 2014, IBM acquired AlchemyAPI last year and Apple recently made two AI acquisitions in just four days.

These acquisitions came after recent breakthroughs in GPU-accelerated deep-learning techniques have made it possible to reach exceptional improvements in pattern recognition, with great applications for speech recognition and computer vision. According to Tim Tuttle, founder and CEO of Expect Labs, within the next two years machines should be able to follow spoken instructions even better than humans do.

While arguably the ability to communicate through our senses is at the essence of human intelligence, it is only one ingredient of the essential recipe. Professor Stuart Russell from U.C. Berkeley identifies six major capabilities that a computer needs to pass the Total Turing test: natural language processing, knowledge representation, automated reasoning, machine learning, computer vision and robotics.

In simpler terms, these are the building blocks of artificial general intelligence, and speech recognition is just one aspect. Speaking can be a convenient alternative to tapping on a keyboard when your hands are busy, but then your voice is just a medium, and it doesn’t always shine as the best input method. How many times have you started asking Siri something and ended up typing your own query on Google?

Context is the hard part

The team behind Viv believes they can build a better personal assistant, using advanced deep-learning techniques to make machines teach themselves how to solve problems. While they’re understandably keeping their secret sauce close to their chest, the information disclosed so far implies that it requires some human guidance in order to build use cases. In the same way a human can learn to solve a problem using clues given by someone who knows how to solve it, they guide the AI to find its own methods to solve problems.

However, the comparison with humans stops here, because, unlike machines, we have the ability to autonomously build on top of our knowledge by contextualizing problems and finding original solutions to solve them. We naturally “connect the dots” to find answers and make decisions, while current AI implementations often fail to associate problems with something essential and very hard to formalize: the context that surrounds them.

Context is what gives AI the ability to form more intelligent decisions rather than solely relying on well-defined input instructions. As such, it links the past, present and future to solve sophisticated problems. Professor Patrick Brézillon from the University of Paris argues: “In Artificial Intelligence, the lack of explicit representation of context is one of the reasons of the failures of many Knowledge-Based Systems.” There is indeed a lot to grasp.

Teaching computers about context in human behavior is a colossal task; people are not always predictable and the variety of situations is basically endless. At a personal level, using machine-learning techniques to understand someone’s way of dealing with social interactions and decision making would involve countless hours of user input. That could probably be performed by observing you 24 hours a day but, since mind reading doesn’t exist yet, you would also need to be expressing your reasoning out loud so the machine could learn to think like you.

Harnessing the power of the Internet

Machine learning requires a lot of data. For natural language processing, the data is generally collected in a corpus, which is a large structured set of texts that can be used to train the AI. To give you an idea of just how large data sets can be, when Watson beat the human champion of Jeopardy, it had previously ingested the entire Wikipedia database.

What is interesting about the IBM Watson story is that the corpus it was fed required no prior structuring, which means Watson was able to use the data without human supervision. Now what if M had a similar training, with the further goals of being able to converse and perform elaborate tasks? What would the model be and where could we find the appropriate data?

The Internet contains millions of hours of talks, videos, books, data and everything that would allow for neural networks to build intelligence. You want to teach a machine about love? Feed it Romeo and Juliet and other romance novels. About business? Plug it into The Wall Street Journal’s news feed. DeepMind recently gave us a taste of what could be done, teaching language to their AI with a database of more than 300,000 articles from CNN and the Daily Mail.

The data is right there, and for now we only seem to be scratching the surface. But another wave of progress in machine learning will soon allow us to make even more sense of the exabytes of information the Web contains, and such advancement will mark a huge step in the evolution toward an Artificial Superintelligence.

Aside from scraping the oceans of unstructured data available online, a much closer future that could make our lives easier is already at hand. Every day humans make hundreds of decisions online, and every time we click on a link, those clicks are recorded by advertising and analytics companies across multiple websites. Imagine if that information was instead used by an AI dedicated to understanding your browsing preferences as you navigate and collect the relevant information in your browsing, along with that of millions of other users, to determine patterns out of the data.

It would not only be able to offer you a more personalized and contextualized experience of the Web, it would also understand your intent better and be able to anticipate your needs before you even express them! And voilà, an AI personal assistant that could really lighten the load using technology that already exists.

Researchers predict we’ll have to wait at least another decade before we can truly experience the greatness of ubiquitous human-like intelligence. Meanwhile, the Internet is arriving at a stage where it is gathering all the necessary ingredients for a huge leap in terms of AI, and already has a lot of bots, scrapers, analytics and other APIs harvesting our online data of which we could take advantage.

So let’s disconnect images in the movies from the real progress that’s happening before our eyes, and realize that the greatest chance we have of creating an AI that can really make our lives easier is by harnessing something we use every day.

More TechCrunch

The AI industry moves faster than the rest of the technology sector, which means it outpaces the federal government by several orders of magnitude.

Senate study proposes ‘at least’ $32B yearly for AI programs

The FBI along with a coalition of international law enforcement agencies seized the notorious cybercrime forum BreachForums on Wednesday.  For years, BreachForums has been a popular English-language forum for hackers…

FBI seizes hacking forum BreachForums — again

The announcement signifies a significant shake-up in the streaming giant’s advertising approach.

Netflix to take on Google and Amazon by building its own ad server

It’s tough to say that a $100 billion business finds itself at a critical juncture, but that’s the case with Amazon Web Services, the cloud arm of Amazon, and the…

Matt Garman taking over as CEO with AWS at crossroads

Back in February, Google paused its AI-powered chatbot Gemini’s ability to generate images of people after users complained of historical inaccuracies. Told to depict “a Roman legion,” for example, Gemini would show…

Google still hasn’t fixed Gemini’s biased image generator

A feature Google demoed at its I/O confab yesterday, using its generative AI technology to scan voice calls in real time for conversational patterns associated with financial scams, has sent…

Google’s call-scanning AI could dial up censorship by default, privacy experts warn

Google’s going all in on AI — and it wants you to know it. During the company’s keynote at its I/O developer conference on Tuesday, Google mentioned “AI” more than…

The top AI announcements from Google I/O

Uber is taking a shuttle product it developed for commuters in India and Egypt and converting it for an American audience. The ride-hail and delivery giant announced Wednesday at its…

Uber has a new way to solve the concert traffic problem

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

Google is preparing to launch a new system to help address the problem of malware on Android. Its new live threat detection service leverages Google Play Protect’s on-device AI to…

Google takes aim at Android malware with an AI-powered live threat detection service

Users will be able to access the AR content by first searching for a location in Google Maps.

Google Maps is getting geospatial AR content later this year

The heat pump startup unveiled its first products and revealed details about performance, pricing and availability.

Quilt heat pump sports sleek design from veterans of Apple, Tesla and Nest

The space is available from the launcher and can be locked as a second layer of authentication.

Google’s new Private Space feature is like Incognito Mode for Android

Gemini, the company’s family of generative AI models, will enhance the smart TV operating system so it can generate descriptions for movies and TV shows.

Google TV to launch AI-generated movie descriptions

When triggered, the AI-powered feature will automatically lock the device down.

Android’s new Theft Detection Lock helps deter smartphone snatch and grabs

The company said it is increasing the on-device capability of its Google Play Protect system to detect fraudulent apps trying to breach sensitive permissions.

Google adds live threat detection and screen-sharing protection to Android

This latest release, one of many announcements from the Google I/O 2024 developer conference, focuses on improved battery life and other performance improvements, like more efficient workout tracking.

Wear OS 5 hits developer preview, offering better battery life

For years, Sammy Faycurry has been hearing from his registered dietitian (RD) mom and sister about how poorly many Americans eat and their struggles with delivering nutritional counseling. Although nearly…

Dietitian startup Fay has been booming from Ozempic patients and emerges from stealth with $25M from General Catalyst, Forerunner

Apple is bringing new accessibility features to iPads and iPhones, designed to cater to a diverse range of user needs.

Apple announces new accessibility features for iPhone and iPad users

TechCrunch Disrupt, our flagship startup event held annually in San Francisco, is back on October 28-30 — and you can expect a bustling crowd of thousands of startup enthusiasts. Exciting…

Startup Blueprint: TC Disrupt 2024 Builders Stage agenda sneak peek!

Mike Krieger, one of the co-founders of Instagram and, more recently, the co-founder of personalized news app Artifact (which TechCrunch corporate parent Yahoo recently acquired), is joining Anthropic as the…

Anthropic hires Instagram co-founder as head of product

Seven orgs so far have signed on to standardize the way data is collected and shared.

Venture orgs form alliance to standardize data collection

As cloud adoption continues to surge toward the $1 trillion mark in annual spend, we’re seeing a wave of enterprise startups gaining traction with customers and investors for tools to…

Alkira connects with $100M for a solution that connects your clouds

Charging has long been the Achilles’ heel of electric vehicles. One startup thinks it has a better way for apartment dwelling EV drivers to charge overnight.

Orange Charger thinks a $750 outlet will solve EV charging for apartment dwellers

So did investors laugh them out of the room when they explained how they wanted to replace Quickbooks? Kind of.

Embedded accounting startup Layer secures $2.3M toward goal of replacing QuickBooks

While an increasing number of companies are investing in AI, many are struggling to get AI-powered projects into production — much less delivering meaningful ROI. The challenges are many. But…

Weka raises $140M as the AI boom bolsters data platforms

PayHOA, a previously bootstrapped Kentucky-based startup that offers software for self-managed homeowner associations (HOAs), is an example of how real-world problems can translate into opportunity. It just raised a $27.5…

Meet PayHOA, a profitable and once-bootstrapped SaaS startup that just landed a $27.5M Series A

Restaurant365, which offers a restaurant management suite, has raised a hot $175M from ICONIQ Growth, KKR and L Catterton.

Restaurant365 orders in $175M at $1B+ valuation to supersize its food service software stack 

Venture firm Shilling has launched a €50M fund to support growth-stage startups in its own portfolio and to invest in startups everywhere else. 

Portuguese VC firm Shilling launches €50M opportunity fund to back growth-stage startups

Chang She, previously the VP of engineering at Tubi and a Cloudera veteran, has years of experience building data tooling and infrastructure. But when She began working in the AI…

LanceDB, which counts Midjourney as a customer, is building databases for multimodal AI