Transportation

Lime has built its own camera-based sidewalk detection technology

Comment

Lime scooter with computer vision system, including camera, attached to the neck
Image Credits: Lime

Shared micromobility giant Lime is finally bringing on some of its own city-appeasing advanced rider assistance system (ARAS) technology. At a Lime event in Paris, the startup shared plans to pilot an in-house built computer vision platform that will leverage cameras to detect when users are riding on the sidewalk. While it will be at the discretion of the cities whether to both audibly alert the riders to their transgressions and actually slow them down, both functions are available.

Lime will be piloting the tech on close to 400 scooters in San Francisco and Chicago starting early to mid-August. By the end of the year, Lime hopes to expand its pilot to six cities in total, including Paris, where the company held a demo of the new tech on Wednesday.

Because it’s easier for cities to blame micromobility companies and scooter riders for sidewalk riding, rather than invest the proper time and money in building protected bike lanes, almost every major operator has been implementing some form of scooter ARAS over the past year.

Bird, Superpedestrian and Neuron rely on a location-based systems to determine where scooters are riding and parking. And Voi, Spin and Zipp have all piloted the computer vision tech of third-party providers, Drover AI and Luna. Lime said it, too, has tested third-party computer vision systems to test the viability of the business model before investing in its own system, which will be the first operator-built camera-based platform to detect sidewalk riding. That said, it’s not the first company to integrate such a system into a scooter. Segway, which supplies many micromobility companies, recently announced its own AI-powered scooter.

Both scooter ARAS camps — localization and computer vision — have their champions. Localization advocates say their tech is cheaper and easier to implement today, whereas computer vision tech is just not there yet in order to be effective. Not to mention it’s expensive and adds yet another hardware element that may break or be vandalized on the streets.

Joe Kraus, president at Lime, says the company is taking a long-term bet by investing in computer vision, which he reckons will actually be cheaper than augmented GPS in the long run, while also providing more applicable use cases.

“I think about where is massive money being invested in order to bring things down the cost curve and to bring capability up the innovation curve,” Kraus told TechCrunch. “The amount of investment that is going into making camera-based systems do more incredible things, like the accuracy of image classification and detection, is huge. There’s a huge amount of investment going onto the open source software side, and as well as on the chipset side to make AI chips on the edge dramatically cheaper and more power efficient.”

To improve localization-based scooter ARAS, getting hyper-accurate maps is crucial to pinpointing where the sidewalks actually are. Kraus doesn’t believe the same level of demand, investment and performance curve is happening for GPS signaling.

“The cost of GPS augmentation inside of a city with more accurate timing signals is not cheap,” said Kraus.

GPS also doesn’t open up as many potential doors for new features, the executive argued. Lime is starting off by detecting sidewalk riding, but it has plans to implement other use cases, like parking detection. Currently, Lime and Bird are both piloting Google’s ARCore Geospatial API, which uses a rider’s smartphone camera to geo-locate parked scooters and e-bikes accurately to determine if they’re parked correctly.

Lime might also choose to use its computer vision tech for “broader localization efforts” or “non-repudiation in the case of accidents,” according to Kraus. Lime Vision, as the feature is called, can also help Lime win brownie points with cities by sharing data on things like hotspots for sidewalk riding to help inform where to actually build bike lanes, or the number of potholes on certain streets.

The first version of Lime Vision which will be tested with the initial pilot is a retrofittable, waterproof unit that affixes to the neck of the scooter below the handlebars and contains the camera, an AI chip and a CPU, or a processor. It’s here where Lime’s computer vision model does its computations in real time, allowing for detections in less than a second, according to Kraus. The unit is connected via a wire to the scooter’s brain so it can communicate commands based on what it analyzes.

Lime is already working on the second version of its computer vision system that would be fully integrated into the body of the vehicle, rather than a separate attachment, said Kraus.

In addition to its computer vision launch, Lime said on Wednesday it plans to pilot a new reaction test to inhibit drunk riding in 30 cities globally. The test, which will pop up on the Lime app when a rider tries to book a ride after a designated time of night, appears as a sort of game: The user controls a scooter as it rides along a street and is asked to hit the stop sign when it appears. Riders who don’t hit that stop sign within a certain amount of time will not be able to start a ride.

Previously, Lime had tried out a similar feature that activated after 10 p.m. in most markets. It would ask riders to type in a “Y-E-S” in response to the question, “Do you affirm you are not drunk and fit to ride?” Last year, Bird launched Safe Start, an in-app checkpoint that asked riders to enter a keyword into the app that it hoped would deter drunk people from riding.

A clarification was issued to the fourth paragraph of this article. 

Advanced rider assistance systems: Tech spawned by the politics of micromobility

More TechCrunch

When Alex Ewing was a kid growing up in Purcell, Oklahoma, he knew how close he was to home based on which billboards he could see out the car window.…

OneScreen.ai brings startup ads to billboards and NYC’s subway

SpaceX’s massive Starship rocket could take to the skies for the fourth time on June 5, with the primary objective of evaluating the second stage’s reusable heat shield as the…

SpaceX sent Starship to orbit — the next launch will try to bring it back

Eric Lefkofsky knows the public listing rodeo well and is about to enter it for a fourth time. The serial entrepreneur, whose net worth is estimated at nearly $4 billion,…

Billionaire Groupon founder Eric Lefkofsky is back with another IPO: AI health tech Tempus

TechCrunch Disrupt showcases cutting-edge technology and innovation, and this year’s edition will not disappoint. Among thousands of insightful breakout session submissions for this year’s Audience Choice program, five breakout sessions…

You’ve spoken! Meet the Disrupt 2024 breakout session audience choice winners

Check Point is the latest security vendor to fix a vulnerability in its technology, which it sells to companies to protect their networks.

Zero-day flaw in Check Point VPNs is ‘extremely easy’ to exploit

Though Spotify never shared official numbers, it’s likely that Car Thing underperformed or was just not worth continued investment in today’s tighter economic market.

Spotify offers Car Thing refunds as it faces lawsuit over bricking the streaming device

The studies, by researchers at MIT, Ben-Gurion University, Cambridge and Northeastern, were independently conducted but complement each other well.

Misinformation works, and a handful of social ‘supersharers’ sent 80% of it in 2020

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Okay, okay…

Tesla shareholder sweepstakes and EV layoffs hit Lucid and Fisker

In a series of posts on X on Thursday, Paul Graham, the co-founder of startup accelerator Y Combinator, brushed off claims that OpenAI CEO Sam Altman was pressured to resign…

Paul Graham claims Sam Altman wasn’t fired from Y Combinator

In its three-year history, EthonAI has amassed some fairly high-profile customers including Siemens and chocolate-maker Lindt.

AI manufacturing startup funding is on a tear as Switzerland’s EthonAI raises $16.5M

Don’t miss out: TechCrunch Disrupt early-bird pricing ends in 48 hours! The countdown is on! With only 48 hours left, the early-bird pricing for TechCrunch Disrupt 2024 will end on…

Ticktock! 48 hours left to nab your early-bird tickets for Disrupt 2024

Biotech startup Valar Labs has built a tool that accurately predicts certain treatment outcomes, potentially saving precious time for patients.

Valar Labs debuts AI-powered cancer care prediction tool and secures $22M

Archer Aviation is partnering with ride-hailing and parking company Kakao Mobility to bring electric air taxi flights to South Korea starting in 2026, if the company can get its aircraft…

Archer, Kakao Mobility partner to bring electric air taxis to South Korea in 2026

Space startup Basalt Technologies started in a shed behind a Los Angeles dentist’s office, but things have escalated quickly: Soon it will try to “hack” a derelict satellite and install…

Basalt plans to ‘hack’ a defunct satellite to install its space-specific OS

As a teen model, Katrin Kaurov became financially independent at a young age. Aleksandra Medina, whom she met at NYU Abu Dhabi, also learned to manage money early on. The…

Former teen model co-created app Frich to help Gen Z be more realistic about finances

Can AI help you tell your story? That’s the idea behind a startup called Autobiographer, which leverages AI technology to engage users in meaningful conversations about the events in their…

Autobiographer’s app uses AI to help you tell your life story

AI-powered summaries of web pages are a feature that you will find in many AI-centric tools these days. The next step for some of these tools is to prepare detailed…

Perplexity AI’s new feature will turn your searches into shareable pages

ChatGPT, OpenAI’s text-generating AI chatbot, has taken the world by storm. What started as a tool to hyper-charge productivity through writing essays and code with short text prompts has evolved…

ChatGPT: Everything you need to know about the AI-powered chatbot

Battery recycling startups have emerged in Europe in a bid to tap into the next big opportunity in the EV market: battery waste.  Among them is Cylib, a German-based startup…

Cylib wants to own EV battery recycling in Europe

Amazon has received approval from the U.S. Federal Aviation Administration (FAA) to fly its delivery drones longer distances, the company announced on Thursday. Amazon says it can now expand its…

Amazon gets FAA approval to expand US drone deliveries

With Plannin, creators can tell their audience about their latest trip, which hotels they liked and post photos of their travels.

Former Priceline execs debut Plannin, a booking platform that uses travel influencers to help plan trips

Amazon is rolling out its AI voice search feature to Alexa, which lets it answer open-ended questions about content.

Amazon is rolling out AI voice search to Fire TV devices

Redpanda has already integrated Benthos into its own service and has made it the core technology of its new Redpanda Connect service.

Redpanda acquires Benthos to expand its end-to-end streaming data platform

It’s a lofty goal to take on legacy payments infrastructure, however, Forward’s model has an advantage by shifting the economics back to SaaS companies.

Fintech startup Forward grabs $16M to take on Stripe, lead future of integrated payments

Fertility remains a pressing concern around the world — birthrates are down in many countries, and infertility rates (that is, the inability to conceive) are up. Rhea, a Singapore- and…

Rhea reaps $10M more led by Thiel

Microsoft, Meta, Intel, AMD and others have formed a new group to design next-gen interconnects for AI accelerator hardware.

Tech giants form an industry group to help develop next-gen AI chip components

With JioFinance, the Indian tycoon Mukesh Ambani is making his boldest consumer-facing move yet into financial services.

Ambani’s Reliance fires opening salvo in fintech battle, launches JioFinance app

Salespeople live and die by commissions. It’s no surprise, then, that Salesforce paid a premium to buy a platform that simplifies managing commissions.

Filing shows Salesforce paid $419M to buy Spiff in February

YoLa Fresh works with over a thousand retailers across Morocco and records up to $1 million in gross merchandise volume.

YoLa Fresh, a GrubMarket for Morocco, digs up $7M to connect farmers with food sellers

Instagram is expanding the scope of its “Limits” tool specifically for teenagers that would let them restrict unwanted interactions with people.

Instagram now lets teens limit interactions to their ‘Close Friends’ group to combat harassment