Transportation

Lime has built its own camera-based sidewalk detection technology

Comment

Lime scooter with computer vision system, including camera, attached to the neck
Image Credits: Lime

Shared micromobility giant Lime is finally bringing on some of its own city-appeasing advanced rider assistance system (ARAS) technology. At a Lime event in Paris, the startup shared plans to pilot an in-house built computer vision platform that will leverage cameras to detect when users are riding on the sidewalk. While it will be at the discretion of the cities whether to both audibly alert the riders to their transgressions and actually slow them down, both functions are available.

Lime will be piloting the tech on close to 400 scooters in San Francisco and Chicago starting early to mid-August. By the end of the year, Lime hopes to expand its pilot to six cities in total, including Paris, where the company held a demo of the new tech on Wednesday.

Because it’s easier for cities to blame micromobility companies and scooter riders for sidewalk riding, rather than invest the proper time and money in building protected bike lanes, almost every major operator has been implementing some form of scooter ARAS over the past year.

Bird, Superpedestrian and Neuron rely on a location-based systems to determine where scooters are riding and parking. And Voi, Spin and Zipp have all piloted the computer vision tech of third-party providers, Drover AI and Luna. Lime said it, too, has tested third-party computer vision systems to test the viability of the business model before investing in its own system, which will be the first operator-built camera-based platform to detect sidewalk riding. That said, it’s not the first company to integrate such a system into a scooter. Segway, which supplies many micromobility companies, recently announced its own AI-powered scooter.

Both scooter ARAS camps — localization and computer vision — have their champions. Localization advocates say their tech is cheaper and easier to implement today, whereas computer vision tech is just not there yet in order to be effective. Not to mention it’s expensive and adds yet another hardware element that may break or be vandalized on the streets.

Joe Kraus, president at Lime, says the company is taking a long-term bet by investing in computer vision, which he reckons will actually be cheaper than augmented GPS in the long run, while also providing more applicable use cases.

“I think about where is massive money being invested in order to bring things down the cost curve and to bring capability up the innovation curve,” Kraus told TechCrunch. “The amount of investment that is going into making camera-based systems do more incredible things, like the accuracy of image classification and detection, is huge. There’s a huge amount of investment going onto the open source software side, and as well as on the chipset side to make AI chips on the edge dramatically cheaper and more power efficient.”

To improve localization-based scooter ARAS, getting hyper-accurate maps is crucial to pinpointing where the sidewalks actually are. Kraus doesn’t believe the same level of demand, investment and performance curve is happening for GPS signaling.

“The cost of GPS augmentation inside of a city with more accurate timing signals is not cheap,” said Kraus.

GPS also doesn’t open up as many potential doors for new features, the executive argued. Lime is starting off by detecting sidewalk riding, but it has plans to implement other use cases, like parking detection. Currently, Lime and Bird are both piloting Google’s ARCore Geospatial API, which uses a rider’s smartphone camera to geo-locate parked scooters and e-bikes accurately to determine if they’re parked correctly.

Lime might also choose to use its computer vision tech for “broader localization efforts” or “non-repudiation in the case of accidents,” according to Kraus. Lime Vision, as the feature is called, can also help Lime win brownie points with cities by sharing data on things like hotspots for sidewalk riding to help inform where to actually build bike lanes, or the number of potholes on certain streets.

The first version of Lime Vision which will be tested with the initial pilot is a retrofittable, waterproof unit that affixes to the neck of the scooter below the handlebars and contains the camera, an AI chip and a CPU, or a processor. It’s here where Lime’s computer vision model does its computations in real time, allowing for detections in less than a second, according to Kraus. The unit is connected via a wire to the scooter’s brain so it can communicate commands based on what it analyzes.

Lime is already working on the second version of its computer vision system that would be fully integrated into the body of the vehicle, rather than a separate attachment, said Kraus.

In addition to its computer vision launch, Lime said on Wednesday it plans to pilot a new reaction test to inhibit drunk riding in 30 cities globally. The test, which will pop up on the Lime app when a rider tries to book a ride after a designated time of night, appears as a sort of game: The user controls a scooter as it rides along a street and is asked to hit the stop sign when it appears. Riders who don’t hit that stop sign within a certain amount of time will not be able to start a ride.

Previously, Lime had tried out a similar feature that activated after 10 p.m. in most markets. It would ask riders to type in a “Y-E-S” in response to the question, “Do you affirm you are not drunk and fit to ride?” Last year, Bird launched Safe Start, an in-app checkpoint that asked riders to enter a keyword into the app that it hoped would deter drunk people from riding.

A clarification was issued to the fourth paragraph of this article. 

Advanced rider assistance systems: Tech spawned by the politics of micromobility

More TechCrunch

Sona, a workforce management platform for frontline employees, has raised $27.5 million in a Series A round of funding. More than two-thirds of the U.S. workforce are reportedly in frontline…

Sona, a frontline workforce management platform, raises $27.5M with eyes on US expansion

Uber Technologies announced Tuesday that it will buy the Taiwan unit of Delivery Hero’s Foodpanda for $950 million in cash. The deal is part of Uber Eats’ strategy to expand…

Uber to acquire Foodpanda’s Taiwan unit from Delivery Hero for $950M in cash 

Paris-based Blisce has become the latest VC firm to launch a fund dedicated to climate tech. It plans to raise as much as €150M (about $162M).

Paris-based VC firm Blisce launches climate tech fund with a target of $160M

Maad, a B2B e-commerce startup based in Senegal, has secured $3.2 million debt-equity funding to bolster its growth in the western Africa country and to explore fresh opportunities in the…

Maad raises $3.2M seed amid B2B e-commerce sector turbulence in Africa

The fresh funds were raised from two investors who transferred the capital into a special purpose vehicle, a legal entity associated with the OpenAI Startup Fund.

OpenAI Startup Fund raises additional $5M

Accel has invested in more than 200 startups in the region to date, making it one of the more prolific VCs in this market.

Accel has a fresh $650M to back European early-stage startups

Kyle Vogt, the former founder and CEO of self-driving car company Cruise, has a new VC-backed robotics startup focused on household chores. Vogt announced Monday that the new startup, called…

Cruise founder Kyle Vogt is back with a robot startup

When Keith Rabois announced he was leaving Founders Fund to return to Khosla Ventures in January, it came as a shock to many in the venture capital ecosystem — and…

From Miles Grimshaw to Eva Ho, venture capitalists continue to play musical chairs

On the heels of OpenAI announcing the latest iteration of its GPT large language model, its biggest rival in generative AI in the U.S. announced an expansion of its own.…

Anthropic is expanding to Europe and raising more money

If you’re looking for a Starliner mission recap, you’ll have to wait a little longer, because the mission has officially been delayed.

TechCrunch Space: You rock(et) my world, moms

Apple devoted a full event to iPad last Tuesday, roughly a month out from WWDC. From the invite artwork to the polarizing ad spot, Apple was clear — the event…

Apple iPad Pro M4 vs. iPad Air M2: Reviewing which is right for most

Terri Burns, a former partner at GV, is venturing into a new chapter of her career by launching her own venture firm called Type Capital. 

GV’s youngest partner has launched her own firm

The decision to go monochrome was probably a smart one, considering the candy-colored alternatives that seem to want to dazzle and comfort you.

ChatGPT’s new face is a black hole

Apple and Google announced on Monday that iPhone and Android users will start seeing alerts when it’s possible that an unknown Bluetooth device is being used to track them. The…

Apple and Google agree on standard to alert people when unknown Bluetooth devices may be tracking them

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: Watch here

A human safety operator will be behind the wheel during this phase of testing, according to the company.

GM’s Cruise ramps up robotaxi testing in Phoenix

OpenAI announced a new flagship generative AI model on Monday that they call GPT-4o — the “o” stands for “omni,” referring to the model’s ability to handle text, speech, and…

OpenAI debuts GPT-4o ‘omni’ model now powering ChatGPT

Featured Article

The women in AI making a difference

As a part of a multi-part series, TechCrunch is highlighting women innovators — from academics to policymakers —in the field of AI.

18 hours ago
The women in AI making a difference

The expansion of Polar Semiconductor’s facility would enable the company to double its U.S. production capacity of sensor and power chips within two years.

White House proposes up to $120M to help fund Polar Semiconductor’s chip facility expansion

In 2021, Google kicked off work on Project Starline, a corporate-focused teleconferencing platform that uses 3D imaging, cameras and a custom-designed screen to let people converse with someone as if…

Google’s 3D video conferencing platform, Project Starline, is coming in 2025 with help from HP

Over the weekend, Instagram announced that it is expanding its creator marketplace to 10 new countries — this marketplace connects brands with creators to foster collaboration. The new regions include…

Instagram expands its creator marketplace to 10 new countries

You can expect plenty of AI, but probably not a lot of hardware.

Google I/O 2024: What to expect

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

Four-year-old Mexican BNPL startup Aplazo facilitates fractionated payments to offline and online merchants even when the buyer doesn’t have a credit card.

Aplazo is using buy now, pay later as a stepping stone to financial ubiquity in Mexico

We received countless submissions to speak at this year’s Disrupt 2024. After carefully sifting through all the applications, we’ve narrowed it down to 19 session finalists. Now we need your…

Vote for your Disrupt 2024 Audience Choice favs

Co-founder and CEO Bowie Cheung, who previously worked at Uber Eats, said the company now has 200 customers.

Healthy growth helps B2B food e-commerce startup Pepper nab $30 million led by ICONIQ Growth

Booking.com has been designated a gatekeeper under the EU’s DMA, meaning the firm will be regulated under the bloc’s market fairness framework.

Booking.com latest to fall under EU market power rules

Featured Article

‘Got that boomer!’: How cybercriminals steal one-time passcodes for SIM swap attacks and raiding bank accounts

Estate is an invite-only website that has helped hundreds of attackers make thousands of phone calls aimed at stealing account passcodes, according to its leaked database.

23 hours ago
‘Got that boomer!’: How cybercriminals steal one-time passcodes for SIM swap attacks and raiding bank accounts

Squarespace is being taken private in an all-cash deal that values the company on an equity basis at $6.6 billion.

Permira is taking Squarespace private in a $6.9 billion deal

AI-powered tools like OpenAI’s Whisper have enabled many apps to make transcription an integral part of their feature set for personal note-taking, and the space has quickly flourished as a…

Buy Me a Coffee’s founder has built an AI-powered voice note app