IP Library Granted Patent US 12,581,040
Granted Patent B2
US 12,581,040 · App. 17/846,577 · Granted Mar 17, 2026

Systems and methods for coordinated collection of street-level image data

Inventors: Renee Park (San Francisco, CA); Saurabh Saraf (San Mateo, CA); Ramesh Rangarajan Sarukkai (Los Gatos, CA); Vinay Shet (Fremont, CA)
Assignee: Lyft, Inc.
H04N7/181G06F16/5866G06V20/56H04L67/10H04N1/00H04N7/183H04N23/661H04W4/02H04W4/40H04W4/50G06V20/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,581,040
App. No.
17/846,577
Granted
Mar 17, 2026
Kind
B2
Abstract

The disclosed computer-implemented method may include (i) identifying, by a server computer system, a provider computing device for use in capturing street-level image data, where the provider computing device controls a camera positioned to capture street-level imagery outside the vehicle, (ii) determining, by the server computer system, a configuration that controls use of the provider computing device to provide street-level image data captured by the camera to the server computer system, (iii) sending, by the server computer system, the configuration to the computing device, and (iv) receiving, from the computing device, street-level image data captured by the computing device using the camera responsive to the configuration. Various other methods, systems, and computer-readable media are also disclosed.

Claims (34)

1 . A computer-implemented method comprising:

identifying, by a server computer system, a provider computing device for use in capturing street-level imagery, wherein the provider computing device controls a camera positioned to capture street-level imagery outside a vehicle associated with the provider computing device;

sending, by the server computer system, instructions to the provider computing device indicating that the camera of the provider computing device is to capture street-level image data;

receiving, by the server computer system, street-level image data captured by the provider computing device using the camera responsive to the instructions, the received street-level image data including one or more features extracted from the street-level image data, the street-level image data including at least one subsequent image of a map feature that has changed, wherein the camera, in further response to the instructions, captures a minimum threshold number of images of the changed map feature;

accessing, by the server computer system, a map for a specified region that includes one or more map features for the region; and

updating, by the server computer system, the map features based on at least one of the extracted features from the street-level image data,

wherein the updating is performed upon determining that at least one of the map features has changed from an initial state to a subsequent, different state, and

wherein the changed map features are updated after a specified time delay has passed, the specified time delay being varied based on a number of secondary provider computing devices that are capturing the changed map features.

2 . The computer-implemented method of claim 1 , wherein the updating is performed upon reaching the minimum threshold number of images of the changed map feature.

3 . The computer-implemented method of claim 1 , wherein the changed map feature comprises a temporary change for the map feature that, at a subsequent point in time, returns from the subsequent, different state to the initial state.

4 . The computer-implemented method of claim 3 , further comprising, upon determining that the temporary change for the map feature has returned to the initial state, updating, by the server computer system, the changed map feature in the map.

5 . The computer-implemented method of claim 1 , further comprising instructing, by the server computer system, one or more of the secondary provider computing devices to capture secondary street-level image data of the changed map features.

6 . A system comprising:

at least one provider computing device, associated with a vehicle, with at least one hardware processor; and

a server computer system, wherein the server computer system:

identifies a provider computing device for use in capturing street-level imagery, wherein the provider computing device controls a camera positioned to capture street-level imagery outside a vehicle associated with the provider computing device;

sends instructions to the provider computing device indicating that the camera of the provider computing device is to capture street-level image data;

receives street-level image data captured by the provider computing device using the camera responsive to the instructions, the received street-level image data including one or more features extracted from the street-level image data, the street-level image data including at least one subsequent image of a map feature that has changed, wherein the camera, in further response to the instructions, captures a minimum threshold number of images of the changed map feature;

accesses a map for a specific region that includes one or more map features for the region; and

updates the map features based on at least one of the extracted features from the street-level image data,

wherein the updating is performed upon determining that at least one of the map features has changed from an initial state to a subsequent, different state, and

wherein the changed map features are updated after a specified time delay has passed, the specified time delay being varied based on a number of secondary provider computing devices that are capturing the changed map features.

7 . The system of claim 6 , wherein the updating is performed upon reaching the minimum threshold number of images of the changed map feature.

8 . The system of claim 6 , wherein the changed map feature comprises a temporary change for the map feature that, at a subsequent point in time, returns from the subsequent, different state to the initial state.

9 . The system of claim 8 , further comprising, upon determining that the temporary change for the map feature has returned to the initial state, updating, by the server computer system, the changed map feature in the map.

10 . The system of claim 6 , wherein one or more of the secondary provider computing devices is instructed to capture secondary street-level image data of the changed map features.

11 . A non-transitory computer-readable medium comprising one or more computer-readable instructions that, when executed by at least one processor of a computing device, cause the computing device to:

identify a provider computing device for use in capturing street-level imagery, wherein the provider computing device controls a camera positioned to capture street-level imagery outside a vehicle associated with the provider computing device;

send instructions to the provider computing device indicating that the camera of the provider computing device is to capture street-level image data;

receive street-level image data captured by the provider computing device using the camera responsive to the instructions, the received street-level image data including one or more features extracted from the street-level image data, the street-level image data including at least one subsequent image of a map feature that has changed, wherein the camera, in further response to the instructions, captures a minimum threshold number of images of the changed map feature;

access a map for a specific region that includes one or more map features for the region; and

update the map features based on at least one of the extracted features from the street-level image data,

wherein the updating is performed upon determining that at least one of the map features has changed from an initial state to a subsequent, different state, and

wherein the changed map features are updated after a specified time delay has passed, the specified time delay being varied based on a number of secondary provider computing devices that are capturing the changed map features.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2023
From: PARK, RENEE; SARAF, SAURABH; SARUKKAI, RAMESH; SHET, VINAY
To: LYFT, INC.
Reel/Frame 065727/0595 →
SECURITY INTEREST Recorded Nov 3, 2022
From: LYFT, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 061880/0237 →
Continuity (4)
Continuation 16890377 · Jun 2, 2020
Continuation 16237159 · Dec 31, 2018
Continuation 15920438 · Mar 13, 2018
Related Publication 20220353475A1 · Nov 3, 2022
References Cited (46)
US 8612465B1 · Brewington · 2013 [cited by applicant]
US 8634980B1 · Urmson · 2014 [cited by examiner]
US 9613455B1 · Nelson · 2017 [cited by examiner]
US 9679487B1 · Hayward · 2017 [cited by applicant]
US 9836962B1 · Hayward · 2017 [cited by applicant]
US 10218941B1 · Park et al. · 2019 [cited by applicant]
US 10687024B2 · Park et al. · 2020 [cited by applicant]
US 20020085095A1 · Janssen · 2002 [cited by applicant]
US 20090201370A1 · Otsuka et al. · 2009 [cited by applicant]
US 20140309789A1 · Ricci · 2014 [cited by applicant]
US 20150350607A1 · Kim et al. · 2015 [cited by applicant]
US 20160214533A1 · Doyle · 2016 [cited by examiner]
US 20170034110A1 · Bijor et al. · 2017 [cited by applicant]
US 20170183015A1 · Phelan et al. · 2017 [cited by applicant]
US 20180003511A1 · Browing et al. · 2018 [cited by applicant]
US 20180012091A1 · Ricci · 2018 [cited by applicant]
US 20180151066A1 · Oba · 2018 [cited by examiner]
US 20180253424A1 · Banerjee et al. · 2018 [cited by applicant]
US 20230237799A1 · Mugura · 2023 [cited by examiner]
AU 2019236493A1 · 2020 [cited by applicant]
CA 3093833A1 · 2019 [cited by applicant]
CN 102506879A · 2012 [cited by applicant]
CN 103507810A · 2014 [cited by applicant]
CN 104965511A · 2015 [cited by applicant]
CN 106799993A · 2017 [cited by applicant]
CN 206475817U · 2017 [cited by applicant]
CN 107272037A · 2017 [cited by applicant]
IL 277289A · 2020 [cited by applicant]
JP 2013120187A · 2013 [cited by applicant]
JP 2017060164A · 2017 [cited by applicant]
WO 2019178168A1 · 2019 [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 15/920,438 dated Aug. 10, 2018, 20 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 15/920,438 dated Oct. 11, 2018, 26 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/237,159 dated Sep. 25, 2019, 23 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/237,159 dated Apr. 6, 2020, 21 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/890,377 dated Aug. 31, 2020, 28 pages. [cited by applicant]
Final Office Action received for U.S. Appl. No. 16/890,377 dated Feb. 24, 2021, 31 pages. [cited by applicant]
Non-Final Office Action received for U.S. Appl. No. 16/890,377 dated May 25, 2021, 28 pages. [cited by applicant]
Notice of Allowance received for U.S. Appl. No. 16/890,377 dated Mar. 22, 2022, 29 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application Serial No. PCT/US2019/021947 dated Jul. 2, 2019, 11 pages. [cited by applicant]
Examination Report No. 1 received for Australian Patent Application Serial No. 2019236493 dated Sep. 29, 2020, 4 pages. [cited by applicant]
First Office Action received for Canadian Patent Application Serial No. 3,093,833 dated Oct. 27, 2020, 9 pages. [cited by applicant]
International Preliminary Report on Patentability received for PCT Application Serial No. PCT/US2019/021947 dated Sep. 24, 2020, 8 pages. [cited by applicant]
Second Office Action received for Canadian Patent Application Serial No. 3,093,833 dated Mar. 11, 2021, 7 pages. [cited by applicant]
First Office Action received for Chinese Patent Application No. 201980032116.4 dated Aug. 19, 2022, 10 pages (including English Translation). [cited by applicant]
Extended European Search Report received for Application No. 19767956.6 dated Nov. 12, 2021, 9 pages. [cited by applicant]