IP Library Granted Patent US 11,879,977
Granted Patent B2
US 11,879,977 · App. 17/216,043 · Granted Jan 23, 2024

System of vehicles equipped with imaging equipment for high-definition near real-time map generation

Inventors: Ro Gupta (Brooklyn, NY); Justin Day (Brooklyn, NY); Chase Nicholl (Brooklyn, NY); Max Henstell (Portland, OR); Ioannis Stamos (Brooklyn, NY); David Boyle (Brooklyn, NY); Ethan Sorrelgreen (Seattle, WA); Huong Dinh (New York, NY)
Assignee: Woven by Toyota, U.S., Inc.
G01S17/88B60R1/00G01C21/3841G01C21/3885G01C21/3893G01S17/86G01S17/89G06T7/11G06V10/17G06V20/58G06V20/584H04W4/44B60R2300/207B60R2300/301B60R2300/302B60R2300/406B60R2300/50G01S17/42G06T2207/30236
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,879,977
App. No.
17/216,043
Granted
Jan 23, 2024
Kind
B2
Abstract

Described are street level intelligence platforms, systems, and methods that can include a fleet of swarm vehicles having imaging devices. Images captured by the imaging devices can be used to produce and/or be integrated into maps of the area to produce high-definition maps in near real-time. Such maps may provide enhanced street level intelligence useful for fleet management, navigation, traffic monitoring, and/or so forth.

Claims (22)

1. A method, comprising:

receiving video depicting street segments from vehicle-mounted smartphones;

bucketizing the video into buckets that are separately associated with segments of the video capturing a street segment from the street segments by one of the vehicle-mounted smartphones;

identifying (i) a selected segment of the street segments for which no video is received during a time interval and (ii) adjacent segments that are adjacent to the selected segment;

calculating a number of pedestrians for each of the adjacent segments during the time interval using image recognition and pedestrian counts for the adjacent segments by dividing the number of pedestrians for each of the adjacent segments by a number of video frames associated with the adjacent segments; and

estimating a pedestrian count for the selected segment according to an average of the pedestrian counts associated with the adjacent segments.

2. The method of claim 1 , wherein video depicting a particular street segment from the street segments is received irregularly.

3. The method of claim 1 , wherein estimating the pedestrian count includes generating histograms of the pedestrian counts observed for the adjacent segments on an hourly basis.

4. A system, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to:

receive video depicting street segments from vehicle-mounted smartphones;

bucketize the video into buckets that are separately associated with segments of the video capturing a street segment from the street segments by one of the vehicle-mounted smartphones;

identify (i) a selected segment of the street segments for which no video is received during a time interval and (ii) adjacent segments that are adjacent to the selected segment;

calculate a number of pedestrians for each of the adjacent segments during the time interval using image recognition and pedestrian counts for the adjacent segments by dividing the number of pedestrians for each of the adjacent segments by a number of video frames associated with the adjacent segments; and

estimate a pedestrian count for the selected segment according to an average of the pedestrian counts associated with the adjacent segments.

5. A non-transitory computer-readable medium storing instructions that, when execute by an electronic processor, cause the electronic processor to:

receive video depicting street segments from vehicle-mounted smartphones;

bucketize the video into buckets that are separately associated with segments of the video capturing a street segment from the street segments by one of the vehicle-mounted smartphones;

identify (i) a selected segment of the street segments for which no video is received during a time interval and (ii) adjacent segments that are adjacent to the selected segment;

calculate a number of pedestrians for each of the adjacent segments during the time interval using image recognition and pedestrian counts for the adjacent segments by dividing the number of pedestrians for each of the adjacent segments by a number of video frames associated with the adjacent segments; and

estimate a pedestrian count for the selected segment according to an average of the pedestrian counts associated with the adjacent segments.

Assignments (5)
CHANGE OF NAME Recorded Jun 22, 2023
From: WOVEN PLANET NORTH AMERICA, INC.
To: WOVEN BY TOYOTA, U.S., INC.
Reel/Frame 064065/0601 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2022
From: CARMERA, LLC
To: WOVEN PLANET NORTH AMERICA, INC.
Reel/Frame 060857/0207 →
ENTITY CONVERSION Recorded Aug 22, 2022
From: CARMERA, INC.
To: CARMERA, LLC
Reel/Frame 061296/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2021
From: SORRELGREEN, ETHAN; DINH, HUONG
To: CARMERA, INC.
Reel/Frame 056166/0645 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 7, 2021
From: GUPTA, RO; DAY, JUSTIN; NICHOLL, CHASE; HENSTELL, MAX; STAMOS, IOANNIS; BOYLE, DAVID
To: CARMERA, INC.
Reel/Frame 056166/0677 →