IP Library › Granted Patent US 12,056,815
Granted Patent B2
US 12,056,815 · App. 16/441,866 · Granted Aug 6, 2024

Generating map features based on aerial data and telemetry data

Inventors: Orhan Bulan (Troy, MI); Yehenew G. Mengistu (Sterling Heights, MI); Sheetal Mahesh (Pflugerville, TX); Michael A. Losh (Rochester Hills, MI); David H. Clifford (Royal Oak, MI)
Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
G06T17/05G06F16/29G06V10/80G06V20/182G06V20/588G06T2207/10032
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,056,815
App. No.
16/441,866
Granted
Aug 6, 2024
Kind
B2
Abstract

In one example implementation according to aspects of the present disclosure, a computer-implemented method for generating map features includes receiving, by a processing device, aerial image data. The method further includes receiving, by the processing device, telemetry data. The method further includes performing, by the processing device, data fusion on the aerial image data and the telemetry data to generate map features. The method further includes controlling, by the processing system, a vehicle based at least in part on the map features.

Claims (43)

1. A computer-implemented method for generating map features, the method comprising:

receiving, by a processing device, aerial image data;

receiving, by the processing device, telemetry data;

performing, by the processing device, data fusion on the aerial image data and the telemetry data to generate map features, wherein performing the data fusion further comprises:

receiving geolocations of the start of the road and the end of the road,

extracting nodes, from a navigation map, along the road between the start of the road and the end of the road,

interpolating missing nodes, between the start of the road and the end of the road, to provide coverage for the entire road,

performing image processing analysis of the ariel image data to detect the map features along the road between the start of the road and the end of the road, and

converting the map features to a coordinate format, wherein the coordinate format is a WGS84 coordinate format; and

controlling, by the processing device, a vehicle based at least in part on the map features.

2. The computer-implemented method of claim 1 , wherein performing the data fusion further comprises performing post-processing on the map features to refine the map features.

3. The computer-implemented method of claim 1 , wherein the map features include at least one of a lane width, a curvature, a heading, a lane marking, a lane width, a road edge, a stop bar, or a pedestrian cross-walk.

4. The computer-implemented method of claim 1 , further comprising updating a map having the map features based at least in part on ground survey data.

5. A system in a vehicle comprising:

a memory comprising computer readable instructions; and

a processing device for executing the computer readable instructions for performing a method for generating map features, the method comprising:

receiving, by the processing device, aerial image data;

receiving, by the processing device, telemetry data;

performing, by the processing device, data fusion on the aerial image data and the telemetry data to generate map features, wherein the map features include at least one of a lane width, a curvature, a heading, a lane marking, a lane width, a road edge, a stop bar, or a pedestrian cross-walk, wherein performing the data fusion further comprises:

receiving geolocations of the start of the road and the end of the road,

extracting nodes, from a navigation map, along the road between the start of the road and the end of the road,

interpolating missing nodes, between the start of the road and the end of the road, to provide coverage for the entire road, and

performing image processing analysis of the ariel image data to detect the map features along the road between the start of the road and the end of the road; and

controlling, by the processing system, the vehicle based at least in part on the map features.

6. The system of claim 5 , wherein performing the data fusion further comprises receiving geolocations of a start of a road and an end of the road.

7. The system of claim 6 , wherein performing the data fusion further comprises extracting nodes, from a navigation map, along the road between the start of the road and the end of the road.

8. The system of claim 7 , wherein performing the data fusion further comprises performing image processing analysis to detect the map features.

9. The system of claim 8 , wherein performing the data fusion further comprises converting the map features to a coordinate format.

10. The system of claim 8 , wherein performing the data fusion further comprises performing post-processing on the map features to refine the map features.

11. The system of claim 5 , wherein the method further comprises updating a map having the map features based at least in part on ground survey data.

12. A computer program product comprising:

a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processing device to cause the processing device to perform a method for generating map features, the method comprising:

receiving, by the processing device, aerial image data;

receiving, by the processing device, telemetry data;

performing, by the processing device, data fusion on the aerial image data and the telemetry data to generate map features, wherein the map features include at least one of a lane width, a curvature, a heading, a lane marking, a lane width, a road edge, a stop bar, or a pedestrian cross-walk; and

controlling, by the processing system, a vehicle based at least in part on the map features,

wherein performing the data fusion further comprises:

receiving geolocations of a start of a road and an end of the road;

extracting nodes, from a navigation map, along the road between the start of the road and the end of the road;

interpolating missing nodes, between the start of the road and the end of the road, to provide coverage for the entire road;

performing image processing analysis, on aerial image data for the nodes along the road, to detect the map features along the road between the start to the road and the end of the road;

converting the detected map features to a coordinate format, wherein the coordinate format is a WGS84 coordinate format; and

perform post-processing on the detected map features to refine the detected map features.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2019
From: BULAN, ORHAN; MENGISTU, YEHENEW G.; MAHESH, SHEETAL; LOSH, MICHAEL A.; CLIFFORD, DAVID H.
To: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Reel/Frame 049474/0311 →
Continuity (1)
Related Publication 20200394838A1 · Dec 17, 2020