IP Library Granted Patent US 11,624,618
Granted Patent B2
US 11,624,618 · App. 16/915,468 · Granted Apr 11, 2023

Pavement marking map change detection, reaction, and live tile shipping

Inventors: Juan Fasola (San Francisco, CA); Harman Kumar (San Francisco, CA); Shreyans Kushwaha (San Francisco, CA); Xiaoyu Zhou (San Francisco, CA); Yu-Cheng Lin (San Francisco, CA)
Assignee: GM Cruise Holdings LLC.
G01C21/32G01S17/89G05D1/0274G05D1/0088G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,624,618
App. No.
16/915,468
Filed
Jun 29, 2020
Granted
Apr 11, 2023
Kind
B2
Art Unit
3664
USPC
701/450
Abstract

Systems, methods, and computer-readable media are provided for detecting a pavement marking around an autonomous vehicle, comparing the detected pavement marking with a pavement marking present in a semantic data map, determining whether a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map, and updating the semantic data map based on the determining of whether the change has occurred between the detected pavement marking and the pavement marking present in the semantic data map.

Claims (47)

1. A computer-implemented method comprising:

detecting, by a light detection and ranging sensor (LiDAR) installed on an autonomous vehicle, a pavement marking around the autonomous vehicle to produce a detected pavement marking defined by points of a point cloud generated by the LiDAR;

comparing, by at least one processor, the points of the point cloud defining the detected pavement marking with corresponding data map points of a pavement marking present in a semantic data map;

determining, by the at least one processor and based on the comparing, that a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map; and

updating, by the at least one processor, the semantic data map based on the change to produce an updated semantic data map, wherein the updating comprises:

generating, by the at least one processor, geospatial tiles around the autonomous vehicle, wherein the geospatial tiles are local LiDAR intensity tiles or colorized tiles;

determining a category of the detected pavement marking;

based on the category, selecting between generating the local LiDAR intensity tiles or generating the colorized tiles for the geospatial tiles, wherein the geospatial tiles include different colors based on a degree of the change between each set of the points of the point cloud corresponding to a set of the corresponding data map points, each set of the points of the point cloud corresponding to a geospatial tile of the geospatial tiles; and

designating, by the at least one processor, on the semantic data map, each geospatial tile of the geospatial tiles that is associated with the detected pavement marking.

2. The computer-implemented method of claim 1 , wherein the pavement marking is a lane line or a crosswalk.

3. The computer-implemented method of claim 1 , wherein the change that has occurred between the detected pavement marking and the pavement marking present in the semantic data map is a threshold that is exceeded between the detected pavement marking and the pavement marking present in the semantic data map.

4. The computer-implemented method of claim 1 , further comprising providing the updated semantic data map to an autonomous vehicle fleet.

5. The method of claim 1 , further comprising:

requesting, depending on the category of the detected pavement marking and the degree of the change between each set of the points of the point cloud corresponding to a set of the corresponding data map points, a level of assistance from a remote operator necessary to operate the autonomous vehicle.

6. A system comprising:

one or more processors; and

at least one computer-readable storage medium having stored therein instructions that, when executed by the one or more processors, cause the system to:

detect, by a light detection and ranging sensor (LiDAR) installed on an autonomous vehicle, a pavement marking around the autonomous vehicle to produce a detected pavement marking defined by points of a point cloud generated by the LiDAR;

compare the points of the point cloud defining the detected pavement marking with corresponding data map points of a pavement marking present in a semantic data map;

determine, based on the comparing, whether a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map; and

update the semantic data map based on the determination of whether the change has occurred between the detected pavement marking and the pavement marking present in the semantic data map, wherein to update the semantic data map, the instructions, when executed by the one or more processors, further cause the system to:

generate geospatial tiles around the autonomous vehicle, wherein the geospatial tiles are local LiDAR intensity tiles or colorized tiles;

determine a category of the detected pavement marking;

based on the category, select between generating the local LiDAR intensity tiles or generating the colorized tiles for the geospatial tiles, wherein the geospatial tiles vary based on a category of the detected pavement marking and a degree of the change between each set of the points of the point cloud corresponding to a set of the corresponding data map points, wherein each set of the points of the point cloud correspond to a geospatial tile of the geospatial tiles; and

designate on the semantic data map each geospatial tile of the geospatial tiles that is associated with the detected pavement marking.

7. The system of claim 6 , wherein the pavement marking is a lane line or a crosswalk.

8. The system of claim 6 , wherein the change that has occurred between the detected pavement marking and the pavement marking present in the semantic data map is a threshold that is exceeded between the detected pavement marking and the pavement marking present in the semantic data map.

9. The system of claim 6 , wherein the instructions, when executed by the one or more processors, further cause the system to provide the updated semantic data map to an autonomous vehicle fleet.

10. The system of claim 6 , wherein the category of the detected pavement marking is determined by at least one of a type of the pavement marking, a purpose for the pavement marking, or a threshold level of change to the pavement marking.

11. The system of claim 6 , wherein the instructions, when executed by the one or more processors, further cause the system to:

request, depending on the category of the detected pavement marking and the degree of the change between each set of the points of the point cloud corresponding to a set of the corresponding data map points, a level of assistance from a remote operator necessary to operate the autonomous vehicle.

12. A non-transitory computer-readable storage medium comprising:

instructions, stored on the non-transitory computer-readable storage medium, that, when executed by one or more processors, cause the one or more processors to:

detect, by a light detection and ranging sensor (LiDAR) installed on an autonomous vehicle, a pavement marking around the autonomous vehicle to produce a detected pavement marking defined by points of a point cloud generated by the LiDAR;

compare the points of the point cloud defining the detected pavement marking with corresponding data map points of a pavement marking present in a semantic data map;

determine, based on the comparing, whether a change has occurred between the detected pavement marking and the pavement marking present in the semantic data map; and

update the semantic data map based on the determination of whether the change has occurred between the detected pavement marking and the pavement marking present in the semantic data map, wherein to update the semantic data map, the instructions, when executed by the one or more processors, further cause the one or more processors to:

generate geospatial tiles around the autonomous vehicle, wherein the geospatial tiles are local LiDAR intensity tiles or colorized tiles;

determine a category of the detected pavement marking;

based on the category, select between generating the local LiDAR intensity tiles or generating the colorized tiles for the geospatial tiles, wherein the geospatial tiles vary based on a category of the detected pavement marking and a degree of the change between each set of the points of the point cloud corresponding to a set of the corresponding data map points, wherein each set of the points of the point cloud correspond to a geospatial tile of the geospatial tiles; and

designate on the semantic data map each geospatial tile of the geospatial tiles that is associated with the detected pavement marking.

13. The non-transitory computer-readable storage medium of claim 12 , wherein the pavement marking is a lane line or a crosswalk.

14. The non-transitory computer-readable storage medium of claim 12 , wherein the change that has occurred between the detected pavement marking and the pavement marking present in the semantic data map is a threshold that is exceeded between the detected pavement marking and the pavement marking present in the semantic data map.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to provide the updated semantic data map to an autonomous vehicle fleet.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the category of the detected pavement marking is determined by at least one of a type of the pavement marking, a purpose for the pavement marking, or a threshold level of change to the pavement marking.

17. The non-transitory computer readable storage medium of claim 12 , wherein the instructions, when executed by the one or more processors, further cause the one or more processors to:

request, depending on the category of the detected pavement marking and the degree of the change between each set of the points of the point cloud corresponding to a set of the corresponding data map points, a level of assistance from a remote operator necessary to operate the autonomous vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2020
From: FASOLA, JUAN; KUMAR, HARMAN; KUSHWAHA, SHREYANS; LIN, YU-CHENG; ZHOU, XIAOYU
To: GM CRUISE HOLDINGS LLC
Reel/Frame 053077/0468 →
Continuity (1)
Related Publication 20210404813A1 · Dec 30, 2021
Cited By (1)
US 12,688,706