Granted Patent B2

US 12,447,997 · App. 18/364,505 · Granted Oct 21, 2025

Inventors: Bo Yu (Troy, MI); Gui Chen (Sterling Heights, MI); Fan Bai (Ann Arbor, MI); Shuqing Zeng (Sterling Heights, MI); Joon Hwang (Pflugerville, TX); Mason David Gemar (Cedar Park, TX)

Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC

B60W60/001G01C21/3822G06T11/60G06V20/588B60W2556/50

Abstract

Claims (75)

1. A method for merging lane line maps, the method comprising:

determining a road topology of a road segment, wherein determining the road topology of the road segment further comprises:

retrieving topology data about the road segment; and

determining a plurality of virtual lateral lines based at least in part on the topology data about the road segment, wherein each of the plurality of virtual lateral lines is perpendicular to the road segment, and wherein the plurality of virtual lateral lines are evenly spaced along a length of the road segment;

identifying a plurality of fused points based at least in part on the road topology and based at least in part on a first lane line map of the road segment and a second lane line map of the road segment, wherein identifying the plurality of fused points further comprises:

determining a plurality of corresponding point pairs, wherein each of the plurality of corresponding point pairs includes a first point and a second point, and wherein each of the plurality of corresponding point pairs corresponds to one of the plurality of virtual lateral lines; and

fusing each of the plurality of corresponding point pairs to form the plurality of fused points, wherein each of the plurality of fused points is located between the first point and the second point of one of the plurality of corresponding point pairs;

forming a fused lane line map based at least in part on the plurality of fused points; and

controlling a path of a vehicle using an automated driving system based at least in part on the fused lane line map.

2. The method of claim 1 , wherein determining the plurality of corresponding point pairs further comprises:

selecting a first of the plurality of virtual lateral lines;

shifting a subset of a plurality of points of the first lane line map towards a plurality of points of the second lane line map based at least in part on the first of the plurality of virtual lateral lines;

identifying a first plurality of intersecting points, wherein each of the first plurality of intersecting points is one of the plurality of points of the first lane line map, and wherein each of the first plurality of intersecting points intersects with the first of the plurality of virtual lateral lines;

identifying a second plurality of intersecting points, wherein each of the second plurality of intersecting points is one of the plurality of points of the second lane line map, and wherein each of the second plurality of intersecting points intersects with the first of the plurality of virtual lateral lines;

determining one of the plurality of corresponding point pairs based at least in part on the first plurality of intersecting points and the second plurality of intersecting points, wherein the first point of the one of the plurality of corresponding point pairs is from the first plurality of intersecting points and the second point of the one of the plurality of corresponding point pairs is from the second plurality of intersecting points, and wherein a distance between the first point and the second point is less than or equal to a predetermined corresponding point pair distance threshold; and

repeating the selecting step, the shifting step, the identifying steps, and the determining step until each of the plurality of virtual lateral lines has been selected.

3. The method of claim 2 , shifting the subset of the plurality of points of the first lane line map further comprises:

selecting the subset of the plurality of points of the first lane line map, wherein each of the subset of the plurality of points of the first lane line map is within a circle centered at one of the plurality of virtual lateral lines; and

shifting the subset of the plurality of points of the first lane line map towards the plurality of points of the second lane line map using an iterative closest point algorithm, wherein the subset of the plurality of points of the first lane line map is only shifted along a lateral axis, and wherein the lateral axis is parallel to the one of the plurality of virtual lateral lines.

4. The method of claim 2 , wherein determining the one of the plurality of corresponding point pairs further comprises:

identifying the first point and the second point, wherein a traffic direction of the first point corresponds with a traffic direction of the second point.

5. The method of claim 4 , wherein identifying the first point and the second point further comprises:

determining a traffic direction of each of the first plurality of intersecting points, wherein the traffic direction of each of the first plurality of intersecting points includes one of: a left traffic direction and a right traffic direction;

determining a traffic direction of each of the second plurality of intersecting points, wherein the traffic direction of each of the second plurality of intersecting points includes one of: the left traffic direction and the right traffic direction; and

identifying the first point and the second point, wherein the first point is one of the first plurality of intersecting points having the left traffic direction and the second point is one of the second plurality of intersecting points having the left traffic direction.

6. The method of claim 1 , wherein forming the fused lane line map further comprises:

plotting a lane line between each of the plurality of fused points, wherein the lane line is substantially parallel to the road segment.

7. A system for merging lane line maps for a vehicle, the system comprising:

a camera system;

an automated driving system;

a vehicle communication system; and

a vehicle controller in electrical communication with the camera system, the automated driving system, and the vehicle communication system, wherein the vehicle controller is programmed to:

generate a first lane line map of a road segment in an environment surrounding the vehicle using the camera system;

receive a second lane line map of the road segment using the vehicle communication system;

identify a plurality of fused points based at least in part on the first lane line map and the second lane line map, wherein to identify the plurality of fused points, the vehicle controller is further programmed to:

determine a plurality of virtual lateral lines, wherein each of the plurality of virtual lateral lines is perpendicular to the road segment, and wherein the plurality of virtual lateral lines are evenly spaced along a length of the road segment;

determine a plurality of corresponding point pairs, wherein each of the plurality of corresponding point pairs includes a first point and a second point, and wherein each of the plurality of corresponding point pairs corresponds to one of the plurality of virtual lateral lines; and

fuse each of the plurality of corresponding point pairs to form the plurality of fused points, wherein each of the plurality of fused points is located between the first point and the second point of one of the plurality of corresponding point pairs;

form a fused lane line map based at least in part on the plurality of fused points; and

control a path of the vehicle using the automated driving system based at least in part on the fused lane line map.

8. The system of claim 7 , wherein to determine one of the plurality of corresponding point pairs, the vehicle controller is further programmed to:

select a first of the plurality of virtual lateral lines;

shift a subset of a plurality of points of the first lane line map towards a plurality of points of the second lane line map based at least in part on the first of the plurality of virtual lateral lines;

identify a first plurality of intersecting points, wherein each of the first plurality of intersecting points is one of the plurality of points of the first lane line map, and wherein each of the first plurality of intersecting points intersects with the first of the plurality of virtual lateral lines;

identify a second plurality of intersecting points, wherein each of the second plurality of intersecting points is one of the plurality of points of the second lane line map, and wherein each of the second plurality of intersecting points intersects with the first of the plurality of virtual lateral lines; and

determine the one of the plurality of corresponding point pairs based at least in part on the first plurality of intersecting points and the second plurality of intersecting points, wherein the first point of the one of the plurality of corresponding point pairs is from the first plurality of intersecting points and the second point of the one of the plurality of corresponding point pairs is from the second plurality of intersecting points, and wherein a distance between the first point and the second point is less than or equal to a predetermined corresponding point pair distance threshold.

9. The system of claim 8 , wherein to shift the subset of the plurality of points of the first lane line map, the vehicle controller is further programmed to:

select the subset of the plurality of points of the first lane line map, wherein each of the subset of the plurality of points of the first lane line map is within a circle centered at one of the plurality of virtual lateral lines; and

shift the subset of the plurality of points of the first lane line map towards the plurality of points of the second lane line map using an iterative closest point algorithm, wherein the subset of the plurality of points of the first lane line map is only shifted along a lateral axis, and wherein the lateral axis is parallel to the one of the plurality of virtual lateral lines.

10. The system of claim 8 , wherein to determine the one of the plurality of corresponding point pairs, the vehicle controller is further programmed to:

determine a traffic direction of each of the first plurality of intersecting points, wherein the traffic direction of each of the first plurality of intersecting points includes one of: a left traffic direction and a right traffic direction;

determine a traffic direction of each of the second plurality of intersecting points, wherein the traffic direction of each of the second plurality of intersecting points includes one of: the left traffic direction and the right traffic direction; and

identify the first point and the second point, wherein the first point is one of the first plurality of intersecting points having the left traffic direction and the second point is one of the second plurality of intersecting points having the left traffic direction.

11. A system for merging lane line maps for a vehicle, the system comprising:

a server system, the server system including:

a server communication system; and

a server controller in electrical communication with the server communication system, wherein the server controller is programmed to:

receive a first lane line map and a second lane line map of a road segment using the server communication system;

identify a plurality of fused points based at least in part on the first lane line map and the second lane line map, wherein to identify the plurality of fused points, the server controller is further programmed to:

determine a plurality of virtual lateral lines, wherein each of the plurality of virtual lateral lines is perpendicular to the road segment, and wherein the plurality of virtual lateral lines are evenly spaced along a length of the road segment;

determine a plurality of corresponding point pairs, wherein each of the plurality of corresponding point pairs includes a first point and a second point, and wherein each of the plurality of corresponding point pairs corresponds to one of the plurality of virtual lateral lines, wherein to determine one of the plurality of corresponding point pairs, the server controller is further programmed to:

 select a first of the plurality of virtual lateral lines;

 shift a subset of a plurality of points of the first lane line map towards a plurality of points of the second lane line map based at least in part on the first of the plurality of virtual lateral lines;

 identify a first plurality of intersecting points, wherein each of the first plurality of intersecting points is one of the plurality of points of the first lane line map, and wherein each of the first plurality of intersecting points intersects with the first of the plurality of virtual lateral lines;

 identify a second plurality of intersecting points, wherein each of the second plurality of intersecting points is one of the plurality of points of the second lane line map, and wherein each of the second plurality of intersecting points intersects with the first of the plurality of virtual lateral lines; and

 determine the one of the plurality of corresponding point pairs based at least in part on the first plurality of intersecting points and the second plurality of intersecting points, wherein the first point of the one of the plurality of corresponding point pairs is from the first plurality of intersecting points and the second point of the one of the plurality of corresponding point pairs is from the second plurality of intersecting points, and wherein a distance between the first point and the second point is less than or equal to a predetermined 1 point pair distance threshold; and

generate a plurality of fused points, wherein each of the plurality of fused points is located between the first point and the second point of one of the plurality of corresponding point pairs;

form a fused lane line map based at least in part on the plurality of fused points; and

transmit the fused lane line map using the server communication system; and

a vehicle system, the vehicle system including:

a vehicle communication system;

an automated driving system; and

a vehicle controller in electrical communication with the vehicle communication system and the automated driving system, wherein the vehicle controller is programmed to:

receive the fused lane line map from the server system using the vehicle communication system; and

control a path of the vehicle using the automated driving system based at least in part on the fused lane line map.

Assignments (1)

Continuity (1)

References Cited (36)