IP Library › Granted Patent US 12,031,829
Granted Patent B2
US 12,031,829 · App. 17/111,488 · Granted Jul 9, 2024

Localization based on surrounding vehicles

Inventors: Yimu Wang (Pittsburgh, PA); Ning Xu (Pittsburgh, PA); Ajay Charan (Oakmont, PA); Yih-Jye Hsu (Pittsburgh, PA)
Assignee: Motional AD LLC
G01C21/30B60W40/06B60W60/001G01S7/4004G01S7/497G01S13/89G01S17/89G08G1/20B60W2420/408G01S7/4039G01S2007/4975G05D1/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,031,829
App. No.
17/111,488
Granted
Jul 9, 2024
Kind
B2
Abstract

Among other things, techniques are described for identifying sensor data from a sensor of a first vehicle that includes information related to a pose of at least two other vehicles on a road. The technique further includes determining a geometry of a portion of the road based at least in part on the information about the pose of the at least two other vehicles. The technique further includes comparing the geometry of the portion of the road with map data to identify a match between the portion of the road and a portion of the map data. The technique further includes determining a pose of the first vehicle relative to the map data based at least in part on the match.

Claims (44)

1. A computer-implemented method, comprising:

identifying, with at least one processor, sensor data from a sensor of a first vehicle, wherein the sensor data includes information related to a pose of at least two other vehicles on a road;

determining, with the at least one processor, a geometry of a portion of the road based at least in part on the information about the pose of the at least two other vehicles;

comparing, with the at least one processor, the geometry of the portion of the road with map data to identify a match between the portion of the road and a portion of the map data;

determining a pose of the first vehicle relative to the map data based at least in part on the match; and

causing, with a control circuit, the vehicle to navigate based at least in part on the determined pose.

2. The method of claim 1 , wherein the sensor is a visual sensor or a range sensor.

3. The method of claim 1 , wherein the sensor data includes information about a location of respective ones of the at least two other vehicles relative to the first vehicle.

4. The method of claim 1 , wherein the sensor data includes information about an orientation of respective ones of the at least two other vehicles relative to the first vehicle.

5. The method of claim 1 , wherein the portion of the road is a lane of the road.

6. The method of claim 1 , wherein determining the pose of the first vehicle includes determining a position and orientation of the first vehicle relative to the map data based at least in part on the match.

7. One or more non-transitory computer-readable media comprising instructions that, upon execution of the instructions by one or more processors, are to cause a vehicle to:

identify sensor data from a sensor of a first vehicle, wherein the sensor data includes information related to a pose of at least two other vehicles on a road;

determine a geometry of a portion of the road based at least in part on the information about the poses of the at least two other vehicles on the road, wherein the information is captured by a sensor of the vehicle;

compare the geometry of the portion of the road with map data to identify a match between the portion of the road and a portion of the map data;

determine a pose of the first vehicle relative to the map data based at least in part on the match; and

cause the vehicle to navigate based at least in part on the determined pose.

8. The one or more non-transitory computer-readable media of claim 7 , wherein the instructions are further to determine an accuracy of the pose of the first vehicle relative to the map data based at least in part on a quality of the match between the portion of the road and the portion of the map data.

9. The one or more non-transitory computer-readable media of claim 7 , wherein the instructions are further to determine an accuracy of the pose of the first vehicle relative to the map data based at least in part on a number of the at least two other vehicles.

10. The one or more non-transitory computer-readable media of claim 7 , wherein the pose of the first vehicle is a first pose, and the instructions are further to:

determine an accuracy of the first pose of the first vehicle relative to the map data; and

in response to a determination that the accuracy of the first pose does not satisfy a predefined threshold, execute a localization process to determine a second pose of the first vehicle relative to the map data.

11. The one or more non-transitory computer-readable media of claim 10 , wherein the instructions are further to:

average the first pose and the second pose to determine an average pose for the first vehicle relative to the map data.

12. A vehicle comprising:

a sensor;

one or more processors; and

one or more non-transitory computer-readable media comprising instructions that, upon execution of the instructions by the one or more processors, are to cause the vehicle to:

identify sensor data from the sensor of the vehicle, wherein the sensor data includes information related to a pose of at least two other vehicles on a road;

determine a geometry of a portion of the road based at least in part on the information about the pose of the at least two other vehicles;

compare the geometry of the portion of the road with map data to identify a match between the portion of the road and a portion of the map data;

determine a pose of the vehicle relative to the map data based at least in part on the match; and

cause the vehicle to navigate based at least in part on the determined pose.

13. The vehicle of claim 12 , wherein the instructions are further to identify the sensor data from the sensor in response to a determination that the vehicle is traveling on a highway.

14. The vehicle of any claim 12 , wherein the instructions are further to identify the sensor data from the sensor in response to a determination that the sensor is obstructed.

15. The vehicle of claim 12 , wherein the instructions are further to identify the sensor data from the sensor in response to a determination that an accuracy of a pose of the vehicle relative to the map data produced by a localization process does not satisfy a predefined threshold.

16. The vehicle of claim 12 , wherein the instructions are further to:

determine a previous location of the vehicle; and

compare the geometry of the portion of the road with map data for the previous location of the vehicle to identify the match between the portion of the road and the portion of the map data.

17. The vehicle of claim 12 , wherein comparison of the geometry of the portion of the road with the map data includes performance of a convolution of the determined geometry of the portion of the road and the map data.

18. The vehicle of claim 12 , wherein the instructions are further to:

determine a pose of the vehicle relative to the geometry of the portion of the road; and

wherein determination of the pose of the vehicle relative to the map data based at least in part on the match includes mapping the pose of the vehicle relative to the geometry of the portion of the road to the map data.

19. The vehicle of claim 12 , wherein the sensor is a visual sensor or a range sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2020
From: WANG, YIMU; XU, NING; CHARAN, AJAY; HSU, YIH-JYE
To: MOTIONAL AD LLC
Reel/Frame 054540/0224 →
Continuity (1)
Related Publication 20220178700A1 · Jun 9, 2022
Cited By (1)
US 12,386,034