IP Library Granted Patent US 11,885,893
Granted Patent B2
US 11,885,893 · App. 16/988,094 · Granted Jan 30, 2024

Localization based on predefined features of the environment

Inventors: Dana Miller (Pittsburgh, PA); James Esper (Pittsburgh, PA); Theodore Alden (Pittsburgh, PA); Asim Ayaz (Cranberry Township, PA); Michael Oden (Pittsburgh, PA)
Assignee: Motional Ad LLC
G01S19/48B60W40/10B60W60/001B60W2420/52B60W2552/53B60W2554/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,885,893
App. No.
16/988,094
Granted
Jan 30, 2024
Kind
B2
Abstract

The subject matter described in this specification is directed to a computer system and techniques for determining a location of an autonomous vehicle. The computer system is configured to determine the location using localization data from multiple data sources. When the localization data from the multiple data sources is unavailable or inaccurate, the computer system is configured to determine the location using predefined features of the environment.

Claims (58)

1. A system comprising:

one or more computer processors; and one or more non-transitory media storing instructions which, when executed by the one or more computer processors, cause performance of operations comprising:

receiving first localization data of a vehicle and second localization data of the vehicle at a first time, wherein the first localization data is from a first source and the second localization data is from a second source different from the first source;

determining a first difference between the first localization data and the second localization data received at the first time;

based on determining that the first difference between the first localization data and the second localization data satisfies an accuracy criterion, providing a first estimated location of the vehicle based on the first localization data and the second localization data;

receiving first localization data of the vehicle and second localization data of the vehicle at a second time;

determining a second difference between the first localization data and the second localization data received at the second time;

determining that the second difference between the first localization data and the second localization data at the second time does not satisfy the accuracy criterion; and

based on determining that the second difference between the first localization data and the second localization data at the second time does not satisfy the accuracy criterion:

detecting, using one or more images of an environment surrounding the vehicle, one or more predefined features of the environment;

providing a second estimated location of the vehicle based on the one or more predefined features of the environment; and

causing the vehicle to navigate based on the second estimated location of the vehicle.

2. The system of claim 1 , wherein providing the second estimated location of the vehicle based on the one or more predefined features of the environment includes providing the second estimated location of the vehicle without using GPS signals.

3. The system of claim 1 ,

wherein receiving the first localization data and the second localization data at the first time includes:

detecting a landmark in the environment; and

determining a location of the landmark,

wherein providing the first estimated location of the vehicle based at least in part on the first localization data includes providing the first estimated location of the vehicle based at least in part on the location of the landmark.

4. The system of claim 1 , wherein the accuracy criterion is also not satisfied when the first localization data indicates the vehicle is on a roadway with repeating features.

5. The system of claim 1 , wherein the one or more predefined features include a textural pattern of a roadway surface.

6. The system of claim 5 , wherein the instructions cause performance of operations comprising:

detecting the textural pattern of the roadway surface using a high-frequency radar device.

7. The system of claim 5 , wherein the textural pattern of the roadway surface includes predetermined patterns engraved into the roadway surface.

8. The system of claim 1 , wherein the one or more predefined features include predefined location markers positioned along a roadway.

9. The system of claim 8 , wherein a respective predefined location marker identifies a location along the roadway where the respective predefined location marker is positioned.

10. The system of claim 1 , wherein the instructions cause performance of operations comprising:

detecting motion of the vehicle,

wherein providing the second estimated location of the vehicle based on the one or more predefined features of the environment includes providing the second estimated location of the vehicle based on the detected motion of the vehicle and the one or more predefined features of the environment.

11. The system of claim 10 , wherein providing the second estimated location of the vehicle includes determining, based on the detected motion of the vehicle, a relative location of the vehicle with respect to a structure with a known location.

12. A method, comprising:

receiving first localization data of a vehicle and second localization data of the vehicle at a first time, wherein the first localization data is from a first source and the second localization data is from a second source different from the first source;

determining a first difference between the first localization data and the second localization data received at the first time;

based on determining that the first difference between the first localization data and the second localization data satisfies an accuracy criterion, providing a first estimated location of the vehicle based on the first localization data and the second localization data;

receiving first localization data of the vehicle and second localization data of the vehicle at a second time;

determining a second difference between the first localization data and the second localization data received at the second time;

determining that the second difference between the first localization data and the second localization data at the second time does not satisfy the accuracy criterion; and

based on determining that the second difference between the first localization data and the second localization data at the second time does not satisfy the accuracy criterion:

detecting, using one or more images of an environment surrounding the vehicle, one or more predefined features of the environment;

providing a second estimated location of the vehicle based on the one or more predefined features of the environment; and

causing the vehicle to navigate based on the second estimated location of the vehicle.

13. The method of claim 12 , wherein the accuracy criterion is also not satisfied when the first localization data indicates the vehicle is on a roadway with repeating features.

14. The method of claim 12 , wherein the one or more predefined features include a textural pattern of a roadway surface.

15. The method of claim 12 , wherein the one or more predefined features include predefined location markers positioned along a roadway.

16. The method of claim 12 , further comprising:

detecting motion of the vehicle,

wherein providing the second estimated location of the vehicle based on the one or more predefined features of the environment includes providing the second estimated location of the vehicle based on the detected motion of the vehicle and the one or more predefined features of the environment.

17. The method of claim 16 , wherein providing the second estimated location of the vehicle includes determining, based on the detected motion of the vehicle, a relative location of the vehicle with respect to a structure with a known location.

18. One or more non-transitory media storing instructions which, when executed by one or more computing devices, cause performance of operations comprising:

receiving first localization data of a vehicle and second localization data of the vehicle at a first time, wherein the first localization data is from a first source and the second localization data is from a second source different from the first source;

determining a first difference between the first localization data and the second localization data received at the first time;

based on determining that the first difference between the first localization data and the second localization data satisfies an accuracy criterion, providing a first estimated location of the vehicle based on the first localization data and the second localization data;

receiving first localization data of the vehicle and second localization data of the vehicle at a second time;

determining a second difference between the first localization data and the second localization data received at the second time;

determining that the second difference between the first localization data and the second localization data at the second time does not satisfy the accuracy criterion; and

based on determining that the second difference between the first localization data and the second localization data at the second time does not satisfy the accuracy criterion:

detecting, using one or more images of an environment surrounding the vehicle, one or more predefined features of the environment;

providing a second estimated location of the vehicle based on the one or more predefined features of the environment; and

causing the vehicle to navigate based on the second estimated location of the vehicle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2020
From: APTIV TECHNOLOGIES LIMITED
To: MOTIONAL AD LLC
Reel/Frame 054146/0819 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2020
From: MILLER, DANA; ESPER, JAMES; ALDEN, THEODORE; AYAZ, ASIM; ODEN, MICHAEL
To: APTIV TECHNOLOGIES LIMITED
Reel/Frame 053511/0517 →