IP Library Granted Patent US 11,340,632
Granted Patent B2
US 11,340,632 · App. 16/366,543 · Granted May 24, 2022

Georeferenced trajectory estimation system

Inventors: Robert Zlot (Pittsburgh, PA); Ethan Duff Eade (Pittsburgh, PA); Peter Hansen (Pittsburgh, PA); David Prasser (Pittsburgh, PA); Xxx Xinjilefu (Pittsburgh, PA)
Assignee: UATC, LLC
G05D1/0289G01C21/165G05D1/0255G05D1/0257G05D1/0293G07C5/008G08G1/161G08G1/166H04W4/46G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,340,632
App. No.
16/366,543
Granted
May 24, 2022
Kind
B2
Abstract

A georeferenced trajectory estimation system receives data generated by vehicle sensors from a fleet of vehicles and identifies sets of sensor measurements for a geographic region taken at different times. The sets of sensor measurements include environment geometry data and unaligned trajectory data in local coordinate frames. The georeferenced trajectory estimation system aligns the environment geometry data between sets of sensor measures, and, based on the alignment of the environment geometry data, transforms the identified corresponding trajectory data into a common coordinate frame.

Claims (40)

1. A georeferenced trajectory system for vehicles, the georeferenced trajectory system comprising:

a memory to store instructions; and

one or more processors using the instructions stored in the memory to perform operations including:

accessing a first set of sensor measurements for a geographic region taken by a first vehicle over a first period of time, the first set of sensor measurements comprising first environment geometry data for the geographic region and first trajectory data for the first vehicle referenced to a first local reference frame;

accessing a second set of sensor measurements for the geographic region taken by a second vehicle over a second period of time, the second set of sensor measurements comprising second environment geometry data for the geographic region and second trajectory data referenced to a second local reference frame different than the first local reference frame;

aligning the first environment geometry data with the second environment geometry data;

based on the alignment of the first environment geometry data with the second environment geometry data, transforming the first trajectory data and the second trajectory data into a common coordinate frame;

generating a map based on the common coordinate frame; and

navigating a vehicle using the map based on the common coordinate frame.

2. The georeferenced trajectory system of claim 1 , wherein the first trajectory data comprises a first sequence of poses over the first period of time for the first vehicle, and the second trajectory data comprises a second sequence of poses over the second period of time for the second vehicle.

3. The georeferenced trajectory system of claim 1 , wherein the first trajectory data and the second trajectory data comprise measurements of vehicle position, orientation, force, or motion taken from at least one of an inertial measurement unit, a wheel speed encoder, and a GPS unit.

4. The georeferenced trajectory system of claim 1 , wherein the first environment geometry data and the second environment geometry data are taken from one or more LIDAR units, radar units, sonar units, or cameras.

5. The georeferenced trajectory system of claim 1 , wherein the sets of sensor measurements include LIDAR beam intensity values for the geographic region, and wherein the memory stores further instructions to perform operations including transforming the first trajectory data and the second trajectory data into the common coordinate frame based on an alignment of the LIDAR beam intensity values.

6. The georeferenced trajectory system of claim 1 , wherein the memory stores further instructions to perform operations including aligning environment geometry data from further sets of sensor measurements to transform further trajectory data into the common coordinate frame.

7. The georeferenced trajectory system of claim 1 , wherein the first trajectory data and the second trajectory data are transformed non-rigidly.

8. The georeferenced trajectory system of claim 1 , wherein the first vehicle and the second vehicle are the same vehicle.

9. A method of vehicle trajectory mapping, the method being implemented by one or more processors and comprising:

accessing a first set of sensor measurements for a geographic region taken by a first vehicle over a first period of time, the first set of sensor measurements comprising first environment geometry data for the geographic region and first trajectory data for the first vehicle referenced to a first local reference frame;

accessing a second set of sensor measurements for the geographic region taken by a second vehicle over a second period of time, the second set of sensor measurements comprising second environment geometry data for the geographic region and second trajectory data referenced to a second local reference frame different than the first local reference frame;

aligning the first environment geometry data with the second environment geometry data;

based on the alignment of the first environment geometry data with the second environment geometry data, transforming the first trajectory data and the second trajectory data into a common coordinate frame;

generating a map based on the common coordinate frame; and

navigating a vehicle using the map based on the common coordinate frame.

10. The method of claim 9 , wherein the identifying steps further comprise sensing as the first trajectory data a first sequence of poses over the first period of time for the first vehicle and as the second trajectory data a second sequence of poses over the second period of time for the second vehicle.

11. The method of claim 9 , wherein the identifying steps further comprise measuring vehicle position, orientation, force, or motion taken from at least one of an inertial measurement unit, a wheel speed encoder, and a GPS unit as the first trajectory data and the second trajectory data.

12. The method of claim 9 , wherein the identifying steps further comprise taking the first environment geometry data and the second environment geometry data from one or more LIDAR units, radar units, sonar units, or cameras.

13. The method of claim 9 , wherein the sets of sensor measurements include LIDAR beam intensity values for the geographic region, and wherein transforming the first trajectory data and the second trajectory data into the common coordinate frame is based on an alignment of the LIDAR beam intensity values.

14. The method of claim 9 , further comprising aligning environment geometry data from further sets of sensor measurements to transform further trajectory data into the common coordinate frame.

15. The method of claim 9 , wherein transforming the first trajectory data and the second trajectory data into the common coordinate comprises transforming the first trajectory data and the second trajectory data non-rigidly.

16. The method of claim 9 , wherein the first vehicle and the second vehicle are the same vehicle.

17. A non-transitory computer-readable medium that stores instructions, executable by one or more processors, to cause the one or more processors to perform operations comprising:

accessing a first set of sensor measurements for a geographic region taken by a first vehicle over a first period of time, the first set of sensor measurements comprising first environment geometry data for the geographic region and first trajectory data for the first vehicle referenced to a first local reference frame;

accessing a second set of sensor measurements for the geographic region taken by a second vehicle over a second period of time, the second set of sensor measurements comprising second environment geometry data for the geographic region and second trajectory data referenced to a second local reference frame different than the first local reference frame;

aligning the first environment geometry data with the second environment geometry data;

based on the alignment of the first environment geometry data with the second environment geometry data, transforming the first trajectory data and the second trajectory data into a common coordinate frame;

generating a map based on the common coordinate frame; and

navigating a vehicle using the map based on the common coordinate frame.

18. The medium of claim 17 , further comprising instructions to cause the one or more processors to perform operations including sensing as the first trajectory data a first sequence of poses over the first period of time for the first vehicle and as the second trajectory data a second sequence of poses over the second period of time for the second vehicle.

19. The medium of claim 17 , wherein the sets of sensor measurements include LIDAR beam intensity values for the geographic region, further comprising instructions to cause the one or more processors to perform operations including transforming the first trajectory data and the second trajectory data into the common coordinate frame based on an alignment of the LIDAR beam intensity values.

20. The medium of claim 17 , further comprising instructions to cause the one or more processors to perform operations including aligning environment geometry data from further sets of sensor measurements to transform further trajectory data into the common coordinate frame.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2024
From: UATC, LLC
To: AURORA OPERATIONS, INC.
Reel/Frame 066973/0513 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 24, 2020
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 054461/0341 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2019
From: ZLOT, ROBERT; EADE, ETHAN DUFF; HANSEN, PETER; PRASSER, DAVID; XINJILEFU, XXX
To: UBER TECHNOLOGIES, INC.
Reel/Frame 048762/0412 →
Cited By (1)
US 12,649,493