IP Library Granted Patent US 10,719,083
Granted Patent B2
US 10,719,083 · App. 15/640,370 · Granted Jul 21, 2020

Perception system for autonomous vehicle

Inventors: Brett Browning (Pittsburgh, PA); Narek Melik-Barkhudarov (Pittsburgh, PA); James Andrew Bagnell (Pittsburgh, PA)
Assignee: UATC, LLC
G05D1/0274B60W30/095G01C21/28G01C21/32G01C21/3602G05D1/0088G05D1/024G05D1/0212G05D1/0231G05D1/0246G05D1/0251G05D1/0276G06K9/00791G06K9/00798G06K9/6202G06T7/33G06T7/70H04L67/18G06T2207/10012G06T2207/30252H04L67/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,719,083
App. No.
15/640,370
Granted
Jul 21, 2020
Kind
B2
Abstract

A system to use submaps to control operation of a vehicle is disclosed. A storage system may be provided with a vehicle to store a collection of submaps that represent a geographic area where the vehicle may be driven. A programmatic interface may be provided to receive submaps and submap updates independently of other submaps.

Claims (38)

1. A computer-implemented method for operating a vehicle, the method comprising:

obtaining stored data identifying a set of static objects which are present in an area of a road segment in association with map data indicative of the road segment;

autonomously operating the vehicle to travel on the road segment by:

determining a route for the vehicle to use for travelling for a transport service, wherein the route comprises the road segment;

collecting current sensor data of a scene that includes the area of the road segment, using a sensor set of the vehicle;

determining a plurality of perceived objects of the scene based at least in part on the current sensor data;

determining at least one perceived object that is present in the area of the road segment is a non-static object by subtracting the set of static objects which are present in the area of the road segment from the plurality of perceived objects of the scene;

tracking the at least one perceived object as the vehicle progresses on the road segment, using the sensor set, without tracking any object in the set of static objects by excluding current sensor data associated with any object in the set of static objects for the road segment; and

determining a trajectory for the vehicle to follow based, at least in part, on the route and the at least one perceived object.

2. The computer-implemented method of claim 1 , wherein collecting the current sensor data includes collecting current image data from a camera set of the vehicle.

3. The computer-implemented method of claim 2 , wherein the current image data is recorded from one or more sets of stereoscopic cameras.

4. The computer-implemented method of claim 2 , wherein the stored data comprises stored image data, and wherein determining that the at least one perceived object that is present in the area of the road segment is a non-static object comprises:

comparing the current image data collected from the camera set with the stored image data that identifies the set of static objects in order to determine portions of the current image data which depict one or more of the static objects.

5. The computer-implemented method of claim 4 , wherein determining that the at least one perceived object that is present in the area of the road segment is a non-static object comprises includes ignoring or eliminating the determined portions of the current image data which correspond to the set of static objects.

6. The computer-implemented method of claim 4 , wherein comparing the current image data with the stored image data comprises:

performing a transformation on one of the current image data or the stored image data to account for a variation in lighting as between the current image data and the stored image data.

7. The computer-implemented method of claim 6 , wherein performing the transformation includes altering one or more pixel values of at least one of the current image data or the stored image data for hue, contrast, or brightness.

8. The computer-implemented method of claim 6 , further comprising:

determining a probability that the at least one perceived object will intersect a path of the vehicle or collide with the vehicle.

9. The computer-implemented method of claim 8 , wherein determining the probability is based on a worst-case scenario for the at least one perceived object.

10. The computer-implemented method of claim 6 , wherein performing the transformation includes selecting a transformation based on contextual input that includes at least one of a weather input, day of year input, or time of day input.

11. The computer-implemented method of claim 1 , wherein tracking the at least one perceived object includes determining a trajectory of the at least one perceived object.

12. The computer-implemented method of claim 1 , wherein the stored data includes a set of submaps, each submap of the set of submaps correlating to a respective area of a respective road segment on the route for the vehicle to use on the trip, each submap of the set of submaps including data that identifies a corresponding set of static objects present in the respective area of a the respective road segment for that submap.

13. The computer-implemented method of claim 12 , further comprising:

retrieving the set of submaps based on a determined location of the autonomous vehicle.

14. A computer system comprising:

a memory to store a set of instructions; and

one or more processors to use the instructions to:

obtain stored data that identifies a set of static objects which are present in an area of a road segment in association with map data indicative of the road segment; and

autonomously operate a vehicle to travel on the road segment by:

determining a route for the vehicle to use for travelling for a transport service, wherein the route comprises the road segment

collecting current sensor data of a scene that includes the area of the road segment, using a sensor set of the vehicle;

determining a plurality of perceived objects of the scene based at least in part on the current sensor data;

determining that at least one perceived object that is present in the area of the road segment is a non-static object by subtracting the set of static objects which are present in the area of the road segment from the plurality of perceived objects of the scene;

tracking the at least one perceived object as the vehicle progresses on the road segment, using the sensor set, without tracking any object in the set of static objects by excluding sensor data associated with any object in the set of static objects for the road segment; and

determining a trajectory for the vehicle to follow based, at least in part, on the route and the at least one perceived object.

15. The computer system of claim 14 , wherein the computer system is provided on an autonomous vehicle.

16. The computer system of claim 14 , wherein the computer system communicates with an autonomous vehicle over a network.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: UATC, LLC
To: AURORA OPERATIONS, INC.
Reel/Frame 067733/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE FROM CHANGE OF NAME TO ASSIGNMENT PREVIOUSLY RECORDED ON REEL 050353 FRAME 0884. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECT CONVEYANCE SHOULD BE ASSIGNMENT. Recorded Nov 27, 2019
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 051145/0001 →
CHANGE OF NAME Recorded Sep 12, 2019
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 050353/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2019
From: BROWNING, BRETT
To: UBER TECHNOLOGIES, INC.
Reel/Frame 049986/0702 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2019
From: BAGNELL, JAMES ANDREW; MELIK-BARKHUDAROV, NAREK
To: UBER TECHNOLOGIES, INC.
Reel/Frame 048128/0421 →
Cited By (1)
US 12,691,870