IP Library Granted Patent US 11,175,671
Granted Patent B2
US 11,175,671 · App. 16/003,543 · Granted Nov 16, 2021

Autonomous vehicles featuring machine-learned yield model

Inventors: Colin Jeffrey Green (Pittsburgh, PA); Wei Liu (Pittsburgh, PA); David McAllister Bradley (Canonsburg, PA); Vijay Subramanian (Canonsburg, PA)
Assignee: UATC, LLC
G05D1/0221B60W30/0953B60W30/0956B60W30/18109B60W30/18154G05D1/0088G05D1/0223B60W2555/60G05D2201/0213G08G1/0112G08G1/0129G08G1/09623G08G1/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,175,671
App. No.
16/003,543
Granted
Nov 16, 2021
Kind
B2
Abstract

The present disclosure provides autonomous vehicle systems and methods that include or otherwise leverage a machine-learned yield model. In particular, the machine-learned yield model can be trained or otherwise configured to receive and process feature data descriptive of objects perceived by the autonomous vehicle and/or the surrounding environment and, in response to receipt of the feature data, provide yield decisions for the autonomous vehicle relative to the objects. For example, a yield decision for a first object can describe a yield behavior for the autonomous vehicle relative to the first object (e.g., yield to the first object or do not yield to the first object). Example objects include traffic signals, additional vehicles, or other objects. The motion of the autonomous vehicle can be controlled in accordance with the yield decisions provided by the machine-learned yield model.

Claims (64)

1. A computing system that controls an autonomous vehicle, the computing system comprising:

a machine-learned yield model configured to receive and process feature data descriptive of objects perceived by the autonomous vehicle and, in response, provide yield decisions for the autonomous vehicle relative to the objects;

one or more processors; and

one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:

obtaining first feature data descriptive of a first object perceived by the autonomous vehicle, wherein obtaining the first feature data descriptive of the first object perceived by the autonomous vehicle comprises determining gap data descriptive of a plurality of gaps associated with one or more additional vehicles perceived by the autonomous vehicle, wherein the plurality of gaps comprise one or more temporal gaps that are predicted to occur;

inputting the first feature data into the machine-learned yield model;

receiving a first yield decision as an output of the machine-learned yield model, wherein the first yield decision describes a yield behavior for the autonomous vehicle relative to the first object, wherein the first yield decision instructs the autonomous vehicle to proceed through a particular gap of the plurality of gaps, wherein receiving the first yield decision as the output of the machine-learned yield model comprises

obtaining, through implementation of the machine-learned yield model, a plurality of scores respectively for the plurality of gaps; and

selecting the particular gap of the plurality of gaps based at least in part on the plurality of scores;

generating a motion plan that executes the yield behavior described by the first yield decision output by the machine-learned yield model, wherein generating the motion plan comprises generating a gap penalty for the particular gap of the plurality of gaps, wherein the gap penalty is used to guide motion of the autonomous vehicle through the particular gap; and

controlling motion of the autonomous vehicle based at least in part on the motion plan.

2. The computing system of claim 1 , wherein:

the first object comprises a traffic signal; and

the first feature data descriptive of the first object comprises feature data descriptive of a transition timing associated with the traffic signal.

3. The computing system of claim 1 , wherein the first feature data descriptive of the first object comprises at least one of a required deceleration and a required acceleration associated with the first object.

4. The computing system of claim 1 , wherein:

the first object comprises a traffic signal; and

the first feature data descriptive of the first object comprises feature data descriptive of at least one of:

a stop line location associated with the traffic signal;

a cross traffic line location associated with the traffic signal; and

an exit point location associated with the traffic signal.

5. The computing system of claim 1 , wherein determining gap data descriptive of the plurality of gaps associated with the one or more additional vehicles comprises:

obtaining one or more predicted trajectories respectively generated for the one or more additional vehicles by the autonomous vehicle;

identifying one or more yielding lanes through which the autonomous vehicle will traverse according to a proposed path; and

determining the plurality of gaps for the one or more yielding lanes based at least in part on the one or more predicted trajectories respectively generated for the one or more additional vehicles.

6. The computing system of claim 1 , wherein the operations further comprise:

generating a plurality of gap labels on which the machine-learned yield model is trained, wherein generating the plurality of gap labels comprises:

determining a plurality of example gaps;

determining a plurality of trajectories that respectively traverse through the plurality of example gaps;

determining a plurality of scores respectively for the plurality of trajectories; and

labelling as a positive training example each example gap for which the corresponding trajectory has a score that is greater than a stop score associated with a stop plan and does not violate one or more constraints; and

labelling as a negative training example each example gap for which the corresponding trajectory has a score that is less than the stop score associated with the stop plan or violates at least one of the one or more constraints.

7. The computing system of claim 1 , wherein the machine-learned yield model comprises a machine-learned yield classifier model.

8. The computing system of claim 1 , wherein the machine-learned yield model comprises a machine-learned random forest model or a machine-learned neural network.

9. The computing system of claim 1 , wherein the operations further comprise:

training the machine-learned yield model based at least in part on log data annotated with yield labels, wherein the log data describes yield behaviors performed by autonomous vehicles during previously conducted real-world driving sessions.

10. The computing system of claim 1 , wherein the operations further comprise:

generating a plurality of synthetic autonomous vehicle trajectories;

simulating an outcome for each synthetic autonomous vehicle trajectory;

assigning a yield label for each synthetic autonomous vehicle trajectory based at least in part on the outcome for such synthetic autonomous vehicle trajectory; and

training the machine-learned yield model based at least in part on the yield labels assigned to the synthetic autonomous vehicle trajectories.

11. An autonomous vehicle, comprising:

a machine-learned yield model configured to receive and process feature data descriptive of objects perceived by the autonomous vehicle and, in response, provide yield decisions for the autonomous vehicle relative to the objects;

one or more processors; and

one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:

obtaining first feature data descriptive of a first object perceived by the autonomous vehicle, wherein obtaining the first feature data descriptive of the first object perceived by the autonomous vehicle comprises determining gap data descriptive of a plurality of gaps associated with one or more additional vehicles perceived by the autonomous vehicle, wherein the plurality of gaps comprise one or more temporal gaps that are predicted to occur;

inputting the first feature data into the machine-learned yield model;

receiving a first yield decision as an output of the machine-learned yield model, wherein the first yield decision describes a yield behavior for the autonomous vehicle relative to the first object, wherein the first yield decision instructs the autonomous vehicle to proceed through a particular gap of the plurality of gaps, wherein receiving the first yield decision as the output of the machine-learned yield model comprises

obtaining, through implementation of the machine-learned yield model, a plurality of scores respectively for the plurality of gaps; and

selecting the particular gap of the plurality of gaps based at least in part on the plurality of scores;

generating a motion plan that executes the yield behavior described by the first yield decision output by the machine-learned yield model, wherein generating the motion plan comprises generating a gap penalty for the particular gap of the plurality of gaps, wherein the gap penalty is used to guide motion of the autonomous vehicle through the particular gap; and

controlling motion of the autonomous vehicle based at least in part on the motion plan.

12. The autonomous vehicle of claim 11 , wherein:

the first object comprises a traffic signal; and

the first feature data descriptive of the first object comprises feature data descriptive of a transition timing associated with the traffic signal.

13. The autonomous vehicle of claim 11 , wherein the first feature data descriptive of the first object comprises at least one of a required deceleration and a required acceleration associated with the first object.

14. A computer-implemented method, comprising:

obtaining, by a computing system that comprises one or more computing devices, first feature data descriptive of a first object perceived by an autonomous vehicle, wherein obtaining the first feature data descriptive of the first object perceived by the autonomous vehicle comprises determining, by the computing system, gap data descriptive of a plurality of gaps associated with one or more additional vehicles perceived by the autonomous vehicle, wherein the plurality of gaps comprise one or more temporal gaps that are predicted to occur;

inputting, by the computing system, the first feature data into a machine-learned yield model;

receiving, by the computing system, a first yield decision as an output of the machine-learned yield model, wherein the first yield decision describes a yield behavior for the autonomous vehicle relative to the first object, wherein the first yield decision instructs the autonomous vehicle to proceed through a particular gap of the plurality of gaps, wherein receiving the first yield decision as the output of the machine-learned yield model comprises

obtaining, through implementation of the machine-learned yield model, a plurality of scores respectively for the plurality of gaps; and

selecting the particular gap of the plurality of gaps based at least in part on the plurality of scores;

generating a motion plan that executes the yield behavior described by the first yield decision output by the machine-learned yield model, wherein generating the motion plan comprises generating a gap penalty for the particular gap of the plurality of gaps, wherein the gap penalty is used to guide motion of the autonomous vehicle through the particular gap; and

controlling motion of the autonomous vehicle based at least in part motion plan.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2024
From: UATC, LLC
To: AURORA OPERATIONS, INC.
Reel/Frame 067733/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE NATURE OF CONVEYANCE FROM CHANGE OF NAME TO ASSIGNMENT PREVIOUSLY RECORDED ON REEL 050353 FRAME 0884. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECT CONVEYANCE SHOULD BE ASSIGNMENT. Recorded Nov 27, 2019
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 051145/0001 →
CHANGE OF NAME Recorded Sep 12, 2019
From: UBER TECHNOLOGIES, INC.
To: UATC, LLC
Reel/Frame 050353/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2018
From: GREEN, COLIN JEFFREY; LUI, WEI; BRADLEY, DAVID MCALLISTER; SUBRAMANIAN, VIJAY
To: UBER TECHNOLOGIES, INC.
Reel/Frame 046029/0254 →
Continuity (3)
Continuation 15791646 · Oct 24, 2017
Provisional Application 62569718 · Oct 9, 2017
Related Publication 20190107840A1 · Apr 11, 2019