IP Library Granted Patent US 11,926,346
Granted Patent B2
US 11,926,346 · App. 17/395,318 · Granted Mar 12, 2024

Behavior planning for autonomous vehicles in yield scenarios

Inventors: Fangkai Yang (Seattle, WA); David Nister (Bellevue, WA); Yizhou Wang (San Ramon, CA); Rotem Aviv (San Diego, CA); Julia Ng (San Jose, CA); Birgit Henke (Seattle, WA); Hon Leung Lee (Bellevue, WA); Yunfei Shi (Santa Clara, CA)
Assignee: NVIDIA Corporation
B60W60/0027B60W30/18154B60W30/18159G08G1/096725B60W2420/42B60W2420/52B60W2552/05
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,926,346
App. No.
17/395,318
Filed
Aug 5, 2021
Granted
Mar 12, 2024
Kind
B2
Art Unit
3664
USPC
701/26
Abstract

In various examples, a yield scenario may be identified for a first vehicle. A wait element is received that encodes a first path for the first vehicle to traverse a yield area and a second path for a second vehicle to traverse the yield area. The first path is employed to determine a first trajectory in the yield area for the first vehicle based at least on a first location of the first vehicle at a time and the second path is employed to determine a second trajectory in the yield area for the second vehicle based at least on a second location of the second vehicle at the time. To operate the first vehicle in accordance with a wait state, it may be determined whether there is a conflict between the first trajectory and the second trajectory, where the wait state defines a yielding behavior for the first vehicle.

Claims (69)

1. A method comprising:

identifying a scenario for a first vehicle based at least on analyzing sensor data generated using at least one sensor of the first vehicle in an environment;

determining based at least on the scenario, a first path for the first vehicle to traverse an area in the environment, a second path for a second vehicle to traverse the area, and a wait state corresponding to a state machine including at least a first state and a second state that correspond to respective categories of yield behavior for controlling the first vehicle with respect to one or more contention points between the first path and the second path;

determining, from the first path, a first trajectory that satisfies the respective categories of yield behavior represented by the wait state in the area based at least on a first location of the first vehicle at a time;

determining, from the second path, a second trajectory in the area for the second vehicle based at least on a second location of the second vehicle at the time;

evaluating whether there is a conflict between the first trajectory and the second trajectory;

selecting the wait state for the first vehicle based at least on the evaluating; and

based at least on the selecting of the wait state, controlling the first vehicle to traverse the area using the wait state.

2. The method of claim 1 , furthering comprising:

determining, from the first path, a third trajectory that satisfies at least one category of yield behavior represented by a second wait state in the area based at least on the first location of the first vehicle at the time,

wherein the selecting of the wait state is further based at least on determining a conflict exists between the third trajectory and one or more trajectories corresponding to the second path.

3. The method of claim 1 , wherein the selecting of the wait state is from a plurality of wait states.

4. The method of claim 1 , wherein the controlling includes transitioning between the first state and the second state of the state machine based at least on evaluating one or more transition conditions associated with the wait state.

5. The method of claim 1 , the wait state further corresponds to at least one category of yield behavior for controlling the second vehicle with respect to the one or more contention points between the first path and the second path, and the second trajectory is determined to satisfy the at least one category of yield behavior represented by the wait state in the area.

6. The method of claim 1 , wherein the scenario includes one or more of a crossing scenario with the area including an intersection or a merging scenario with the area including merging lanes.

7. The method of claim 1 , wherein the identifying the scenario includes:

localizing the first vehicle in a map of the environment that identifies a location of the scenario, wherein the map encodes a set of traffic rules for the location;

detecting dynamic traffic signal states of the environment; and

selecting, for the evaluating, at least the wait state as a subset of a plurality of wait states based at least on the wait state corresponding to the set of traffic rules for the location and the dynamic traffic signal states.

8. A processor comprising:

one or more circuits to:

identify a scenario for a first vehicle based at least on analyzing sensor data generated using at least one sensor of the first vehicle in an environment;

determine based at least on the scenario, a first path for the first vehicle to traverse an area in the environment, a second path for a second vehicle to traverse the area, and a wait state corresponding to a state machine including at least a first state and a second state that correspond to respective categories of yield behavior for controlling the first vehicle with respect to one or more contention points between the first path and the second path;

employ the first path to determine a first trajectory that satisfies the respective categories of yield behavior represented by the wait state in the area based at least on a first location of the first vehicle at a time;

employ the second path to determine a second trajectory in the area for the second vehicle based at least on a second location of the second vehicle at the time;

evaluate whether there is a conflict between the first trajectory and the second trajectory;

select the wait state for the first vehicle based at least on the evaluating; and

based at least on the selecting of the wait state, control the first vehicle to traverse the area using the wait state.

9. The processor of claim 8 , wherein the one or more circuits are further to:

determine, from the first path, a third trajectory that satisfies at least one category of yield behavior represented by a second wait state in the area based at least on the first location of the first vehicle at the time,

wherein the selecting of the wait state is further based at least on determining a conflict exists between the third trajectory and one or more trajectories corresponding to the second path.

10. The processor of claim 8 , wherein selecting of the wait state is from a plurality of wait states.

11. The processor claim 8 , wherein the one or more circuits are further to:

determine a first time interval that indicates a first set of temporal coordinates characterizing the first trajectory traversing the area;

determine a second time interval that indicates a second set of temporal coordinates characterizing the second trajectory traversing the area;

determine an intersection of the first set of temporal coordinates and the second set of temporal coordinates; and

determine the conflict between the first trajectory and the second trajectory based on detecting that the intersection of the first set of temporal coordinates and the second set of temporal coordinates is a non-null set.

12. The processor of claim 8 , wherein the first trajectory and the second trajectory are each trajectories within a four-dimensional manifold with at least two spatial dimensions and at least two temporal dimensions.

13. The processor of claim 8 , wherein the scenario includes one or more of a crossing scenario with the area including an intersection or a merging scenario with the area including merging lanes.

14. The processor of claim 8 , wherein the second trajectory simulates the second vehicle accelerating after the time.

15. A system comprising:

one or more processing units to execute actions comprising:

identifying a scenario for a first vehicle based at least on analyzing sensor data generated using at least one sensor of the first vehicle in an environment;

determining based at least on the scenario, a first path for the first vehicle to traverse an area in the environment, a second path for a second vehicle to traverse the area, and a wait state corresponding to a state machine including at least a first state and a second state that correspond to respective categories of yield behavior for controlling the first vehicle with respect to one or more contention points between the first path and the second path;

determining, from the first path, a first trajectory that satisfies the respective categories of yield behavior represented by the wait state in the area based at least on a first location of the first vehicle at a time;

determining, from the second path, a second trajectory in the area for the second vehicle based at least on a second location of the second vehicle at the time;

evaluating whether there is a conflict between the first trajectory and the second trajectory;

selecting the wait state for the first vehicle based at least on the evaluating; and

based at least on the selecting of the wait state, controlling the first vehicle to traverse the area using the wait state.

16. The system of claim 15 , wherein the actions further include:

determining, from the first path, a third trajectory that satisfies at least one category of yield behavior represented by a second wait state in the area based at least on the first location of the first vehicle at the time,

wherein the selecting of the wait state is further based at least on determining a conflict exists between the third trajectory and one or more trajectories corresponding to the second path.

17. The system of claim 15 , wherein the selecting of the wait state is from a plurality of wait states.

18. The system of claim 15 , the actions further comprising:

determining a first time interval that indicates a first set of temporal coordinates characterizing the first trajectory traversing the area;

determining a second time interval that indicates a second set of temporal coordinates characterizing the second trajectory traversing the area;

determining an intersection of the first set of temporal coordinates and the second set of temporal coordinates; and

identifying the conflict between the first trajectory and the second trajectory based on detecting that the intersection of the first set of temporal coordinates and the second set of temporal coordinates is a non-null set.

19. The system of claim 15 , wherein the first trajectory and the second trajectory are each trajectories within a four-dimensional manifold with at least two spatial dimensions and at least two temporal dimensions.

20. The system of claim 15 , comprised in at least one of:

a control computing system for an autonomous or semi-autonomous machine;

a perception computing system for an autonomous or semi-autonomous machine;

a system for performing simulation operations;

a system for performing deep learning operations;

a system implemented using an edge computing device;

a system implemented using a robot;

a system incorporating one or more virtual machines (VMs);

a system implemented at least partially in a data center; or

a system implemented at least partially using cloud computing resources.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2021
From: YANG, FANGKAI; NISTER, DAVID; WANG, YIZHOU; AVIV, ROTEM; NG, JULIA; HENKE, BIRGIT; LEE, HON LEUNG; SHI, YUNFEI
To: NVIDIA CORPORATION
Reel/Frame 057097/0951 →
Continuity (1)
Related Publication 20230037767A1 · Feb 9, 2023
Cited By (3)
US 12,606,207 US 12,698,007 US 12,703,393