IP Library Granted Patent US 10,649,458
Granted Patent B2
US 10,649,458 · App. 15/698,607 · Granted May 12, 2020

Data-driven prediction-based system and method for trajectory planning of autonomous vehicles

Inventors: Xing Sun (San Diego, CA); Wutu Lin (San Diego, CA); Liu Liu (San Diego, CA); Kai-Chieh Ma (San Diego, CA); Zijie Xuan (San Diego, CA); Yufei Zhao (San Diego, CA)
Assignee: TUSIMPLE, INC.
G05D1/0221B62D15/026B62D15/0255B62D15/0265G05D1/0088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,649,458
App. No.
15/698,607
Granted
May 12, 2020
Kind
B2
Abstract

A data-driven prediction-based system and method for trajectory planning of autonomous vehicles are disclosed. A particular embodiment includes: generating a first suggested trajectory for an autonomous vehicle; generating predicted resulting trajectories of proximate agents using a prediction module; scoring the first suggested trajectory based on the predicted resulting trajectories of the proximate agents; generating a second suggested trajectory for the autonomous vehicle and generating corresponding predicted resulting trajectories of proximate agents, if the score of the first suggested trajectory is below a minimum acceptable threshold; and outputting a suggested trajectory for the autonomous vehicle wherein the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold.

Claims (39)

1. A system comprising:

an electronic data processor;

one or more vehicle sensor subsystems to generate input object data related to objects detected in proximity to an autonomous vehicle, the input object data including speed and trajectory data corresponding to proximate agents, the proximate agents being vehicles in the vicinity of the autonomous vehicle and detectable by the vehicle sensor subsystems;

a vehicle control subsystem to control the autonomous vehicle; and

a trajectory planning module, executable by the data processor, the trajectory planning module being configured to perform a data-driven prediction-based trajectory planning operation for autonomous vehicles, the trajectory planning operation being configured to:

generate a first suggested trajectory for the autonomous vehicle, the first suggested trajectory configured to comply with pre-defined goals for the autonomous vehicle;

generate a first distribution of predicted resulting trajectories for each of the proximate agents using a prediction module, the first distributions of predicted resulting trajectories being based on the input object data corresponding to the proximate agents and the first suggested trajectory, the predicted resulting trajectories of each of the first distributions having an associated confidence level;

score the first suggested trajectory based on the first distributions of predicted resulting trajectories of the proximate agents, the score corresponding to a level to which the first suggested trajectory complies with the pre-defined goals;

generate a second suggested trajectory for the autonomous vehicle to comply with the pre-defined goals and generate a corresponding second distribution of predicted resulting trajectories for each of the proximate agents using the prediction module, if the score of the first suggested trajectory is below a minimum acceptable threshold, the second distributions of predicted resulting trajectories being based on the input object data corresponding to the proximate agents and the second suggested trajectory, the predicted resulting trajectories of each of the second distributions having an associated confidence level;

output a suggested trajectory for the autonomous vehicle wherein the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold; and

cause the vehicle control subsystem to manipulate the autonomous vehicle to follow the output suggested trajectory.

2. The system of claim 1 wherein the data-driven prediction-based trajectory planning operation includes machine learnable components.

3. The system of claim 1 wherein the output suggested trajectory is dependent upon the predicted resulting trajectories of proximate agents.

4. The system of claim 1 wherein the data-driven prediction-based trajectory planning operation is configured to repeatedly generate distributions of predicted resulting trajectories and their confidence values, until the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold or until a time period or iteration count is exceeded.

5. The system of claim 1 wherein the prediction module is configured to retain information corresponding to predicted trajectories of proximate agents as mathematical or data representations.

6. A method comprising:

using one or more vehicle sensor subsystems to generate input object data related to objects detected in proximity to an autonomous vehicle, the input object data including speed and trajectory data corresponding to proximate agents, the proximate agents being vehicles in the vicinity of the autonomous vehicle and detectable by the vehicle sensor subsystems;

generating, by use of an electronic data processor, a first suggested trajectory for the autonomous vehicle, the first suggested trajectory configured to comply with pre-defined goals for the autonomous vehicle;

generating, by use of the electronic data processor, a first distribution of predicted resulting trajectories for each of the proximate agents using a prediction module, the first distributions of predicted resulting trajectories being based on the input object data corresponding to the proximate agents and the first suggested trajectory, the predicted resulting trajectories of each of the first distributions having an associated confidence level;

scoring, by use of the electronic data processor, the first suggested trajectory based on the first distributions of predicted resulting trajectories of the proximate agents, the score corresponding to a level to which the first suggested trajectory complies with the pre-defined goals;

generating, by use of the electronic data processor, a second suggested trajectory for the autonomous vehicle to comply with the pre-defined goals and generating a corresponding second distribution of predicted resulting trajectories for each of the proximate agents using the prediction module, if the score of the first suggested trajectory is below a minimum acceptable threshold, the second distributions of predicted resulting trajectories being based on the input object data corresponding to the proximate agents and the second suggested trajectory, the predicted resulting trajectories of each of the second distributions having an associated confidence level;

outputting, by use of the electronic data processor, a suggested trajectory for the autonomous vehicle wherein the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold; and

causing a vehicle control subsystem to manipulate the autonomous vehicle to follow the output suggested trajectory.

7. The method of claim 6 including causing a machine to implement a learnable prediction module.

8. The method of claim 6 wherein the output suggested trajectory is dependent upon the predicted resulting trajectories of proximate agents.

9. The method of claim 6 including repeatedly generating distributions of predicted resulting trajectories and their confidence values, until the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold or until a time period or iteration count is exceeded.

10. The method of claim 6 including causing the prediction module to retain information corresponding to predicted trajectories of proximate agents as mathematical or data representations.

11. A non-transitory machine-useable storage medium embodying instructions which, when executed by an electronic data processor, cause the electronic data processor to:

use one or more vehicle sensor subsystems to generate input object data related to objects detected in proximity to an autonomous vehicle, the input object data including speed and trajectory data corresponding to proximate agents, the proximate agents being vehicles in the vicinity of the autonomous vehicle and detectable by the vehicle sensor subsystems;

generate a first suggested trajectory for the autonomous vehicle, the first suggested trajectory configured to comply with pre-defined goals for the autonomous vehicle;

generate a first distribution of predicted resulting trajectories for each of the proximate agents using a prediction module, the first distributions of predicted resulting trajectories being based on the input object data corresponding to the proximate agents and the first suggested trajectory, the predicted resulting trajectories of each of the first distributions having an associated confidence level;

score the first suggested trajectory based on the first distributions of predicted resulting trajectories of the proximate agents, the score corresponding to a level to which the first suggested trajectory complies with the pre-defined goals;

generate a second suggested trajectory for the autonomous vehicle to comply with the pre-defined goals and generate a corresponding second distribution of predicted resulting trajectories for each of the proximate agents, if the score of the first suggested trajectory is below a minimum acceptable threshold, the second distributions of predicted resulting trajectories being based on the input object data corresponding to the proximate agents and the second suggested trajectory, the predicted resulting trajectories of each of the second distributions having an associated confidence level;

output a suggested trajectory for the autonomous vehicle wherein the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold; and

cause a vehicle control subsystem to manipulate the autonomous vehicle to follow the output suggested trajectory.

12. The non-transitory machine-useable storage medium of claim 11 wherein the instructions are further configured to enable machine learning.

13. The non-transitory machine-useable storage medium of claim 11 wherein the output suggested trajectory is dependent upon the predicted resulting trajectories of proximate agents.

14. The non-transitory machine-useable storage medium of claim 11 wherein the instructions are further configured to repeatedly generate distributions of predicted resulting trajectories and their confidence values, until the score corresponding to the suggested trajectory is at or above the minimum acceptable threshold or until a time period or iteration count is exceeded.

15. The non-transitory machine-useable storage medium of claim 11 wherein the prediction module is configured to retain information corresponding to predicted trajectories of proximate agents as mathematical or data representations.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0485 →
CHANGE OF NAME Recorded Jan 30, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 051757/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2018
From: SUN, XING; LIN, WUTU; LIU, LIU; MA, KAI-CHIEH; XUAN, ZIJIE; ZHAO, YUFEI
To: TUSIMPLE
Reel/Frame 044563/0262 →
Continuity (1)
Related Publication 20190072973A1 · Mar 7, 2019
Cited By (5)
US 12,242,274 US 12,384,410 US 12,491,868 US 12,565,067 US 12,589,776