IP Library Granted Patent US 10,656,644
Granted Patent B2
US 10,656,644 · App. 15/698,375 · Granted May 19, 2020

System and method for using human driving patterns to manage speed control for autonomous vehicles

Inventors: Wutu Lin (San Diego, CA); Liu Liu (San Diego, CA); Xing Sun (San Diego, CA); Kai-Chieh Ma (San Diego, CA); Zijie Xuan (San Diego, CA); Yufei Zhao (San Diego, CA)
Assignee: TUSIMPLE, INC.
G05D1/0088B60W40/09B60W2720/103G05D2201/0213
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,656,644
App. No.
15/698,375
Granted
May 19, 2020
Kind
B2
Abstract

A system and method for using human driving patterns to manage speed control for autonomous vehicles are disclosed. A particular embodiment includes: generating data corresponding to desired human driving behaviors; training a human driving model module using a reinforcement learning process and the desired human driving behaviors; receiving a proposed vehicle speed control command; determining if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module; and validating or modifying the proposed vehicle speed control command based on the determination.

Claims (36)

1. A system comprising:

a data processor; and

a vehicle speed control module, executable by the data processor, the vehicle speed control module being configured to perform a vehicle speed control command validation operation for an autonomous vehicle, the vehicle speed control command validation operation being configured to:

generate data corresponding to desired human driving behaviors;

train a human driving model module using a reinforcement learning process and the desired human driving behaviors;

receive a proposed vehicle speed control command prior to commanding a vehicle control subsystem to perform a maneuver corresponding to the proposed vehicle speed control command;

determine if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module;

validate or modify the proposed vehicle speed control command based on the determination; and

output the validated or modified vehicle speed control command to the vehicle control subsystem causing the autonomous vehicle to follow a trajectory corresponding to the validated or modified vehicle speed control command.

2. The system of claim 1 being further configured to train the human driving model module using the reinforcement learning process having a simulation training phase and an actual on-the-road training phase.

3. The system of claim 1 being further configured to train the human driving model module by modifying parameters in the human driving model module based on the reinforcement learning process.

4. The system of claim 1 being further configured to train the human driving model module by determining a current state of the autonomous vehicle and determining a deviation between the current state of the autonomous vehicle and a state corresponding to the desired human driving behaviors.

5. The system of claim 1 being further configured to capture data through vehicle sensor subsystems and driving simulation data to model the desired human driving behaviors.

6. The system of claim 1 wherein the data corresponding to desired human driving behaviors are represented as mathematical or data representations.

7. A method comprising:

generating data corresponding to desired human driving behaviors;

training a human driving model module using a reinforcement learning process and the desired human driving behaviors;

receiving a proposed vehicle speed control command prior to commanding a vehicle control subsystem to perform a maneuver corresponding to the proposed vehicle speed control command;

determining if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module;

validating or modifying the proposed vehicle speed control command based on the determination; and

outputting the validated or modified vehicle speed control command to the vehicle control subsystem causing the autonomous vehicle to follow a trajectory corresponding to the validated or modified vehicle speed control command.

8. The method of claim 7 including training the human driving model module using the reinforcement learning process having a simulation training phase and an actual on-the-road training phase.

9. The method of claim 7 including training the human driving model module by modifying parameters in the human driving model module based on the reinforcement learning process.

10. The method of claim 7 including training the human driving model module by determining a current state of the autonomous vehicle and determining a deviation between the current state of the autonomous vehicle and a state corresponding to the desired human driving behaviors.

11. The method of claim 7 including capturing data through vehicle sensor subsystems and driving simulation data to model the desired human driving behaviors.

12. The method of claim 7 wherein the data corresponding to desired human driving behaviors are represented as mathematical or data representations.

13. A non-transitory machine-useable storage medium embodying instructions which, when executed by a machine, cause the machine to:

generate data corresponding to desired human driving behaviors;

train a human driving model module using a reinforcement learning process and the desired human driving behaviors;

receive a proposed vehicle speed control command prior to commanding a vehicle control subsystem to perform a maneuver corresponding to the proposed vehicle speed control command;

determine if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module;

validate or modify the proposed vehicle speed control command based on the determination; and

output the validated or modified vehicle speed control command to the vehicle control subsystem causing the autonomous vehicle to follow a trajectory corresponding to the validated or modified vehicle speed control command.

14. The non-transitory machine-useable storage medium of claim 13 being further configured to train the human driving model module using the reinforcement learning process having a simulation training phase and an actual on-the-road training phase.

15. The non-transitory machine-useable storage medium of claim 13 being further configured to train the human driving model module by modifying parameters in the human driving model module based on the reinforcement learning process.

16. The non-transitory machine-useable storage medium of claim 13 being further configured to train the human driving model module by determining a current state of the autonomous vehicle and determining a deviation between the current state of the autonomous vehicle and a state corresponding to the desired human driving behaviors.

Assignments (3)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0553 →
CHANGE OF NAME Recorded Jan 30, 2020
From: TUSIMPLE
To: TUSIMPLE, INC.
Reel/Frame 051757/0470 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2018
From: SUN, XING; LIN, WUTU; LIU, LIU; MA, KAI-CHIEH; XUAN, ZIJIE; ZHAO, YUFEI
To: TUSIMPLE
Reel/Frame 047467/0776 →
Continuity (1)
Related Publication 20190072960A1 · Mar 7, 2019
Cited By (1)
US 12,554,257