IP Library Granted Patent US 11,983,008
Granted Patent B2
US 11,983,008 · App. 17/654,224 · Granted May 14, 2024

System and method for using human driving patterns to manage speed control for autonomous vehicles

Inventors: Wutu Lin (San Diego, CA); Liu Liu (San Diego, CA); Xing Sun (San Diego, CA); Kai-Chieh Ma (San Diego, CA); Zijie Xuan (San Diego, CA); Yufei Zhao (San Diego, CA)
Assignee: TUSIMPLE, INC.
G05D1/0088B60W40/09B60W2720/103
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,983,008
App. No.
17/654,224
Granted
May 14, 2024
Kind
B2
Abstract

A system and method for using human driving patterns to manage speed control for autonomous vehicles are disclosed. A particular embodiment includes: generating data corresponding to desired human driving behaviors; training a human driving model module using a reinforcement learning process and the desired human driving behaviors; receiving a proposed vehicle speed control command; determining if the proposed vehicle speed control command conforms to the desired human driving behaviors by use of the human driving model module; and validating or modifying the proposed vehicle speed control command based on the determination.

Claims (40)

1. A method, comprising:

receiving a vehicle control command prior to controlling an autonomous vehicle to perform the vehicle control command;

comparing the vehicle control command to standards of driving behavior and validating or modifying the vehicle control command according to the comparing; and

causing the autonomous vehicle to perform the vehicle control command according to the validated or modified vehicle control command.

2. The method of claim 1 , wherein the standards of driving behavior are determined by training a reinforcement learning process comprising training by simulation to generate data from the standards of driving behavior that is compared to data corresponding to human driving behaviors during the simulation.

3. The method of claim 1 , wherein the standards of driving behavior are determined by training a reinforcement learning process comprising training using on-the-road data from the standards of driving behavior that is compared to data corresponding to human driving behaviors captured by sensors of the autonomous vehicle.

4. The method of claim 1 , wherein the standards of driving behavior are determined by training a neural network.

5. The method of claim 1 , further comprising:

updating one or more driving parameters in response to the comparing.

6. The method of claim 5 , wherein the driving parameters comprise:

a speed parameter,

a braking parameter, or

a steering angle parameter of the autonomous vehicle.

7. The method of claim 5 , further comprising:

determining a current state of the autonomous vehicle and determining a deviation between the current state of the autonomous vehicle and a first state corresponding to the standards of driving behavior, wherein the driving parameters are modified based on the deviation between the current state of the autonomous vehicle and the first state.

8. The method of claim 7 , wherein the deviation is larger than a first deviation between the current state of the autonomous vehicle and data corresponding to human driving behaviors.

9. An apparatus, comprising:

at least one processor; and

at least one memory including executable instructions that, when executed, cause the at least one processor to perform operations comprising:

receiving a vehicle control command prior to controlling an autonomous vehicle to perform the vehicle control command;

comparing the vehicle control command to standards of driving behavior and validating or modifying the vehicle control command according to the comparing; and

causing the autonomous vehicle to perform the vehicle control command according to the validated or modified vehicle control command.

10. The apparatus of claim 9 , wherein the standards of driving behavior are determined by training a reinforcement learning process comprising training by simulation to generate data from the standards of driving behavior that is compared to data corresponding to human driving behaviors during the simulation.

11. The apparatus of claim 9 , wherein the standards of driving behavior are determined by training a reinforcement learning process comprising training using on-the-road data from the standards of driving behavior that is compared to data corresponding to human driving behaviors captured by sensors of the autonomous vehicle.

12. The apparatus of claim 9 , wherein the standards of driving behavior are determined by training a neural network or generating a rules set.

13. The apparatus of claim 9 , wherein the modifying the vehicle control command modifies driving parameters in the vehicle control command.

14. The apparatus of claim 13 , wherein the driving parameters comprise:

a speed parameter,

a braking parameter, or

a steering angle parameter of the autonomous vehicle.

15. The apparatus of claim 14 , wherein the executable instructions further cause the at least one processor to perform operations comprising:

determining a current state of the autonomous vehicle and determining a deviation between the current state of the autonomous vehicle and a first state corresponding to the standards of driving behavior, wherein the driving parameters are modified based on the deviation between the current state of the autonomous vehicle and the first state.

16. The apparatus of claim 15 , wherein the deviation is larger than a first deviation between the current state of the autonomous vehicle and data corresponding to human driving behaviors.

17. A non-transitory machine-readable storage medium including instructions that, when executed by at least one processor, cause the at least one processor to perform operations comprising:

receiving a vehicle control command prior to controlling an autonomous vehicle to perform the vehicle control command;

comparing the vehicle control command to standards of driving behavior and validating or modifying the vehicle control command according to the comparing; and

causing the autonomous vehicle to perform the vehicle control command according to the validated or modified vehicle control command.

18. The non-transitory machine-readable storage medium of claim 17 , wherein the standards of driving behavior are determined by training a reinforcement learning process comprising training by simulation to generate data from the standards of driving behavior that is compared to data corresponding to human driving behaviors during the simulation.

19. The non-transitory machine-readable storage medium of claim 17 , wherein the standards of driving behavior are determined by training a reinforcement learning process comprising training using on-the-road data from the standards of driving behavior that is compared to data corresponding to human driving behaviors captured by sensors of the autonomous vehicle.

20. The non-transitory machine-readable storage medium of claim 17 , wherein the standards of driving behavior are determined by training a neural network.

Assignments (2)
CHANGE OF NAME Recorded Dec 3, 2025
From: TUSIMPLE, INC.
To: CREATEAI, INC.
Reel/Frame 073832/0553 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2022
From: LIN, WUTU; LIU, LIU; SUN, XING; MA, KAI-CHIEH; XUAN, ZIJIE; ZHAO, YUFEI
To: TUSIMPLE, INC.
Reel/Frame 059215/0574 →
Continuity (3)
Continuation 16849916 · Apr 15, 2020
Continuation 15698375 · Sep 7, 2017
Related Publication 20220197283A1 · Jun 23, 2022