IP Library Granted Patent US 11,579,607
Granted Patent B2
US 11,579,607 · App. 16/799,067 · Granted Feb 14, 2023

Method and system for driving mode switching based on self-aware capability parameters in hybrid driving

Inventors: Hao Zheng (Saratoga, CA); Timothy Patrick Daly, Jr. (San Jose, CA); David Wanqian Liu (Los Altos, CA)
Assignee: PlusAI, Inc.
G05D1/0061B60W40/08B60W50/082B60W50/14G06F9/4881B60W2040/0872B60W2540/22
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,579,607
App. No.
16/799,067
Granted
Feb 14, 2023
Kind
B2
Abstract

The present teaching relates to method, system, and medium, for switching a mode of a vehicle. Real-time data related to the vehicle are received, which include intrinsic/extrinsic capability parameters, based on which a set of tasks to switch from a current mode to a different mode is determined. A first duration of time required for the switch is determined based on a first risk evaluated with respect to the current mode and the real-time data. A task duration time needed by a driver to complete the task is estimated for each of the set of tasks. A second risk for the switching is estimated based on the required first duration of time and a total task duration times needed to complete the set of tasks. The switch is carried out when the second risk satisfying a criterion.

Claims (53)

1. A method, implemented on a machine having at least one processor, storage, and a communication platform capable of connecting to a network for operating a vehicle, the method comprising:

receiving real-time data related to the vehicle;

determining, based on the real-time data, a set of tasks to be performed to switch the vehicle from a current mode to a different mode in accordance with a task model;

determining, based on a first risk evaluated with respect to the current mode, a first duration of time required to switch from the current mode to the different mode;

estimating a task duration time needed to complete each task from the set of tasks and a total duration of time needed to complete the set of tasks; estimating a second risk of switching from the current mode to the different mode based on the first duration of time and the total duration of time;

in response to the second risk satisfying a criterion, generating a schedule of the set of tasks, each task in the set of tasks associated with at least one media from a plurality of media and at least one warning content from a plurality of warning content; and

causing the vehicle to output to a driver of the vehicle, for each task from the set of tasks, the at least one warning content using the at least one media for that task based on the schedule and within the first duration of time.

2. The method of claim 1 , wherein the real-time data includes intrinsic capability parameters and extrinsic capability parameters, the intrinsic capability parameters specifying conditions internal to the vehicle that limit the operational capability of the vehicle, the extrinsic capability parameters specifying conditions external to the vehicle that limit the operational capability of the vehicle.

3. The method of claim 1 , wherein the task duration time needed to complete each task from the set of tasks is estimated based on an observed state of the driver of the vehicle.

4. The method of claim 3 , wherein the task duration time needed to complete each task from the set of tasks is further estimated based on:

a generic response-time profile, characterizing a length of time required by human drivers to complete the task; and

a driver profile for the driver indicative of the task duration time needed by the driver to complete the task.

5. The method of claim 3 , wherein:

the state of the driver is estimated based on information obtained from a plurality of sensors disposed in the vehicle; and

the state of the driver includes at least one of a pose of the driver, a functional state of the driver, a health state of the driver, and a mental state of the driver.

6. The method of claim 1 , wherein the criterion corresponds to the total duration of time needed to complete the set of tasks being less than or equal to the first duration of time.

7. The method of claim 1 , wherein the vehicle is a hybrid driving vehicle capable of switching between a human driving mode and an autonomous mode, the current mode is one of the human driving mode or the autonomous mode, and the different mode is the other of the human driving mode or the autonomous mode.

8. A machine readable medium having information stored thereon for operating a vehicle, wherein the information, when read by the machine, causes the machine to perform the following:

receiving real-time data related to the vehicle;

determining, based on the real-time data, a set of tasks to be performed to switch the vehicle from a current mode to a different mode;

determining, based on a first risk evaluated with respect to the current mode, a first duration of time required to switch from the current mode to the different mode;

estimating a task duration time needed to complete each task from the set of tasks and a total duration of time needed to complete the set of tasks;

estimating a second risk of switching from the current mode to the different mode based on the first duration of time and the total duration of time;

in response to the second risk satisfying a criterion, generating a schedule of the set of tasks, each task in the set of tasks associated with at least one media from a plurality of media and at least one warning content from a plurality of warning content; and

causing the vehicle to output to the driver of the vehicle, for each task from the set of tasks, the at least one warning content using the at least one media for that task based on the schedule and within the first duration of time.

9. The medium of claim 8 , wherein the real-time data includes intrinsic capability parameters and extrinsic capability parameters, the intrinsic capability parameters specifying conditions internal to the vehicle that limit the operational capability of the vehicle, the extrinsic capability parameters specifying conditions external to the vehicle that limit the operational capability of the vehicle.

10. The medium of claim 8 , wherein the task duration time needed to complete each task from the set of tasks is estimated based on an observed state of the driver of the vehicle.

11. The medium of claim 10 , wherein the task duration time needed to complete each task from the set of tasks is further estimated based on:

a generic response-time profile, characterizing a length of time required by human drivers to complete the task; and

a driver profile for the driver indicative of the task duration time needed by the driver to complete the task.

12. The medium of claim 10 , wherein:

the state of the driver is estimated based on information obtained from a plurality of sensors disposed in the vehicle; and

the state of the driver includes at least one of a pose of the driver, a functional state of the driver, a health state of the driver, and a mental state of the driver.

13. The medium of claim 8 , wherein the criterion corresponds to the total duration of time needed to complete the set of tasks being less than or equal to the first duration of time.

14. The method of claim 8 , wherein the vehicle is a hybrid driving vehicle capable of switching between a human driving mode and an autonomous mode, the current mode is one of the human driving mode or the autonomous mode, and the different mode is the other of the human driving mode or the autonomous mode.

15. A system for operating a vehicle, the system comprising:

processing circuitry configured to:

receive real-time data related to the vehicle;

determine, based on the real-time data, a set of tasks to be performed to switch the vehicle from a current mode to a different mode;

determine, based on a first risk evaluated with respect to the current mode, a first duration of time required to switch from the current mode to the different mode;

estimate a task duration time needed to complete each task from the set of tasks and a total duration of time needed to complete the set of tasks;

estimate a second risk of switching from the current mode to the different mode based on the first duration of time and the total duration of time;

in response to the second risk satisfying a criterion, generate a schedule of the set of tasks, each task in the set of tasks associated with at least one warning content from a plurality of warning content; and

cause the vehicle to output to the driver, for each task from the set of tasks, the at least one warning content for that task based on the schedule and within the first duration of time.

16. The system of claim 15 , wherein the real-time data includes intrinsic capability parameters and extrinsic capability parameters, the intrinsic capability parameters specifying conditions internal to the vehicle that limit the operational capability of the vehicle, the extrinsic capability parameters specifying conditions external to the vehicle that limit the operational capability of the vehicle.

17. The system of claim 15 , wherein the task duration time needed to complete each task from the set of tasks is estimated based on an observed state of the driver of the vehicle.

18. The system of claim 17 , wherein the task duration time needed to complete each task from the set of tasks is further estimated based on:

a generic response-time profile, characterizing a length of time required by human drivers to complete the task; and

a driver profile for the driver indicative of the task duration time needed by the driver to complete the task.

19. The system of claim 17 , wherein:

the state of the driver is estimated based on information obtained from a plurality of sensors disposed in the vehicle; and

the state of the driver includes at least one of a pose of the driver, a functional state of the driver, a health state of the driver, and a mental state of the driver.

20. The system of claim 15 , wherein the criterion corresponds to the total duration of time needed to complete the set of tasks being less than or equal to the first duration of time.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 19, 2021
From: PLUSAI LIMITED
To: PLUSAI, INC.
Reel/Frame 056909/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2021
From: PLUSAI CORP
To: PLUSAI LIMITED
Reel/Frame 055440/0781 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2020
From: ZHENG, HAO; DALY JR., TIMOTHY PATRICK; LIU, DAVID WANQIAN
To: PLUSAI CORP
Reel/Frame 051904/0973 →
Continuity (3)
Continuation 15872245 · Jan 16, 2018
Continuation 15846851 · Dec 19, 2017
Related Publication 20200192360A1 · Jun 18, 2020