IP Library Granted Patent US 12,466,444
Granted Patent B2
US 12,466,444 · App. 17/097,316 · Granted Nov 11, 2025

Techniques for switching between manual and autonomous control for a movable object

Inventor: Mingyu Wang (Guangdong, CN)
Assignee: SHENZHEN ZHUOYU TECHNOLOGY CO., LTD.
B60W60/0051B60W50/082B60W50/14B60W60/0015B60W2050/0071B60W2050/143B60W2556/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,466,444
App. No.
17/097,316
Granted
Nov 11, 2025
Kind
B2
Abstract

Techniques are disclosed for switching between a manual driving mode and an autonomous driving mode. A system for switching driving modes can include a vehicle control unit in communication with a plurality of sensors and a plurality of vehicle controls of an autonomous vehicle. The vehicle control unit can include a control manager configured to receive a request to switch driving modes from a first mode to a second mode, obtain a driving state using the plurality of sensors, determine the driving state meets a switching standard, enter a pending switching state in which a control input received for the first mode is combined with a control input received for the second mode to generate a vehicle control output, send a message indicating that the driving mode is to switch from the first mode to the second mode, and switch driving modes from the first mode to the second mode.

Claims (73)

1 . A vehicle control system, comprising:

a plurality of sensors coupled to an autonomous vehicle;

a plurality of vehicle controls in the autonomous vehicle;

a vehicle control unit in communication with the plurality of sensors and the plurality of vehicle controls, the vehicle control unit including at least one processor and a control manager, the control manager including instructions which, when executed by the processor, cause the control manager to:

receive a request to switch driving modes from a first mode to a second mode;

obtain a driving state using the plurality of sensors;

determine that the driving state meets a switching standard;

enter a pending switching state, the pending switching state in which the autonomous vehicle being a temporary driving mode between the first mode and the second mode, a length of time in the pending switching state varies depending on current driving conditions, wherein the length of time the pending switching state in smooth traffic conditions is shorter than that in congested traffic conditions, wherein in the pending switching state, a control input received for the first mode applied with a first weight value is combined with a control input received for the second mode applied with a second weight value to generate a vehicle control output to control one function of the autonomous vehicle;

send a message indicating that the driving mode is to switch from the first mode to the second mode, the message including an option to cancel, if a driver cancels change, then the driving mode reverts back to the first mode, if, at the end of the pending switching state, the change has not been canceled, then the driving mode is updated to the second mode; and

switch the driving modes from the temporary driving mode to the second mode,

wherein as time in the pending switching state continues, the first weight value decreases while the second weight value increases.

2 . The system of claim 1 , wherein the driving state includes one or more of a position, speed, acceleration, environmental information, driving information, or traffic information.

3 . The system of claim 1 , wherein the switching standard comprises a plurality of positive switching standards and a plurality of negative switching standards.

4 . The system of claim 3 , wherein the plurality of positive switching standards and the plurality of negative switching standards include at least one of:

a maximum speed for a current location;

a driving time;

a terrain type;

an intersection type;

a current speed;

a threshold distance from a nearest vehicle; or

a current motion relative to a nearest vehicle.

5 . The system of claim 1 , wherein the request to switch driving modes is generated after a driver has not provided any control input in at least a threshold amount of time, wherein the second mode is a safe mode that brings the autonomous vehicle to a safe stop.

6 . The system of claim 1 , wherein the plurality of sensors include a communication unit to receive sensor data from different autonomous vehicles or traffic infrastructure.

7 . The system of claim 6 , wherein the switching standard is based on the sensor data received from the different autonomous vehicles or traffic infrastructure.

8 . A method for controlling an autonomous vehicle, comprising:

receiving a request to switch driving modes from a first mode to a second mode in an autonomous vehicle, the autonomous vehicle including a plurality of sensors and a plurality of vehicle controls;

obtaining a driving state using the plurality of sensors;

determining that the driving state meets a switching standard;

entering a pending switching state, the pending switching state in which the autonomous vehicle being a temporary driving mode between the first mode and the second mode, a length of time in the pending switching state varies depending on current driving conditions, wherein the length of time the pending switching state in smooth traffic conditions is shorter than that in congested traffic conditions, wherein in the pending switching state, a control input received for the first mode applied with a first weight value is combined with a control input received for the second mode applied with a second weight value to generate a vehicle control output to control one function of the autonomous vehicle;

sending a message indicating that the driving mode is to switch from the first mode to the second mode, the message including an option to cancel, if a driver cancels change, then the driving mode reverts back to the first mode, if, at the end of the pending switching state, the change has not been canceled, then the driving mode is updated to the second mode; and

switching driving modes from the pending switching state temporary driving mode to the second mode,

wherein as time in the pending switching state continues, the first weight value decreases while the second weight value increases.

9 . The method of claim 8 , wherein the first mode is a manual drive mode and the second mode is an autonomous drive mode, and wherein the request to switch driving modes from a first mode to a second mode is generated automatically.

10 . The method of claim 8 , wherein the request to switch driving modes from a first mode to a second mode is generated by an input received through the plurality of vehicle controls.

11 . The method of claim 8 , further comprising:

receiving a second request to switch driving modes from the second mode to the first mode;

obtaining a second driving state;

determining that the second driving state does not meet a second switching standard; and

returning a warning indicating the driving mode cannot be switched based on the second driving state.

12 . The method of claim 11 , further comprising:

receiving a third request to switch driving modes from the second mode to the first mode in response to the warning, the third request overriding the warning; and

switching driving modes from the second mode to the first mode.

13 . A non-transitory computer readable storage medium including instructions stored thereon which, when executed by one or more processors, cause the one or more processors to:

receive a request to switch driving modes from a first mode to a second mode in an autonomous vehicle, the autonomous vehicle including a plurality of sensors and a plurality of vehicle controls;

obtain a driving state using the plurality of sensors;

determine that the driving state meets a switching standard;

enter a pending switching state, the pending switching state in which the autonomous vehicle being a temporary driving mode between the first mode and the second mode, a length of time in the pending switching state varies depending on current driving conditions, wherein the length of time the pending switching state in smooth traffic conditions is shorter than that in congested traffic conditions, wherein in the pending switching state, a control input received for the first mode applied with a first weight value is combined with a control input received for the second mode applied with a second weight value to generate a vehicle control output to control one function of the autonomous vehicle;

send a message indicating that the driving mode is to switch from the first mode to the second mode, the message including an option to cancel, if a driver cancels change, then the driving mode reverts back to the first mode, if, at the end of the pending switching state, the change has not been canceled, then the driving mode is updated to the second mode; and

switch driving modes from the pending switching state temporary driving mode to the second mode,

wherein as time in the pending switching state continues, the first weight value decreases while the second weight value increases.

14 . The non-transitory computer readable storage medium of claim 13 , wherein the driving state includes one or more of a position, speed, acceleration, environmental information, driving information, or traffic information.

15 . The non-transitory computer readable storage medium of claim 13 , wherein the switching standard comprises a plurality of positive switching standards and a plurality of negative switching standards.

16 . The non-transitory computer readable storage medium of claim 15 , wherein the plurality of positive switching standards and the plurality of negative switching standards include at least one of:

a maximum speed for a current environment;

a driving time;

a terrain type;

an intersection type;

a current speed;

a threshold distance from a nearest vehicle; or a current motion relative to a nearest vehicle.

17 . The non-transitory computer readable storage medium of claim 13 , wherein the plurality of sensors include a communication unit to receive sensor data from different autonomous vehicles or traffic infrastructure and wherein the switching standard is based on the sensor data received from the different autonomous vehicles or traffic infrastructure.

18 . The non-transitory computer readable storage medium of claim 13 , wherein the first mode is a manual drive mode and the second mode is an autonomous drive mode, and wherein the request to switch driving modes from a first mode to a second mode is generated automatically, and wherein the request to switch driving modes from a first mode to a second mode is generated by an input received through the plurality of vehicle controls.

19 . The non-transitory computer readable storage medium of claim 13 , wherein the instructions, when executed, further cause the one or more processors to:

receive a second request to switch driving modes from the second mode to the first mode;

obtain a second driving state;

determine that the second driving state does not meet a second switching standard;

return a warning indicating the driving mode cannot be switched based on the second driving state;

receive a third request to switch driving modes from the second mode to the first mode in response to the warning, the third request overriding the warning; and

switching driving modes from the second mode to the first mode.

20 . The system of claim 1 , wherein to combine the control input received for the first mode with the control input received for the second mode to generate a vehicle control output, the instructions, when executed, further cause the one or more processors to:

determine that an amplitude of the control input received for the second mode is larger than a threshold input value;

apply a first weight value to the control input received for the second mode to obtain a first weighted control input;

apply a second weight value to the control input received for the first mode, the second weight value being larger than the first weight value to obtain a second weighted control input; and

generate the vehicle control output based on the first and second weighted control inputs.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2024
From: SZ DJI TECHNOLOGY CO., LTD.
To: SHENZHEN ZHUOYU TECHNOLOGY CO., LTD.
Reel/Frame 067452/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 17, 2020
From: WANG, MINGYU
To: SZ DJI TECHNOLOGY CO., LTD.
Reel/Frame 054394/0015 →
Continuity (2)
Continuation PCTCN2019077510 · Mar 8, 2019
Related Publication 20210061312A1 · Mar 4, 2021
References Cited (32)
US 10101743B2 · Abe · 2018 [cited by examiner]
US 10528044B2 · Emura · 2020 [cited by examiner]
US 10787192B1 · Katzourakis · 2020 [cited by examiner]
US 20120046817A1 · Kindo et al. · 2012 [cited by applicant]
US 20150345819A1 · Ostrovsky et al. · 2015 [cited by applicant]
US 20160209840A1 · Kim · 2016 [cited by examiner]
US 20170261983A1 · Abe · 2017 [cited by examiner]
US 20170305425A1 · Xing · 2017 [cited by applicant]
US 20180113454A1 · Emura · 2018 [cited by examiner]
US 20180186376A1 · Lee et al. · 2018 [cited by applicant]
US 20190011914A1 · Park · 2019 [cited by examiner]
US 20190126925A1 · Ryne · 2019 [cited by examiner]
US 20190161116A1 · Moreillon · 2019 [cited by examiner]
US 20190291745A1 · Sikorski · 2019 [cited by examiner]
US 20200282984A1 · Mizoguchi · 2020 [cited by examiner]
US 20210061299A1 · Wang · 2021 [cited by examiner]
CN 102053619A · 2011 [cited by applicant]
CN 102395499A · 2012 [cited by applicant]
CN 102945046A · 2013 [cited by applicant]
CN 104331085A · 2015 [cited by applicant]
CN 107187449A · 2017 [cited by applicant]
CN 107635844A · 2018 [cited by applicant]
CN 108137062A · 2018 [cited by examiner]
CN 108140324A · 2018 [cited by examiner]
CN 109204325A · 2019 [cited by applicant]
DE 102017004845A1 · 2017 [cited by examiner]
EP 3045369A1 · 2016 [cited by examiner]
JP 2019040588A · 2019 [cited by applicant]
Chinese Office Action issued Jun. 16, 2023, in corresponding Chinese Patent Application No. 201980005612.0. [cited by applicant]
“Steam Turbine Digital Electro-hydraulic Regulating System”, Xiao Zenghong et al., China Electric Power Press, p. 209, Apr. 2003. [cited by applicant]
Office Action, CN App. No. 201980005612.0, Sep. 14, 2022, 17 pages of Original Document Only. [cited by applicant]
International Search Report and Written Opinion for related International Application No. PCT/CN2019/077510, mailed Dec. 13, 2019, 10 pages. [cited by applicant]