IP Library Granted Patent US 11,511,774
Granted Patent B2
US 11,511,774 · App. 17/024,629 · Granted Nov 29, 2022

Method and apparatus for controlling autonomous driving vehicle

Inventors: Yue Wang (Beijing, CN); Zelin Wu (Beijing, CN); Jingjing Xue (Beijing, CN); Yingnan Liu (Beijing, CN); Wenlong Rao (Beijing, CN); Zijie Wang (Beijing, CN); Wei Gong (Beijing, CN)
Assignee: Apollo Intelligent Driving Technology (Beijing) Co., Ltd.
B60W60/0016B60W10/18B60W40/08B60W50/0098B60W50/14B60W2040/0818B60W2420/42B60W2530/00B60W2540/26B60W2555/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,511,774
App. No.
17/024,629
Granted
Nov 29, 2022
Kind
B2
Abstract

A method and an apparatus for controlling an autonomous driving vehicle are provided. The method includes: receiving environment information sent by an autonomous driving vehicle, the environment information including vehicle exterior environment information; determining whether the autonomous driving vehicle is in an abnormal operation status, based on the vehicle exterior environment information and operation information of an operation executed by the autonomous driving vehicle; and sending a braking control instruction and a data acquisition instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle is in the abnormal operation status, the braking control instruction being used for controlling braking of the autonomous driving vehicle, and the data acquisition instruction being used for acquiring data of a driving recorder in the autonomous driving vehicle.

Claims (84)

1. A method for controlling an autonomous driving vehicle, comprising:

receiving environment information sent by the autonomous driving vehicle, the environment information comprising vehicle exterior environment information;

determining whether the autonomous driving vehicle is in an abnormal operation status, based on the vehicle exterior environment information and operation information of an operation executed by the autonomous driving vehicle; and

sending a braking control instruction and a data acquisition instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle is in the abnormal operation status, the braking control instruction being used for controlling braking of the autonomous driving vehicle, and the data acquisition instruction being used for acquiring data of a driving recorder in the autonomous driving vehicle,

wherein determining whether the autonomous driving vehicle is in an abnormal operation status comprises:

by using a pre-stored corresponding relationship between vehicle exterior environment information and an operation or a pre-stored determination rule for determining an operation based on vehicle exterior environment information, predicting a predictive operation to be executed by the autonomous driving vehicle based on the vehicle exterior environment information sent by the autonomous driving vehicle, for determining whether the autonomous driving vehicle is in an abnormal operation status; and

determining the autonomous driving vehicle is in an abnormal operation status in response to determining that the predictive operation is not matched with the operation corresponding to the operation information; and

wherein sending a braking control instruction comprises:

determining a difference between the predictive operation and the operation corresponding to the operation information;

sending a braking control instruction for emergency braking or slow braking to the autonomous driving vehicle based on the difference.

2. The method according to claim 1 , wherein, before the receiving environment information sent by an autonomous driving vehicle, the method further comprises:

receiving a vehicle control request sent by the autonomous driving vehicle.

3. The method according to claim 1 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information; and

the method further comprises:

determining whether the autonomous driving vehicle comprises a predetermined passenger, based on the vehicle interior video information; and

sending a first control instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle does not comprise the predetermined passenger, wherein the first control instruction is used for controlling the autonomous driving vehicle to send alarm information.

4. The method according to claim 3 , wherein the method further comprises:

determining whether the predetermined passenger is in an abnormal status, in response to determining that the autonomous driving vehicle comprises the predetermined passenger; and

sending a second control instruction to the autonomous driving vehicle, in response to determining that the predetermined passenger is in the abnormal status, wherein the second control instruction is used for controlling the autonomous driving vehicle to play preset prompt information.

5. The method according to claim 1 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information; and

the method further comprises:

determining whether the autonomous driving vehicle comprises a passenger with an abnormal behavior, based on the vehicle interior video information; and

sending a third control instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle comprises the passenger with the abnormal behavior, wherein the third control instruction is used for controlling the autonomous driving vehicle to execute a predetermined emergency operation for the passenger abnormal behavior.

6. The method according to claim 1 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information, vehicle interior smoke density information, and vehicle interior temperature information; and

the method further comprises:

determining whether there is burning of objects in the autonomous driving vehicle, based on the vehicle interior video information, the vehicle interior smoke density information and/or the vehicle interior temperature information; and

sending a fourth control instruction to the autonomous driving vehicle, in response to determining that there is burning of objects in the autonomous driving vehicle, wherein the fourth control instruction is used for controlling the autonomous driving vehicle to execute a predetermined emergency operation for burning of objects.

7. The method according to claim 1 , wherein in response to a predictive operation not matching the actual operation corresponding to the operation information, it is determined that the autonomous driving vehicle is in the abnormal operation status, the predictive operation being an operation needed to be performed by the autonomous driving vehicle and predicted based on the vehicle exterior environment information.

8. A server, comprising:

one or more processors; and

a storage apparatus, storing one or more programs,

wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform operations, the operations comprising:

receiving environment information sent by the autonomous driving vehicle, the environment information comprising vehicle exterior environment information;

determining whether the autonomous driving vehicle is in an abnormal operation status, based on the vehicle exterior environment information and operation information of an operation executed by the autonomous driving vehicle; and

sending a braking control instruction and a data acquisition instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle is in the abnormal operation status, the braking control instruction being used for controlling braking of the autonomous driving vehicle, and the data acquisition instruction being used for acquiring data of a driving recorder in the autonomous driving vehicle,

wherein determining whether the autonomous driving vehicle is in an abnormal operation status comprises: by using a pre-stored corresponding relationship between vehicle exterior environment information and an operation or a pre-stored determination rule for determining an operation based on vehicle exterior environment information, predicting a predictive operation to be executed by the autonomous driving vehicle based on the vehicle exterior environment information sent by the autonomous driving vehicle, for determining whether the autonomous driving vehicle is in an abnormal operation status; and

determining the autonomous driving vehicle is in an abnormal operation status in response to determining that the predictive operation is not matched with the operation corresponding to the operation information; and

wherein sending a braking control instruction comprises:

determining a difference between the predictive operation and the operation corresponding to the operation information;

sending a braking control instruction for emergency braking or slow braking to the autonomous driving vehicle based on the difference.

9. The server according to claim 8 , wherein, before the receiving environment information sent by an autonomous driving vehicle, the operations further comprise:

receiving a vehicle control request sent by the autonomous driving vehicle.

10. The server according to claim 8 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information; and

the operations further comprise:

determining whether the autonomous driving vehicle comprises a predetermined passenger, based on the vehicle interior video information; and

sending a first control instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle does not comprise the predetermined passenger, wherein the first control instruction is used for controlling the autonomous driving vehicle to send alarm information.

11. The server according to claim 10 , wherein the operations further comprise:

determining whether the predetermined passenger is in an abnormal status, in response to determining that the autonomous driving vehicle comprises the predetermined passenger; and

sending a second control instruction to the autonomous driving vehicle, in response to determining that the predetermined passenger is in the abnormal status, wherein the second control instruction is used for controlling the autonomous driving vehicle to play preset prompt information.

12. The server according to claim 8 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information; and

the operations further comprise:

determining whether the autonomous driving vehicle comprises a passenger with an abnormal behavior, based on the vehicle interior video information; and

sending a third control instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle comprises the passenger with the abnormal behavior, wherein the third control instruction is used for controlling the autonomous driving vehicle to execute a predetermined emergency operation for the passenger abnormal behavior.

13. The server according to claim 8 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information, vehicle interior smoke density information, and vehicle interior temperature information; and

the operations further comprise:

determining whether there is burning of objects in the autonomous driving vehicle, based on the vehicle interior video information, the vehicle interior smoke density information and/or the vehicle interior temperature information; and

sending a fourth control instruction to the autonomous driving vehicle, in response to determining that there is burning of objects in the autonomous driving vehicle, wherein the fourth control instruction is used for controlling the autonomous driving vehicle to execute a predetermined emergency operation for burning of objects.

14. A non-transitory computer readable medium, storing a computer program thereon, wherein the program, when executed by a processor, causes the processor to perform operations, the operations comprising:

receiving environment information sent by the autonomous driving vehicle, the environment information comprising vehicle exterior environment information;

determining whether the autonomous driving vehicle is in an abnormal operation status, based on the vehicle exterior environment information and operation information of an operation executed by the autonomous driving vehicle; and

sending a braking control instruction and a data acquisition instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle is in the abnormal operation status, the braking control instruction being used for controlling braking of the autonomous driving vehicle, and the data acquisition instruction being used for acquiring data of a driving recorder in the autonomous driving vehicle,

wherein determining whether the autonomous driving vehicle is in an abnormal operation status comprises:

by using a pre-stored corresponding relationship between vehicle exterior environment information and an operation or a pre-stored determination rule for determining an operation based on vehicle exterior environment information, predicting a predictive operation to be executed by the autonomous driving vehicle based on the vehicle exterior environment information sent by the autonomous driving vehicle, for determining whether the autonomous driving vehicle is in an abnormal operation status; and

determining the autonomous driving vehicle is in an abnormal operation status in response to determining that the predictive operation is not matched with the operation corresponding to the operation information; and

wherein sending a braking control instruction comprises:

determining a difference between the predictive operation and the operation corresponding to the operation information;

sending a braking control instruction for emergency braking or slow braking to the autonomous driving vehicle based on the difference.

15. The computer readable medium according to claim 14 , wherein, before the receiving environment information sent by an autonomous driving vehicle, the operations further comprise:

receiving a vehicle control request sent by the autonomous driving vehicle.

16. The computer readable medium according to claim 14 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information; and

the operations further comprise:

determining whether the autonomous driving vehicle comprises a predetermined passenger, based on the vehicle interior video information; and

sending a first control instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle does not comprise the predetermined passenger, wherein the first control instruction is used for controlling the autonomous driving vehicle to send alarm information.

17. The computer readable medium according to claim 14 , wherein the operations further comprise:

determining whether the predetermined passenger is in an abnormal status, in response to determining that the autonomous driving vehicle comprises the predetermined passenger; and

sending a second control instruction to the autonomous driving vehicle, in response to determining that the predetermined passenger is in the abnormal status, wherein the second control instruction is used for controlling the autonomous driving vehicle to play preset prompt information.

18. The computer readable medium according to claim 14 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information; and

the operations further comprise:

determining whether the autonomous driving vehicle comprises a passenger with an abnormal behavior, based on the vehicle interior video information; and

sending a third control instruction to the autonomous driving vehicle, in response to determining that the autonomous driving vehicle comprises the passenger with the abnormal behavior, wherein the third control instruction is used for controlling the autonomous driving vehicle to execute a predetermined emergency operation for the passenger abnormal behavior.

19. The computer readable medium according to claim 14 , wherein the environment information comprises vehicle interior environment information, and the vehicle interior environment information comprises vehicle interior video information, vehicle interior smoke density information, and vehicle interior temperature information; and

the operations further comprise:

determining whether there is burning of objects in the autonomous driving vehicle, based on the vehicle interior video information, the vehicle interior smoke density information and/or the vehicle interior temperature information; and

sending a fourth control instruction to the autonomous driving vehicle, in response to determining that there is burning of objects in the autonomous driving vehicle, wherein the fourth control instruction is used for controlling the autonomous driving vehicle to execute a predetermined emergency operation for burning of objects.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICANT NAME PREVIOUSLY RECORDED AT REEL: 057933 FRAME: 0812. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 28, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058594/0836 →
EMPLOYMENT AGREEMENT Recorded Nov 1, 2021
From: WU, ZELIN
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 059591/0652 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057933/0812 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2021
From: WANG, YUE; XUE, JINGJING; LIU, YINGNAN; RAO, WENLONG; WANG, ZIJIE; GONG, WEI
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 056734/0651 →
Priority Claims (1)
CN 201811374621.0 · Nov 19, 2018 · national
Continuity (2)
Continuation PCTCN2019103252 · Aug 29, 2019
Related Publication 20210001887A1 · Jan 7, 2021