IP Library Granted Patent US 11,250,702
Granted Patent B2
US 11,250,702 · App. 16/575,138 · Granted Feb 15, 2022

Method and device for assisting in controlling automatic driving of vehicle, and system

Inventors: Ji Tao (Beijing, CN); Tian Xia (Beijing, CN); Xing Hu (Beijing, CN)
Assignee: Apollo Intelligent Driving Technology (Beijing) Co., Ltd.
G08G1/096783G05D1/0219G05D1/0251G08G1/0116
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,250,702
App. No.
16/575,138
Granted
Feb 15, 2022
Kind
B2
Abstract

Embodiments of the present disclosure provide a method and a device for assisting in controlling automatic driving of a vehicle, a medium, and a system. The method for assisting in controlling automatic driving of a vehicle may include: acquiring sensing information related to environment collected by a sensor, the sensor being disposed in the environment and independent of the vehicle; determining an environment sensing result related to the environment by processing the acquired sensing information, the environment sensing result indicating relevant information about a plurality of objects including the vehicle in the environment; and providing the environment sensing result to a vehicle-side control device associated with the vehicle for assisting in controlling a driving behavior of the vehicle.

Claims (76)

1. A method for assisting in controlling automatic driving of a vehicle, the method comprising:

acquiring sensing information related to environment collected by at least one sensor, the at least one sensor being disposed in the environment and independent of the vehicle;

determining an environment sensing result related to the environment by processing the acquired sensing information, the environment sensing result indicating relevant information about a plurality of objects in the environment, the plurality of objects comprising the vehicle; and

providing the environment sensing result to a vehicle-side control device associated with the vehicle for assisting in controlling a driving behavior of the vehicle;

wherein providing the environment sensing result to the vehicle-side control device comprises:

determining a vehicle exterior sensing result by excluding a self-vehicle sensing result corresponding to the vehicle from the environment sensing result; and

transmitting the vehicle exterior sensing result to the vehicle-side control device;

wherein determining the vehicle exterior sensing result comprises:

identifying, from the environment sensing result, identification information related to a label portion equipped to the vehicle;

determining the self-vehicle sensing result corresponding to the vehicle in the environment sensing result based on the identification information; and

excluding the self-vehicle sensing result from the environment sensing result to acquire the vehicle exterior sensing result.

2. The method according to claim 1 , further comprising:

determining behavior prediction of at least one object of the plurality of objects based on the environment sensing result, the behavior prediction comprising at least one of: an expected moving trajectory of the at least one object, an expected moving speed of the at least one object, and an expected moving direction of the at least one object; and

providing the determined behavior prediction to the vehicle-side control device for further assisting in controlling the driving behavior of the vehicle.

3. The method according to claim 2 , wherein determining the behavior prediction comprises:

determining the behavior prediction using a prediction model specific to a region in which the at least one sensor is located, the prediction model being trained based on behaviors of another object in the region.

4. The method according to claim 1 , further comprising:

determining an automatic driving recommendation for the vehicle based on the environment sensing result, the automatic driving recommendation comprising at least one of: a travel route recommendation of the vehicle, a travel direction recommendation of the vehicle, and a recommendation of operational instructions for controlling the driving behavior of the vehicle; and

providing the determined automatic driving recommendation to the vehicle-side control device for further assisting in controlling the driving behavior of the vehicle.

5. The method according to claim 4 , wherein determining the automatic driving recommendation comprises:

determining the automatic driving recommendation using a recommendation model specific to a region in which the at least one sensor is located, the recommendation model being trained based on driving behaviors performed by another vehicle in the region.

6. The method according to claim 1 , wherein determining the environment sensing result comprises:

acquiring a static high-precision map associated with the environment, the static high-precision map at least indicating a position of a static object in the environment; and

determining the environment sensing result based on the sensing information and the static high-precision map.

7. The method according to claim 6 , wherein determining the environment sensing result based on the sensing information and the static high-precision map comprises:

updating the static high-precision map with the sensing information to acquire a real-time high-precision map associated with the environment as the environment sensing result.

8. The method according to claim 6 , wherein the sensing information comprises image sensing information, and determining the environment sensing result based on the sensing information and the static high-precision map comprises:

identifying the static object and other objects in the environment from the image sensing information; and

determining positions of other objects according to the position of the static object indicated by the static high-precision map based on a relative position relationship between the static object and the other objects in the image sensing information.

9. A device for assisting in controlling automatic driving of a vehicle, comprising:

one or more processors; and

a storage device, configured to store one or more programs that, when executed by the one or more processors, causes the one or more processors to perform a method or assisting in controlling automatic driving of a vehicle, the method comprising:

acquiring sensing information related to environment collected by at least one sensor, the at least one sensor being disposed in the environment and independent of the vehicle;

determining an environment sensing result related to the environment by processing the acquired sensing information, the environment sensing result indicating relevant information about a plurality of objects in the environment, the plurality of objects comprising the vehicle; and

providing the environment sensing result to a vehicle-side control device associated with the vehicle for assisting in controlling a driving behavior of the vehicle;

wherein providing the environment sensing result to the vehicle-side control device comprises:

determining a vehicle exterior sensing result by excluding a self-vehicle sensing result corresponding to the vehicle from the environment sensing result; and

transmitting the vehicle exterior sensing result to the vehicle-side control device;

wherein determining the vehicle exterior sensing result comprises:

identifying, from the environment sensing result, identification information related to a label portion equipped to the vehicle;

determining the self-vehicle sensing result corresponding to the vehicle in the environment sensing result based on the identification information; and

excluding the self-vehicle sensing result from the environment sensing result to acquire the vehicle exterior sensing result.

10. The device according to claim 9 , wherein the method further comprises:

determining behavior prediction of at least one object of the plurality of objects based on the environment sensing result, the behavior prediction comprising at least one of: an expected moving trajectory of the at least one object, an expected moving speed of the at least one object, and an expected moving direction of the at least one object; and

providing the determined behavior prediction to the vehicle-side control device for further assisting in controlling the driving behavior of the vehicle.

11. The device according to claim 10 , wherein determining the behavior prediction comprises:

determining the behavior prediction using a prediction model specific to a region in which the at least one sensor is located, the prediction model being trained based on behaviors of another object in the region.

12. The device according to claim 9 , wherein the method further comprises:

determining an automatic driving recommendation for the vehicle based on the environment sensing result, the automatic driving recommendation comprising at least one of: a travel route recommendation of the vehicle, a travel direction recommendation of the vehicle, and a recommendation of operational instructions for controlling the driving behavior of the vehicle; and

providing the determined automatic driving recommendation to the vehicle-side control device for further assisting in controlling the driving behavior of the vehicle.

13. The device according to claim 12 , wherein determining the automatic driving recommendation comprises:

determining the automatic driving recommendation using a recommendation model specific to a region in which the at least one sensor is located, the recommendation model being trained based on driving behaviors performed by another vehicle in the region.

14. The device according to claim 9 , wherein determining the environment sensing result comprises:

acquiring a static high-precision map associated with the environment, the static high-precision map at least indicating a position of a static object in the environment; and

determining the environment sensing result based on the sensing information and the static high-precision map.

15. The device according to claim 14 , wherein determining the environment sensing result based on the sensing information and the static high-precision map comprises:

updating the static high-precision map with the sensing information to acquire a real-time high-precision map associated with the environment as the environment sensing result.

16. The device according to claim 14 , wherein the sensing information comprises image sensing information, and determining the environment sensing result based on the sensing information and the static high-precision map comprises:

identifying the static object and other objects in the environment from the image sensing information; and

determining positions of other objects according to the position of the static object indicated by the static high-precision map based on a relative position relationship between the static object and the other objects in the image sensing information.

17. A vehicle infrastructure cooperative system, comprising:

at least one sensor disposed in environment and independent of a vehicle, configured to collect sensing information related to the environment;

a roadside assist device comprising a device for assisting in controlling automatic driving of a vehicle, the device for assisting in controlling automatic driving of a vehicle comprising:

one or more processors; and

a storage device, configured to store one or more programs that, when executed by the one or more processors, causes the one or more processors to perform a method or assisting in controlling automatic driving of a vehicle, the method comprising:

acquiring sensing information related to environment collected by at least one sensor, the at least one sensor being disposed in the environment and independent of the vehicle;

determining an environment sensing result related to the environment by processing the acquired sensing information, the environment sensing result indicating relevant information about a plurality of objects in the environment, the plurality of objects comprising the vehicle; and

providing the environment sensing result to a vehicle-side control device associated with the vehicle for assisting in controlling a driving behavior of the vehicle;

wherein providing the environment sensing result to the vehicle-side control device comprises:

determining a vehicle exterior sensing result by excluding a self-vehicle sensing result corresponding to the vehicle from the environment sensing result; and

transmitting the vehicle exterior sensing result to the vehicle-side control device;

wherein determining the vehicle exterior sensing result comprises:

identifying, from the environment sensing result, identification information related to a label portion equipped to the vehicle;

determining the self-vehicle sensing result corresponding to the vehicle in the environment sensing result based on the identification information; and

excluding the self-vehicle sensing result from the environment sensing result to acquire the vehicle exterior sensing result; and

a vehicle-side control device, configured to control a driving behavior of the vehicle based on the environment sensing result provided by the roadside assist device.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICANT NAME PREVIOUSLY RECORDED AT REEL: 057933 FRAME: 0812. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 28, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058594/0836 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
To: APOLLO INTELLIGENT DRIVING (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057933/0812 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2020
From: TAO, JI
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 052625/0976 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2020
From: HU, XING
To: BAIDU ONLINE NETWORK TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 052626/0063 →
Priority Claims (1)
CN 201811096609.8 · Sep 19, 2018 · national
Continuity (1)
Related Publication 20200090511A1 · Mar 19, 2020