IP Library Granted Patent US 11,308,138
Granted Patent B2
US 11,308,138 · App. 16/722,231 · Granted Apr 19, 2022

Danger warning method for vehicle, danger warning device for vehicle, and medium

Inventors: Zhuhua Zhang (Beijing, CN); Xing Hu (Beijing, CN)
Assignee: Apollo Intelligent Driving Technology (Beijing) Co., Ltd.
G06F16/29B60W50/14B60W2050/143B60W2050/146
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,308,138
App. No.
16/722,231
Granted
Apr 19, 2022
Kind
B2
Abstract

Embodiments of the present disclosure provide a danger warning method for a vehicle, a danger warning device for a vehicle, and medium. The method includes: receiving a plurality of sensing data sets from a plurality of environmental monitoring devices that monitor a plurality of geographical ranges; determining a danger degree of respective object in the plurality of geographical ranges with respect to the vehicle based on the plurality of sensing data sets; and providing a danger warning instruction to the vehicle in response to determining that the danger degree is greater than a degree threshold. Each of the plurality of sensing data sets includes relevant information about objects in the corresponding geographical range, and the plurality of environmental monitoring devices are arranged away from the vehicle. The danger degree is configured to indicate a possibility that the object will endanger safe driving of the vehicle.

Claims (79)

1. A danger warning method for a vehicle, comprising:

receiving a plurality of sensing data sets from a plurality of environmental monitoring devices that monitor a plurality of geographical ranges, each of the plurality of sensing data sets comprising relevant information about objects in the corresponding geographical range, and the plurality of environmental monitoring devices being arranged away from the vehicle;

determining a danger degree of respective object in the plurality of geographical ranges with respect to the vehicle based on the plurality of sensing data sets, the danger degree being configured to indicate a possibility that the object will endanger safe driving of the vehicle; and

providing a danger warning instruction to the vehicle in response to determining that the danger degree is greater than a degree threshold;

wherein determining the danger degree comprises:

performing de-redundancy on the plurality of sensing data sets; and

determining the danger degree based on a plurality of de-redundant sensing data sets;

wherein performing de-redundancy on the plurality of sensing data sets comprises:

determining that at least two of the plurality of sensing data sets comprise relevant information about the same object; and

keeping the relevant information about the same object in one of the at least two sensing data sets, and deleting the relevant information about the same object from remaining sensing data sets.

2. The method according to claim 1 , wherein performing de-redundancy comprises:

determining that at least two of the plurality of geographical ranges monitored by the plurality of environmental monitoring devices are at least partially overlapping; and

performing de-redundancy on the at least two sensing data sets comprising relevant information about objects in the at least two geographical ranges.

3. The method according to claim 1 , wherein determining the danger degree comprises:

identifying an object within a distance threshold to the vehicle from the plurality of sensing data sets; and

determining the danger degree of the object based on the relevant information about the object identified.

4. The method according to claim 1 , wherein determining the danger degree comprises:

classifying the plurality of sensing data sets into a plurality of data categories based on at least one of a speed of the object and a relative orientation of the object and the vehicle;

for a predetermined dangerous event, determining a priority of each of the plurality of data categories; and

determining a possibility that respective object in the plurality of geographical ranges triggers the predetermined dangerous event with each of the plurality of data categories according to an order of the priorities, to generate the danger degree of the object.

5. The method according to claim 1 , wherein providing the danger warning comprises:

transmitting the danger warning instruction to an on-board device via a communication connection with the on-board device of the vehicle.

6. The method according to claim 1 , wherein providing the danger warning comprises:

selecting an environmental monitoring device from a plurality of candidate environmental monitoring devices, each of the plurality of candidate environmental monitoring devices having a communication connection with an on-board device of the vehicle; and

transmitting the danger warning instruction to the selected environmental monitoring device, to instruct the selected environmental monitoring device to forward the danger warning instruction to the on-board device,

wherein selecting the environmental monitoring device from the plurality of candidate environmental monitoring devices is based on at least one of:

a distance between each of the plurality of candidate environmental monitoring devices and the vehicle;

whether the plurality of candidate environmental monitoring devices are located in a traveling direction of the vehicle; and

an angle between a position of each of the plurality of candidate environmental monitoring devices and a position of the vehicle in a coordinate system.

7. The method according to claim 1 , wherein each of the plurality of sensing data sets comprises at least one of a type, a size, a position, a speed, and a motion direction of the object in the geographical range.

8. The method according to claim 1 , wherein providing the danger warning instruction to the vehicle in response to determining that the danger degree is greater than the threshold comprises:

presenting the danger warning instruction to a driver of the vehicle, when an automatic driving capability of the vehicle is less than a capability threshold;

providing the danger warning instruction to a controller to assist in driving control of the vehicle, when the automatic driving capability of the vehicle is greater than or equal to the capability threshold.

9. A danger warning device for a vehicle, comprising:

one or more processors; and

a storage device configured to store one or more programs,

wherein when the one or more programs are executed by the one or more processors, the one or more processors are caused to:

receive a plurality of sensing data sets from a plurality of environmental monitoring devices that monitor a plurality of geographical ranges, each of the plurality of sensing data sets comprising relevant information about objects in the corresponding geographical range, and the plurality of environmental monitoring devices being arranged away from the vehicle;

determine a danger degree of respective object in the plurality of geographical ranges with respect to the vehicle based on the plurality of sensing data sets, the danger degree being configured to indicate a possibility that the object will endanger safe driving of the vehicle; and

provide a danger warning instruction to the vehicle in response to determining that the danger degree is greater than a degree threshold;

wherein the one or more processors are configured to:

perform de-redundancy on the plurality of sensing data sets; and

determine the danger degree based on a plurality of de-redundant sensing data sets;

wherein the one or more processors are configured to perform de-redundancy on the plurality of sensing data sets by acts of:

determining that at least two of the plurality of sensing data sets comprise relevant information about the same object; and

keeping the relevant information about the same object in one of the at least two sensing data sets, and deleting the relevant information about the same object from remaining sensing data sets.

10. The device according to claim 9 , wherein the one or more processors are configured to:

determine that at least two of the plurality of geographical ranges monitored by the plurality of environmental monitoring devices are at least partially overlapping; and

perform de-redundancy on the at least two sensing data sets comprising relevant information about the object in the at least two geographical ranges.

11. The device according to claim 9 , wherein the one or more processors are configured to:

identify an object within a distance threshold to the vehicle from the plurality of sensing data sets; and

determine the danger degree of the object based on the relevant information about the object.

12. The device according to claim 9 , wherein the one or more processors are configured to:

classify the plurality of sensing data sets into a plurality of data categories based on at least one of a speed of the object and a relative orientation of the object and the vehicle;

for a predetermined dangerous event, determine a priority of each of the plurality of data categories; and

determine a possibility that respective object in the plurality of geographical ranges triggers the predetermined dangerous event with each of the plurality of data categories according to an order of the priorities, to generate the danger degree of the object.

13. The device according to claim 9 , wherein the one or more processors are configured to:

transmit the danger warning instruction to an on-board device via a communication connection with the on-board device of the vehicle.

14. The device according to claim 9 , wherein the one or more processors are configured to:

select an environmental monitoring device from a plurality of candidate environmental monitoring devices, each of the plurality of candidate environmental monitoring devices having a communication connection with an on-board device of the vehicle; and

transmit the danger warning instruction to the selected environmental monitoring device, to cause the selected environmental monitoring device to forward the danger warning instruction to the on-board device,

wherein the one or more processors are configured to select the environmental monitoring device from the plurality of candidate environmental monitoring devices based on at least one of:

a distance between each of the plurality of candidate environmental monitoring devices and the vehicle;

whether the plurality of candidate environmental monitoring devices are located in a traveling direction of the vehicle; and

an angle between a position of each of the plurality of candidate environmental monitoring devices and a position of the vehicle in a coordinate system.

15. The device according to claim 9 , wherein each of the plurality of sensing data sets comprises at least one of a type, a size, a position, a speed, and a motion direction of the object in the geographical range.

16. The device according to claim 9 , wherein the one or more processors are configured to:

present the danger warning instruction to a driver of the vehicle, presenting the danger warning instruction to a driver of the vehicle;

provide the danger warning instruction to a controller to assist in driving control of the vehicle, when the automatic driving capability of the vehicle is greater than or equal to the capability threshold.

17. A non-transitory computer readable storage medium having a stored thereon computer program that, when executed by a processor, cause a danger warning method for a vehicle to be implemented, the method comprising:

receiving a plurality of sensing data sets from a plurality of environmental monitoring devices that monitor a plurality of geographical ranges, each of the plurality of sensing data sets comprising relevant information about objects in the corresponding geographical range, and the plurality of environmental monitoring devices being arranged away from the vehicle;

determining a danger degree of respective object in the plurality of geographical ranges with respect to the vehicle based on the plurality of sensing data sets, the danger degree being configured to indicate a possibility that the object will endanger safe driving of the vehicle; and

providing a danger warning instruction to the vehicle in response to determining that the danger degree is greater than a degree threshold;

wherein determining the danger degree comprises:

performing de-redundancy on the plurality of sensing data sets; and

determining the danger degree based on a plurality of de-redundant sensing data sets;

wherein performing de-redundancy on the plurality of sensing data sets comprises:

determining that at least two of the plurality of sensing data sets comprise relevant information about the same object; and

keeping the relevant information about the same object in one of the at least two sensing data sets, and deleting the relevant information about the same object from remaining sensing data sets.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2019
From: ZHANG, ZHUHUA; HU, XING
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 051341/0856 →
Priority Claims (1)
CN 201811654598.0 · Dec 28, 2018 · national
Continuity (1)
Related Publication 20200210461A1 · Jul 2, 2020