IP Library › Granted Patent US 12,293,574
Granted Patent B2
US 12,293,574 · App. 17/814,461 · Granted May 6, 2025

Obstacle detection method, electronic device and storage medium

Inventors: Lei Zhang (Beijing, CN); Kai Yang (Beijing, CN); Qijuan Yin (Beijing, CN); Wuzhao Zhang (Beijing, CN); Xiaoyan Wang (Beijing, CN)
Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
G06V10/80G06V10/776G06V20/58
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,293,574
App. No.
17/814,461
Granted
May 6, 2025
Kind
B2
Abstract

There is provided an obstacle detection method, an electronic device and a storage medium, which relates to the field of computer technologies, and particularly to the fields of autonomous driving technologies, intelligent transportation technologies, Internet of Things technologies, deep learning technologies, or the like. The method for detecting obstacle includes: detecting an obstacle in a vehicle traveling process using plural obstacle detection manners to obtain plural initial detection results of the obstacle, the plural initial detection results corresponding to the plural obstacle detection manners; fusing the plural initial detection results to obtain a fusion result; and obtaining a final detection result of the obstacle based on the fusion result.

Claims (51)

1. A method for detecting obstacle, comprising:

detecting an obstacle in a vehicle traveling process using plural obstacle detection manners to obtain plural initial detection results of the obstacle, the plural initial detection results corresponding to the plural obstacle detection manners;

fusing the plural initial detection results to obtain a fusion result; and

obtaining a final detection result of the obstacle based on the fusion result,

wherein each of the plural initial detection results is used to indicate whether an obstacle exists, and the fusing the plural initial detection results to obtain a fusion result comprises:

selecting an initial detection result used to indicate the existence of the obstacle from the plural initial detection results as a to-be-processed detection result;

obtaining fusion information of the to-be-processed detection result; and

obtaining the fusion result based on the fusion information of the to-be-processed detection result,

wherein there exist plural to-be-processed detection results, and the fusion information of the to-be-processed detection results comprises: accuracy information of each of the plural to-be-processed detection results and relevance information between every two of the plural to-be-processed detection results; and the obtaining the fusion result based on the fusion information of the to-be-processed detection result comprises:

sorting the accuracy information of all the to-be-processed detection results in a descending order to obtain sorted accuracy information; and

obtaining the fusion result using a preset functional relationship based on the sorted accuracy information and the relevance information between the every two to-be-processed detection results, the preset functional relationship being used to indicate a relationship between the fusion result and the sorted accuracy information and the relevance information, wherein the sorted accuracy information comprises two pieces of accuracy information, and in the preset functional relationship, the fusion result is in a direct proportion relationship with one of the two pieces of accuracy information and a product of the other of the two pieces of accuracy information and the relevance information,

wherein the obtaining a final detection result of the obstacle based on the fusion result comprises:

if the fusion information is greater than or equal to a preset threshold, determining that the final detection result is the existence of the obstacle.

2. The method according to claim 1 , wherein the obtaining fusion information of the to-be-processed detection result comprises:

detecting environmental information of the vehicle by a pre-established accuracy detection model to obtain the accuracy information of each to-be-processed detection result; and

obtaining relevance information between every two obstacle detection manners corresponding to the every two to-be-processed detection results from a pre-configured configuration file, and taking the obtained relevance information as the relevance information between the every two to-be-processed detection results.

3. An electronic device, comprising:

at least one processor; and

a memory communicatively connected with the at least one processor;

wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform a method for detecting obstacle, wherein the method comprises:

detecting an obstacle in a vehicle traveling process using plural obstacle detection manners to obtain plural initial detection results of the obstacle, the plural initial detection results corresponding to the plural obstacle detection manners;

fusing the plural initial detection results to obtain a fusion result; and

obtaining a final detection result of the obstacle based on the fusion result,

wherein each of the plural initial detection results is used to indicate whether an obstacle exists, and the fusing the plural initial detection results to obtain a fusion result comprises:

selecting an initial detection result used to indicate the existence of the obstacle from the plural initial detection results as a to-be-processed detection result;

obtaining fusion information of the to-be-processed detection result; and

obtaining the fusion result based on the fusion information of the to-be-processed detection result,

wherein there exist plural to-be-processed detection results, and the fusion information of the to-be-processed detection results comprises: accuracy information of each of the plural to-be-processed detection results and relevance information between every two of the plural to-be-processed detection results; and the obtaining the fusion result based on the fusion information of the to-be-processed detection result comprises:

sorting the accuracy information of all the to-be-processed detection results in a descending order to obtain sorted accuracy information; and

obtaining the fusion result using a preset functional relationship based on the sorted accuracy information and the relevance information between the every two to-be-processed detection results, the preset functional relationship being used to indicate a relationship between the fusion result and the sorted accuracy information and the relevance information, wherein the sorted accuracy information comprises two pieces of accuracy information, and in the preset functional relationship, the fusion result is in a direct proportion relationship with one of the two pieces of accuracy information and a product of the other of the two pieces of accuracy information and the relevance information,

wherein the obtaining a final detection result of the obstacle based on the fusion result comprises:

if the fusion information is greater than or equal to a preset threshold, determining that the final detection result is the existence of the obstacle.

4. The electronic device according to claim 3 , wherein the obtaining fusion information of the to-be-processed detection result comprises:

detecting environmental information of the vehicle by a pre-established accuracy detection model to obtain the accuracy information of each to-be-processed detection result; and

obtaining relevance information between every two obstacle detection manners corresponding to the every two to-be-processed detection results from a pre-configured configuration file, and take the obtained relevance information as the relevance information between the every two to-be-processed detection results.

5. A non-transitory computer readable storage medium with computer instructions stored thereon, wherein the computer instructions are used for causing a method for detecting obstacle, wherein the method comprises:

detecting an obstacle in a vehicle traveling process using plural obstacle detection manners to obtain plural initial detection results of the obstacle, the plural initial detection results corresponding to the plural obstacle detection manners;

fusing the plural initial detection results to obtain a fusion result; and

obtaining a final detection result of the obstacle based on the fusion result,

wherein each of the plural initial detection results is used to indicate whether an obstacle exists, and the fusing the plural initial detection results to obtain a fusion result comprises:

selecting an initial detection result used to indicate the existence of the obstacle from the plural initial detection results as a to-be-processed detection result;

obtaining fusion information of the to-be-processed detection result; and

obtaining the fusion result based on the fusion information of the to-be-processed detection result,

wherein there exist plural to-be-processed detection results, and the fusion information of the to-be-processed detection results comprises: accuracy information of each of the plural to-be-processed detection results and relevance information between every two of the plural to-be-processed detection results; and the obtaining the fusion result based on the fusion information of the to-be-processed detection result comprises:

sorting the accuracy information of all the to-be-processed detection results in a descending order to obtain sorted accuracy information; and

obtaining the fusion result using a preset functional relationship based on the sorted accuracy information and the relevance information between the every two to-be-processed detection results, the preset functional relationship being used to indicate a relationship between the fusion result and the sorted accuracy information and the relevance information, wherein the sorted accuracy information comprises two pieces of accuracy information, and in the preset functional relationship, the fusion result is in a direct proportion relationship with one of the two pieces of accuracy information and a product of the other of the two pieces of accuracy information and the relevance information,

wherein the obtaining a final detection result of the obstacle based on the fusion result comprises:

if the fusion information is greater than or equal to a preset threshold, determining that the final detection result is the existence of the obstacle.

6. The non-transitory computer readable storage medium according to claim 5 , the obtaining fusion information of the to-be-processed detection result comprises:

detecting environmental information of the vehicle by a pre-established accuracy detection model to obtain the accuracy information of each to-be-processed detection result; and

obtaining relevance information between every two obstacle detection manners corresponding to the every two to-be-processed detection results from a pre-configured configuration file, and taking the obtained relevance information as the relevance information between the every two to-be-processed detection results.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2022
From: ZHANG, LEI; YANG, KAI; YIN, QIJUAN; ZHANG, WUZHAO; WANG, XIAOYAN
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 060599/0533 →
Priority Claims (1)
CN 202111039230.5 · Sep 6, 2021 · national
Continuity (1)
Related Publication 20230072632A1 · Mar 9, 2023
References Cited (64)
US 9919704B1 · Kundu · 2018 [cited by examiner]
US 11126197B2 · Chen · 2021 [cited by examiner]
US 11391579B2 · Forsberg · 2022 [cited by examiner]
US 11597397B2 · Kondo · 2023 [cited by examiner]
US 11698459B2 · Chi · 2023 [cited by examiner]
US 20180165829A1 · Hong · 2018 [cited by examiner]
US 20180349715A1 · Gupta · 2018 [cited by examiner]
US 20200042781A1 · Zuckerman · 2020 [cited by examiner]
US 20200104612A1 · Chen · 2020 [cited by examiner]
US 20200175714A1 · Hong et al. · 2020 [cited by applicant]
US 20200294257A1 · Yoo · 2020 [cited by examiner]
US 20200364472A1 · Liu · 2020 [cited by examiner]
US 20210224562A1 · Zhan · 2021 [cited by examiner]
US 20220383640A1 · Vora · 2022 [cited by examiner]
US 20230061830A1 · Choi · 2023 [cited by examiner]
US 20230072632A1 · Zhang · 2023 [cited by examiner]
US 20230072730A1 · Yin · 2023 [cited by examiner]
US 20230222618A1 · Yang · 2023 [cited by examiner]
US 20230306750A1 · Zhao · 2023 [cited by examiner]
US 20240005626A1 · Zhang · 2024 [cited by examiner]
US 20240054794A1 · Valstar · 2024 [cited by examiner]
US 20240151855A1 · Chattopadhyay · 2024 [cited by examiner]
US 20240161474A1 · Zu · 2024 [cited by examiner]
US 20240331403A1 · Shen · 2024 [cited by examiner]
US 20240404025A1 · Zhang · 2024 [cited by examiner]
CN 105372654A · 2016 [cited by applicant]
CN 106802668A · 2017 [cited by applicant]
CN 108313088A · 2018 [cited by applicant]
CN 108482427A · 2018 [cited by applicant]
CN 108764108A · 2018 [cited by applicant]
CN 109188460A · 2019 [cited by applicant]
CN 109270524A · 2019 [cited by applicant]
CN 109544990A · 2019 [cited by applicant]
CN 110609570A · 2019 [cited by applicant]
CN 111198371A · 2020 [cited by applicant]
CN 111273268A · 2020 [cited by applicant]
CN 111308461A · 2020 [cited by applicant]
CN 111338383A · 2020 [cited by applicant]
CN 111551938A · 2020 [cited by applicant]
CN 111753765A · 2020 [cited by applicant]
CN 112113578A · 2020 [cited by applicant]
CN 212322114U · 2021 [cited by applicant]
CN 112330746A · 2021 [cited by applicant]
CN 112394726A · 2021 [cited by applicant]
CN 112639821A · 2021 [cited by applicant]
CN 112651359A · 2021 [cited by applicant]
CN 113269260A · 2021 [cited by applicant]
JP 2002099906A · 2002 [cited by applicant]
JP 2015078926A · 2015 [cited by applicant]
JP 2017159801A · 2017 [cited by applicant]
JP 2019175423A · 2019 [cited by applicant]
JP 2020190845A · 2020 [cited by applicant]
KR 101803195B1 · 2017 [cited by applicant]
KR 20180068578A · 2018 [cited by applicant]
WO 2017154456A1 · 2017 [cited by applicant]
Extended European Search Report for EP22175339.5, issued on Oct. 28, 2022, 7 pgs. [cited by applicant]
First office action for CN202111039230.5, issued on Apr. 27, 2023, 11 pgs. [cited by applicant]
Lei Zhang, et al., Target Detection and Tracking System of Unmanned Surface Vehicles, Dec. 31, 2018, 1 pg. [cited by applicant]
First office action for JP2022-122815, issued on Aug. 15, 2023, 2 pgs. [cited by applicant]
Guang-yao Zhai, et al., Tramway Obstacles Detection Based On Information Fusion of MMV, Sep. 30, 2017, 17 pgs. [cited by applicant]
Linli Lu, et al., Fast Obstacle Detection Based On Multi-Sensor Information Fusion, Nov. 24, 2014, 7 pgs. [cited by applicant]
Notice of allowance for CN202111039230.5, issued on Aug. 2, 2023, 4 pgs. [cited by applicant]
First office action for KR10-2022-0092526, issued on Nov. 29, 2023, 6 pgs. [cited by applicant]
Notice of Allowance for JP2022-122815 issued on Feb. 13, 2024, 1 pg. [cited by applicant]