IP Library Granted Patent US 11,579,307
Granted Patent B2
US 11,579,307 · App. 16/915,541 · Granted Feb 14, 2023

Method and apparatus for detecting obstacle

Inventors: Shuang Zhang (Beijing, CN); Xiang Liu (Beijing, CN); Bin Gao (Beijing, CN); Xiaoxing Zhu (Beijing, CN); Jingjing Xue (Beijing, CN); Fan Yang (Beijing, CN); Junping Wang (Beijing, CN); Chengfa Wang (Beijing, CN)
Assignee: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
G01S17/931G01S7/4808G01S17/89
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,579,307
App. No.
16/915,541
Granted
Feb 14, 2023
Kind
B2
Abstract

Embodiments of the present disclosure provide a method and apparatus for detecting an obstacle. The method may include: acquiring first point cloud data collected by a first vehicle-mounted laser radar and second point cloud data collected by a second vehicle-mounted laser radar, where a height of the first vehicle-mounted laser radar from a ground is greater than a height of the second vehicle-mounted laser radar from the ground, and a number of wiring harnesses of the first vehicle-mounted laser radar is greater than a number of wiring harnesses of the second vehicle-mounted laser radar; performing ground estimation based on the first point cloud data; filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data; and performing obstacle detection based on the second point cloud data after the ground point is filtered out.

Claims (50)

1. A method for detecting an obstacle, comprising:

acquiring first point cloud data collected by a first vehicle-mounted laser radar and second point cloud data collected by a second vehicle-mounted laser radar, wherein the first vehicle-mounted laser radar and the second vehicle-mounted laser radar are mounted on a given autonomous driving vehicle, a height of the first vehicle-mounted laser radar from a ground is greater than a height of the second vehicle-mounted laser radar from the ground, and a number of wiring harnesses of the first vehicle-mounted laser radar is greater than a number of wiring harnesses of the second vehicle-mounted laser radar;

performing ground estimation based on the first point cloud data;

filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data; and

performing obstacle detection based on the second point cloud data after the ground point is filtered out,

wherein the performing ground estimation based on the first point cloud data comprises:

dividing the first point cloud data into a plurality of preset spatial grids, performing downsampling on the first point cloud data in each grid, and fitting a ground in the grid to obtain a first ground fitting result;

for each data point in a grid, calculating a distance between the data point and the fitted ground, using the data point as a new ground point in response to the distance being less than a threshold, and updating the first ground fitting result of the grid based on the new ground point to obtain a second ground fitting result;

calculating an angle between grounds in adjacent grids, smoothing the angle in response to the angle being smaller than a preset angle, and updating the second ground fitting result to obtain a third ground fitting result; and

obtaining the ground estimation result of the first point cloud data based on the third ground fitting result.

2. The method according to claim 1 , wherein the filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data comprises:

calculating a distance between a data point in the second point cloud data and the ground estimated based on the first point cloud data, and ascertaining a data point, of which a distance from the ground estimated based on the first point cloud data is less than a preset distance threshold, in the second point cloud data as the ground point; and

filtering out the ground point in the second point cloud data.

3. The method according to claim 1 , wherein the performing obstacle detection based on the second point cloud data after the ground point is filtered out comprises:

fusing the first point cloud data and the second point cloud data after the ground point is filtered out, to perform the obstacle detection.

4. The method according to claim 1 , wherein the second laser radar is a single-line laser radar.

5. An apparatus for detecting an obstacle, comprising:

at least one processor; and

a memory storing instructions, wherein the instructions when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

acquiring first point cloud data collected by a first vehicle-mounted laser radar and second point cloud data collected by a second vehicle-mounted laser radar, wherein the first vehicle-mounted laser radar and the second vehicle-mounted laser radar are mounted on a given autonomous driving vehicle, a height of the first vehicle-mounted laser radar from a ground is greater than a height of the second vehicle-mounted laser radar from the ground, and a number of wiring harnesses of the first vehicle-mounted laser radar is greater than a number of wiring harnesses of the second vehicle-mounted laser radar;

performing ground estimation based on the first point cloud data;

filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data; and

performing obstacle detection based on the second point cloud data after the ground point is filtered out,

wherein the performing ground estimation based on the first point cloud data comprises:

dividing the first point cloud data into a plurality of preset spatial grids, performing downsampling on the first point cloud data in each grid, and fitting a ground in the grid to obtain a first ground fitting result;

for each data point in a grid, calculating a distance between the data point and the fitted ground, using the data point as a new ground point in response to the distance being less than a threshold, and updating the first ground fitting result of the grid based on the new ground point to obtain a second ground fitting result;

calculating an angle between grounds in adjacent grids, smoothing the angle in response to the angle being smaller than a preset angle, and updating the second ground fitting result to obtain a third ground fitting result; and

obtaining the ground estimation result of the first point cloud data based on the third ground fitting result.

6. The apparatus according to claim 5 , wherein the filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data comprises:

calculating a distance between a data point in the second point cloud data and the ground estimated based on the first point cloud data, and ascertaining a data point, of which a distance from the ground estimated based on the first point cloud data is less than a preset distance threshold, in the second point cloud data as the ground point; and

filtering out the ground point in the second point cloud data.

7. The apparatus according to claim 5 , wherein the performing obstacle detection based on the second point cloud data after the ground point is filtered out comprises:

fusing the first point cloud data and the second point cloud data after the ground point is filtered out, to perform the obstacle detection.

8. The apparatus according to claim 5 , wherein the second laser radar is a single-line laser radar.

9. A non-transitory computer readable medium, storing a computer program, wherein the program, when executed by a processor, causes the processor to perform operations, the operations comprising:

acquiring first point cloud data collected by a first vehicle-mounted laser radar and second point cloud data collected by a second vehicle-mounted laser radar, wherein the first vehicle-mounted laser radar and the second vehicle-mounted laser radar are mounted on a given autonomous driving vehicle, a height of the first vehicle-mounted laser radar from a ground is greater than a height of the second vehicle-mounted laser radar from the ground, and a number of wiring harnesses of the first vehicle-mounted laser radar is greater than a number of wiring harnesses of the second vehicle-mounted laser radar;

performing ground estimation based on the first point cloud data;

filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data; and

performing obstacle detection based on the second point cloud data after the ground point is filtered out,

wherein the performing ground estimation based on the first point cloud data comprises:

dividing the first point cloud data into a plurality of preset spatial grids, performing downsampling on the first point cloud data in each grid, and fitting a ground in the grid to obtain a first ground fitting result

for each data point in a grid, calculating a distance between the data point and the fitted ground, using the data point as a new ground point in response to the distance being less than a threshold, and updating the first ground fitting result of the grid based on the new ground point to obtain a second ground fitting result;

calculating an angle between grounds in adjacent grids, smoothing the angle in response to the angle being smaller than a preset angle, and updating the second ground fitting result to obtain a third ground fitting result; and

obtaining the ground estimation result of the first point cloud data based on the third ground fitting result.

10. The non-transitory computer readable medium according to claim 9 , wherein the filtering out a ground point in the second point cloud data according to the ground estimation result of the first point cloud data comprises:

calculating a distance between a data point in the second point cloud data and the ground estimated based on the first point cloud data, and ascertaining a data point, of which a distance from the ground estimated based on the first point cloud data is less than a preset distance threshold, in the second point cloud data as the ground point; and

filtering out the ground point in the second point cloud data.

11. The non-transitory computer readable medium according to claim 9 , wherein the performing obstacle detection based on the second point cloud data after the ground point is filtered out comprises:

fusing the first point cloud data and the second point cloud data after the ground point is filtered out, to perform the obstacle detection.

12. The non-transitory computer readable medium according to claim 9 , wherein the second laser radar is a single-line laser radar.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2021
From: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
To: APOLLO INTELLIGENT DRIVING TECHNOLOGY (BEIJING) CO., LTD.
Reel/Frame 058241/0248 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2020
From: ZHANG, SHUANG; LIU, XIANG; GAO, BIN; ZHU, XIAOXING; XUE, JINGJING; YANG, FAN; WANG, JUNPING; WANG, CHENGFA
To: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
Reel/Frame 053090/0653 →
Priority Claims (1)
CN 201911024230.0 · Oct 25, 2019 · national
Continuity (1)
Related Publication 20210124054A1 · Apr 29, 2021