IP Library › Granted Patent US 12,313,746
Granted Patent B2
US 12,313,746 · App. 17/511,880 · Granted May 27, 2025

Method, apparatus for superimposing laser point clouds and high-precision map and electronic device

Inventors: Wei Ma (Beijing, CN); Ji Tao (Beijing, CN); Xing Hu (Beijing, CN); Liqi Wang (Beijing, CN); Kun Wang (Beijing, CN)
Assignee: Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd.
G01S17/931G01S7/4808G01S17/89G06T7/521G06V10/26G06T2207/10028G06V20/64
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,313,746
App. No.
17/511,880
Granted
May 27, 2025
Kind
B2
Abstract

The present application discloses a method, an apparatus for superimposing laser point clouds and a high-precision map and an electronic device, comprising: when superimposing the laser point clouds and the high-precision map for visualization, first performing dilution processing on non-road laser point clouds in the laser point clouds to be fused to obtain target non-road laser point clouds, which effectively reduces the amount of data of the laser point clouds to be fused; and performing segmentation processing on the map to be fused to obtain multi-level map data corresponding to the map to be fused, which effectively reduces the amount of data of the map to be fused. In this way, when superimposing the laser point clouds and the high-precision map for visualization, both non-road information may be visualized through the laser point clouds, and road information may be visualized through the high-precision map.

Claims (67)

1. A method for superimposing laser point clouds and a high-precision map, comprising:

acquiring laser point clouds to be fused and a map to be fused respectively, wherein the map to be fused at least comprises a partial high-precision map;

performing dilution processing on non-road laser point clouds in the laser point clouds to be fused to obtain target non-road laser point clouds;

performing segmentation processing on the map to be fused to obtain multi-level map data corresponding to the map to be fused; and

performing superposition processing on the target non-road laser point clouds and the multi-level map data, and visualizing a superposition result;

wherein the performing dilution processing on non-road laser point clouds in the laser point clouds to be fused to obtain target non-road laser point clouds comprises:

determining a dilution ratio;

performing a weighted octree segmentation on the non-road laser point clouds according to the dilution ratio to obtain a non-road laser point cloud corresponding to each of multiple leaf nodes; and

calculating, for each leaf node, a center of gravity within a voxel of the non-road laser point cloud corresponding to the leaf node, and weighting an attribute value of the non-road laser point cloud corresponding to the leaf node to obtain an attribute value of the center of gravity; wherein the attribute value of the center of gravity is target non-road laser point cloud corresponding to the leaf node.

2. The method according to claim 1 , wherein the performing superposition processing on the target non-road laser point clouds and the multi-level map data comprises:

performing chunking processing on the target non-road laser point clouds to obtain multiple target point cloud data blocks corresponding to the target non-road laser point clouds; and

performing superposition processing on the multiple target point cloud data blocks and the multi-level map data based on a visualized view-frustum area range.

3. The method according to claim 2 , wherein the performing superposition processing on the multiple target point cloud data blocks and the multi-level map data based on a visualized view-frustum area range comprises:

screening out point cloud data blocks and map data that meet a multi-level of detail segmentation rule from the multiple target point cloud data blocks and the multi-level map data respectively based on the visualized view-frustum area range; and

performing superposition processing on the point cloud data blocks and the map data that meet the multi-level of detail segmentation rule.

4. The method according to claim 1 , wherein the method further comprises:

performing screening processing on the laser point clouds to be fused to obtain initial non-road laser point clouds; and

performing migration processing on elevations of the initial non-road laser point clouds to obtain the non-road laser point clouds.

5. The method according to claim 4 , wherein when the laser point clouds to be fused further comprises initial road laser point clouds, then the performing migration processing on elevations of the initial non-road laser point clouds to obtain the non-road laser point clouds comprises:

determining an average road elevation corresponding to single frame data in the laser point clouds to be fused;

subtracting the average road elevation from elevations of all laser points in the single frame of data to obtain single frame data after the migration processing; wherein the single frame data after the migration processing comprises road laser point clouds after performing the migration processing on the initial road laser point cloud; and

removing the road laser point clouds after the migration processing from the single frame data after the migration processing to obtain the non-road laser point clouds.

6. The method according to claim 4 , wherein when the laser point clouds to be fused do not comprise initial road laser point clouds, then the performing migration processing on elevations of the initial non-road laser point clouds to obtain the non-road laser point clouds comprises:

determining a previous frame of single frame data having been migrated that is closest to single frame data in the laser point clouds to be fused and a subsequent frame of single frame data having been migrated that is closest to the single frame data in the laser point clouds to be fused;

performing interpolation processing on the previous frame of single frame data and the subsequent frame of single frame data to obtain the single frame data after the migration processing; wherein, the single frame data after the migration processing comprises road laser point clouds after performing the migration processing on the initial road laser point cloud; and

removing the road laser point clouds after the migration processing from the single frame data after the migration processing to obtain the non-road laser point clouds.

7. The method according to claim 1 , wherein the acquiring laser point clouds to be fused comprises:

acquiring initial laser point clouds; and

performing optimizing processing on precision of the initial laser point clouds to obtain the laser point clouds to be fused; wherein precision of the laser point clouds to be fused is higher than the precision of the initial laser point clouds.

8. The method according to claim 1 , wherein when the map to be fused further comprises a standard precision map, the acquiring a map to be fused comprises:

performing optimizing processing on precision of the standard precision map to obtain a processed map; and

performing fusion on the processed map and the high-precision map to obtain the map to be fused.

9. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer execute the method for superimposing the laser point clouds and the high-precision map according to claim 1 .

10. An apparatus for superimposing laser point clouds and a high-precision map, comprising:

at least one processor; and

a memory communicatively connected with the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, to enable the at least one processor to:

acquire laser point clouds to be fused and a map to be fused respectively, wherein the map to be fused at least comprises a partial high-precision map;

perform dilution processing on non-road laser point clouds in the laser point clouds to be fused to obtain target non-road laser point clouds, and perform segmentation processing on the map to be fused to obtain multi-level map data corresponding to the map to be fused;

perform superposition processing on the target non-road laser point clouds and the multi-level map data; and

visualize a superposition result;

wherein the at least one processor is further enabled to:

determine a dilution ratio;

perform a weighted octree segmentation on the non-road laser point clouds according to the dilution ratio to obtain a non-road laser point cloud corresponding to each of the multiple leaf nodes; and

calculate, for each leaf node, a center of gravity within a voxel of the non-road laser point cloud corresponding to the leaf node, and perform weighting on an attribute value of the non-road laser point cloud corresponding to the leaf node to obtain an attribute value of the center of gravity; wherein the attribute value of the center of gravity is target non-road laser point cloud corresponding to the leaf node.

11. The apparatus according to claim 10 , wherein the at least one processor is further enabled to:

perform chunking processing on the target non-road laser point clouds to obtain multiple target point cloud data blocks corresponding to the target non-road laser point clouds; and

perform superposition processing on the multiple target point cloud data blocks and the multi-level map data based on a visualized view-frustum area range.

12. The apparatus according to claim 11 , wherein the at least one processor is further enabled to:

screen out point cloud data blocks and map data that meet a multi-level of detail segmentation rule from the multiple target point cloud data blocks and the multi-level map data respectively based on the visualized view-frustum area range;

perform superposition processing on the point cloud data blocks and the map data that meet the multi-level of detail segmentation rule.

13. The apparatus according to claim 10 , wherein the at least one processor is further enabled to:

perform screening processing on the laser point clouds to be fused to obtain initial non-road laser point clouds; and

perform migration processing on elevations of the initial non-road laser point clouds to obtain the non-road laser point clouds.

14. The apparatus according to claim 13 , wherein when the laser point clouds to be fused further comprises initial road laser point clouds, then the at least one processor is further enabled to:

determine an average road elevation corresponding to single frame data in the laser point clouds to be fused;

subtract the average road elevation from elevations of all laser points in the single frame data to obtain the single frame data after the migration processing; wherein the single frame data after the migration processing comprises the road laser point clouds after performing the migration processing on the initial road laser point clouds; and

remove the road laser point clouds after the migration processing from the single frame data after the migration processing to obtain the non-road laser point clouds.

15. The apparatus according to claim 13 , wherein when the laser point clouds to be fused do not comprise initial road laser point clouds, then the at least one processor is further enabled to:

determine a previous frame of single frame data having been migrated that is closest to single frame data in the laser point clouds to be fused and a subsequent frame of single frame data having been migrated that is closest to the single frame data in the laser point clouds to be fused;

perform interpolation processing on the previous frame of single frame data and the subsequent frame of single frame data to obtain the single frame data after the migration processing; wherein, the single frame data after the migration processing comprises the road laser point clouds after performing the migration processing on the initial road laser point clouds; and

remove the road laser point clouds after the migration processing from the single frame data after the migration processing to obtain the non-road laser point clouds.

16. The apparatus according to claim 10 , wherein the at least one processor is further enabled to:

acquire initial laser point clouds; and

perform optimizing processing on precision of the initial laser point clouds to obtain the laser point clouds to be fused; wherein the precision of the laser point clouds to be fused is higher than the precision of the initial laser point clouds.

17. The apparatus according to claim 10 , wherein when the map to be fused further comprises a standard precision map, the at least one processor is further enabled to:

perform optimizing processing on precision of the standard precision map to obtain a processed map; and

perform fusion on the processed map and the high-precision map to obtain the map to be fused.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: MA, WEI; TAO, JI; HU, XING; WANG, LIQI; WANG, KUN
To: APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 057930/0915 →
Priority Claims (1)
CN 202110289938.X · Mar 18, 2021 · national
Continuity (1)
Related Publication 20220050210A1 · Feb 17, 2022
References Cited (38)
US 11763478B1 · Yang · 2023 [cited by examiner]
US 20140267279A1 · Kontkanen · 2014 [cited by applicant]
US 20150178977A1 · Kontkanen · 2015 [cited by examiner]
US 20200025935A1 · Liang · 2020 [cited by examiner]
US 20200184718A1 · Chiu et al. · 2020 [cited by applicant]
US 20200401816A1 · Schroeter · 2020 [cited by applicant]
US 20210063200A1 · Kroepfl · 2021 [cited by examiner]
US 20210105494A1 · Sugio · 2021 [cited by examiner]
US 20210341940A1 · Baik · 2021 [cited by examiner]
US 20210404814A1 · Hess · 2021 [cited by examiner]
US 20210405200A1 · Ding · 2021 [cited by examiner]
US 20220032452A1 · Casas · 2022 [cited by examiner]
US 20220113159A1 · Hou · 2022 [cited by examiner]
US 20220214457A1 · Liang · 2022 [cited by examiner]
CN 107704879A · 2018 [cited by applicant]
CN 107944018A · 2018 [cited by applicant]
CN 108334523A · 2018 [cited by applicant]
CN 109064506A · 2018 [cited by applicant]
CN 110163065A · 2019 [cited by applicant]
CN 111105496A · 2020 [cited by applicant]
CN 111127530A · 2020 [cited by applicant]
CN 111462029A · 2020 [cited by applicant]
CN 111462072A · 2020 [cited by applicant]
CN 112082565A · 2020 [cited by applicant]
CN 112184603A · 2021 [cited by applicant]
JP 2020112876A · 2020 [cited by applicant]
WO 2019037484A1 · 2019 [cited by applicant]
Zhao Saishuai, “Exploration on the Construction Method of Ningbo Digital Highway High-precision Map”, Geospatial Information, Sep. 2020, vol. 18, No. 9, 7 pages. [cited by applicant]
Notice of Reasons for Refusal of corresponding Japanese Patent Application No. 2021-179134, dated Aug. 29, 2022, 7 pages. [cited by applicant]
The Second Office Action of corresponding Chinese Patent Application No. 202110289938X, dated Jul. 21, 2022, 10 pages. [cited by applicant]
Notification of Grant Patent Right for Invention of corresponding Chinese Application No. 202110289938.X, dated Nov. 1, 2022, 6 pages. [cited by applicant]
European Search Report of corresponding European application No. 21204946.4, dated May 10, 2022, 9 pages. [cited by applicant]
Office Action of corresponding Chinese application No. 202110289938.X, dated Apr. 26, 2022, 10 pages. [cited by applicant]
Translation of Office Action of corresponding Chinese application No. 202110289938.X, dated Apr. 26, 2022, 2 pages. [cited by applicant]
Li et al., “A Review of Point Cloud Compression”, ZTE Technology Journal, vol. 27 No. 1, Feb. 2021, 5 pages. [cited by applicant]
Yang et al., “Research on the Key Technologies of High Precision Navigation Map Based on Laser Point Cloud Scanning”, Mar. 2018, 4 pages. [cited by applicant]
Rusu et al., “Towards 3D Point Cloud Based Object Maps for Household Environments”, Mar. 2, 2010, 29 pages. [cited by applicant]
Xiang et al., “A Novel Octree-Based 3-D Fully Convolutional Neural Network for Point Cloud Classification in Road Environment”, IEEE Transactions on Geoscience and Remote Sensing, vol. 57, No. 10, Oct. 2019, 20 pages. [cited by applicant]