IP Library › Granted Patent US 12,340,525
Granted Patent B2
US 12,340,525 · App. 17/970,285 · Granted Jun 24, 2025

High-definition map creation method and device, and electronic device

Inventors: Wendong Ding (Beijing, CN); Yingying Qin (Beijing, CN); Yangyang Dai (Beijing, CN); Yucheng Zhang (Beijing, CN); Liang Peng (Beijing, CN); Guowei Wan (Beijing, CN)
Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
G06T7/32G01S17/89G06T7/11G06T7/70B60W60/001B60W2556/40G06T2207/10028G06T2207/20021G06T2207/30241G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,525
App. No.
17/970,285
Granted
Jun 24, 2025
Kind
B2
Abstract

A high-definition map creation method includes: obtaining point cloud data collected with respect to a target region, the point cloud data including K frames of point clouds and an initial pose of each frame of point cloud, K being an integer greater than 1; associating the K frames of point clouds with each other in accordance with the initial pose to obtain a first point cloud relation graph of the K frames of point clouds; performing point cloud registration on the K frames of point clouds in accordance with the first point cloud relation graph and the initial pose to obtain a target relative pose of each frame of point cloud in the K frames of point clouds; and splicing the K frames of point clouds in accordance with the target relative pose to obtain a point cloud map of the target region.

Claims (69)

1. A high-definition map creation method implemented by an electronic device, the high-definition map creation method comprising:

obtaining point cloud data collected with respect to a target region, the point cloud data comprising K frames of point clouds and an initial pose of each frame of point cloud, K being an integer greater than 1;

associating the K frames of point clouds with each other in accordance with the initial pose, so as to obtain a first point cloud relation graph of the K frames of point clouds;

performing point cloud registration on the K frames of point clouds in accordance with the first point cloud relation graph and the initial pose, so as to obtain a target relative pose of each frame of point cloud in the K frames of point clouds; and

splicing the K frames of point clouds in accordance with the target relative pose, so as to obtain a point cloud map of the target region,

wherein the associating the K frames of point clouds with each other in accordance with the initial pose so as to obtain the first point cloud relation graph of the K frames of point clouds comprises:

dividing the K frames of point clouds into M blocks in accordance with the initial pose, adjacent blocks comprising at least one same frame of point cloud, M being a positive integer;

associating the frames of point clouds in each block with each other, so as to obtain a second point cloud relation graph of the block; and

associating the M second point cloud relation graphs of the M blocks with each other in accordance with the at least one same frame of point cloud, so as to obtain the first point cloud relation graph.

2. The high-definition map creation method according to claim 1 , wherein the dividing the K frames of point clouds into the M blocks in accordance with the initial pose comprises:

dividing the K frames of point clouds into N sub-blocks in accordance with the initial pose and target sub-trajectories, each sub-block comprising frames of point clouds collected on one target sub-trajectory, each target sub-trajectory being a consecutive trajectory on any point cloud collection trajectory of L point cloud collection trajectories with respect to the target region, one point cloud collection trajectory comprising one target sub-trajectory or a plurality of consecutive target sub-trajectories, L being a positive integer, and N being an integer greater than 1; and

dividing the N sub-blocks into M blocks in accordance with a positional relationship among the sub-blocks, each block comprising the sub-blocks in a space with a predetermined size, at least a part of sub-blocks in a first block being different from sub-blocks in a second block, the first block being any block in the M blocks, and the second block being a block in the M blocks different from the first block.

3. The high-definition map creation method according to claim 1 , wherein the associating the frames of point clouds in each block with each other so as to obtain the second point cloud relation graph comprises at least one of:

with respect to each frame of point cloud in the block, associating point clouds in the block spaced apart from the point cloud by a distance within a predetermined range with each other, so as to obtain the second point cloud relation graph;

with respect to any point cloud collection trajectory in the target region, associating the frames of point clouds in the block collected at adjacent time points in accordance with the point cloud collection trajectory and a direction of the point cloud collection trajectory, so as to obtain the second point cloud relation graph; or

associating a first target frame of point cloud in the block collected in accordance with a first point cloud collection trajectory with a second target frame of point cloud in the block collected in accordance with a second point cloud collection trajectory, so as to obtain the second point cloud relation graph, the first point cloud collection trajectory and the second point cloud collection trajectory being different point cloud collection trajectories with respect to the target region, the second target frame of point cloud being located in a line perpendicular to a direction of the first point cloud collection trajectory, and an initial pose of the second target frame of point cloud being adjacent to an initial pose of the first target frame of point cloud.

4. The high-definition map creation method according to claim 1 , wherein the performing the point cloud registration on the K frames of point clouds in accordance with the first point cloud relation graph and the initial pose so as to obtain the target relative pose of each frame of point cloud in the K frames of point clouds comprises:

taking each frame of point cloud in the K frames of point clouds as a node, so as to obtain K nodes corresponding to the K frames of point clouds respectively;

taking an association relation among the frames of points in the first point cloud relation graph as an edge constraint on the K nodes, and optimizing a pose of each node in the K nodes in accordance with the initial pose, so as to obtain a first relative pose of each node in the K nodes; and

determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the first relative pose of each node in the K nodes.

5. The high-definition map creation method according to claim 4 , wherein the K frames of point clouds are divided into M blocks, each block comprises N sub-blocks, and the determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the first relative pose of each node in the K nodes comprises:

obtaining P target nodes in the K nodes, each target node being a node corresponding to a third target frame of point cloud in the sub-block, P being an integer greater than 1;

taking an association relation among the P target nodes determined in accordance with the first relative pose of each node in the P target nodes as an edge constraint on the P target nodes, and optimizing the pose of each target node in the P target nodes in accordance with the initial pose of each target node in the P target nodes, so as to obtain a second relative pose of each target node in the P target nodes; and

determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the second relative pose of each target node in the P target nodes.

6. The high-definition map creation method according to claim 5 , wherein the determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the second relative pose of each target node in the P target nodes comprises:

in the case that a target difference is smaller than a predetermined threshold, optimizing the pose of each node in the K nodes in accordance with the second relative pose of each target node in the P target nodes and the initial pose of each node in the K nodes, so as to obtain the target relative pose of each frame of point cloud in the K frames of point clouds, wherein the target difference is a difference between P second relative poses of the P target nodes and P first relative poses of the P target nodes.

7. The high-definition map creation method according to claim 4 , wherein prior to optimizing the pose of each node in the K nodes in accordance with the initial pose so as to obtain the first relative pose of each node in the K nodes, the high-definition map creation method further comprises:

obtaining target altitude values of L point cloud collection trajectories with respect to the target region, and the optimizing the pose of each node in the K nodes in accordance with the initial pose so as to obtain the first relative pose of each node in the K nodes comprises taking the target altitude values as a constraint on an altitude average in the relative pose, and optimizing the pose of each node in the K nodes in accordance with the initial pose, so as to obtain the first relative pose of each node in the K nodes.

8. An electronic device, comprising at least one processor, and a memory in communication with the at least one processor, wherein the memory is configured to store therein an instruction to be executed by the at least one processor, and the instruction is executed by the at least one processor so as to implement a high-definition map creation method,

the high-definition map creation method comprising:

obtaining point cloud data collected with respect to a target region, the point cloud data comprising K frames of point clouds and an initial pose of each frame of point cloud, K being an integer greater than 1;

associating the K frames of point clouds with each other in accordance with the initial pose, so as to obtain a first point cloud relation graph of the K frames of point clouds;

performing point cloud registration on the K frames of point clouds in accordance with the first point cloud relation graph and the initial pose, so as to obtain a target relative pose of each frame of point cloud in the K frames of point clouds; and

splicing the K frames of point clouds in accordance with the target relative pose, so as to obtain a point cloud map of the target region,

wherein the associating the K frames of point clouds with each other in accordance with the initial pose so as to obtain the first point cloud relation graph of the K frames of point clouds comprises:

dividing the K frames of point clouds into M blocks in accordance with the initial pose, adjacent blocks comprising at least one same frame of point cloud, M being a positive integer;

associating the frames of point clouds in each block with each other, so as to obtain a second point cloud relation graph of the block; and

associating the M second point cloud relation graphs of the M blocks with each other in accordance with the at least one same frame of point cloud, so as to obtain the first point cloud relation graph.

9. The electronic device according to claim 8 , wherein the dividing the K frames of point clouds into the M blocks in accordance with the initial pose comprises:

dividing the K frames of point clouds into N sub-blocks in accordance with the initial pose and target sub-trajectories, each sub-block comprising frames of point clouds collected on one target sub-trajectory, each target sub-trajectory being a consecutive trajectory on any point cloud collection trajectory of L point cloud collection trajectories with respect to the target region, one point cloud collection trajectory comprising one target sub-trajectory or a plurality of consecutive target sub-trajectories, L being a positive integer, and N being an integer greater than 1; and

dividing the N sub-blocks into M blocks in accordance with a positional relationship among the sub-blocks, each block comprising the sub-blocks in a space with a predetermined size, at least a part of sub-blocks in a first block being different from sub-blocks in a second block, the first block being any block in the M blocks, and the second block being a block in the M blocks different from the first block.

10. The electronic device according to claim 8 , wherein the associating the frames of point clouds in each block with each other so as to obtain the second point cloud relation graph comprises at least one of:

with respect to each frame of point cloud in the block, associating point clouds in the block spaced apart from the point cloud by a distance within a predetermined range with each other, so as to obtain the second point cloud relation graph;

with respect to any point cloud collection trajectory in the target region, associating the frames of point clouds in the block collected at adjacent time points in accordance with the point cloud collection trajectory and a direction of the point cloud collection trajectory, so as to obtain the second point cloud relation graph; or

associating a first target frame of point cloud in the block collected in accordance with a first point cloud collection trajectory with a second target frame of point cloud in the block collected in accordance with a second point cloud collection trajectory, so as to obtain the second point cloud relation graph, the first point cloud collection trajectory and the second point cloud collection trajectory being different point cloud collection trajectories with respect to the target region, the second target frame of point cloud being located in a line perpendicular to a direction of the first point cloud collection trajectory, and an initial pose of the second target frame of point cloud being adjacent to an initial pose of the first target frame of point cloud.

11. The electronic device according to claim 8 , wherein the performing the point cloud registration on the K frames of point clouds in accordance with the first point cloud relation graph and the initial pose so as to obtain the target relative pose of each frame of point cloud in the K frames of point clouds comprises:

taking each frame of point cloud in the K frames of point clouds as a node, so as to obtain K nodes corresponding to the K frames of point clouds respectively;

taking an association relation among the frames of points in the first point cloud relation graph as an edge constraint on the K nodes, and optimizing a pose of each node in the K nodes in accordance with the initial pose, so as to obtain a first relative pose of each node in the K nodes; and

determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the first relative pose of each node in the K nodes.

12. The electronic device according to claim 11 , wherein the K frames of point clouds are divided into M blocks, each block comprises N sub-blocks, and the determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the first relative pose of each node in the K nodes comprises:

obtaining P target nodes in the K nodes, each target node being a node corresponding to a third target frame of point cloud in the sub-block, P being an integer greater than 1;

taking an association relation among the P target nodes determined in accordance with the first relative pose of each node in the P target nodes as an edge constraint on the P target nodes, and optimizing the pose of each target node in the P target nodes in accordance with the initial pose of each target node in the P target nodes, so as to obtain a second relative pose of each target node in the P target nodes; and

determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the second relative pose of each target node in the P target nodes.

13. The electronic device according to claim 12 , wherein the determining the target relative pose of each frame of point cloud in the K frames of point clouds in accordance with the second relative pose of each target node in the P target nodes comprises:

in the case that a target difference is smaller than a predetermined threshold, optimizing the pose of each node in the K nodes in accordance with the second relative pose of each target node in the P target nodes and the initial pose of each node in the K nodes, so as to obtain the target relative pose of each frame of point cloud in the K frames of point clouds, wherein the target difference is a difference between P second relative poses of the P target nodes and P first relative poses of the P target nodes.

14. The electronic device according to claim 11 , wherein prior to optimizing the pose of each node in the K nodes in accordance with the initial pose so as to obtain the first relative pose of each node in the K nodes, the high-definition map creation method further comprises:

obtaining target altitude values of L point cloud collection trajectories with respect to the target region, and the optimizing the pose of each node in the K nodes in accordance with the initial pose so as to obtain the first relative pose of each node in the K nodes comprises taking the target altitude values as a constraint on an altitude average in the relative pose, and optimizing the pose of each node in the K nodes in accordance with the initial pose, so as to obtain the first relative pose of each node in the K nodes.

15. A non-transitory computer-readable storage medium storing therein a computer instruction, wherein the computer instruction is executed by a computer so as to implement a high-definition map creation map, which comprises:

obtaining point cloud data collected with respect to a target region, the point cloud data comprising K frames of point clouds and an initial pose of each frame of point cloud, K being an integer greater than 1;

associating the K frames of point clouds with each other in accordance with the initial pose, so as to obtain a first point cloud relation graph of the K frames of point clouds;

performing point cloud registration on the K frames of point clouds in accordance with the first point cloud relation graph and the initial pose, so as to obtain a target relative pose of each frame of point cloud in the K frames of point clouds; and splicing the K frames of point clouds in accordance with the target relative pose, so as to obtain a point cloud map of the target region, wherein the associating the K frames of point clouds with each other in accordance with the initial pose so as to obtain the first point cloud relation graph of the K frames of point clouds comprises:

dividing the K frames of point clouds into M blocks in accordance with the initial pose, adjacent blocks comprising at least one same frame of point cloud, M being a positive integer;

associating the frames of point clouds in each block with each other, so as to obtain a second point cloud relation graph of the block; and

associating the M second point cloud relation graphs of the M blocks with each other in accordance with the at least one same frame of point cloud, so as to obtain the first point cloud relation graph.

16. The non-transitory computer-readable storage medium according to claim 15 , wherein the dividing the K frames of point clouds into the M blocks in accordance with the initial pose comprises: dividing the K frames of point clouds into N sub-blocks in accordance with the initial pose and target sub-trajectories, each sub-block comprising frames of point clouds collected on one target sub-trajectory, each target sub-trajectory being a consecutive trajectory on any point cloud collection trajectory of L point cloud collection trajectories with respect to the target region, one point cloud collection trajectory comprising one target sub-trajectory or a plurality of consecutive target sub-trajectories, L being a positive integer, and N being an integer greater than 1; and dividing the N sub-blocks into M blocks in accordance with a positional relationship among the sub-blocks, each block comprising the sub-blocks in a space with a predetermined size, at least a part of sub-blocks in a first block being different from sub-blocks in a second block, the first block being any block in the M blocks, and the second block being a block in the M blocks different from the first block.

17. The non-transitory computer-readable storage medium according to claim 15 , wherein the associating the frames of point clouds in each block with each other so as to obtain the second point cloud relation graph comprises at least one of:

with respect to each frame of point cloud in the block, associating point clouds in the block spaced apart from the point cloud by a distance within a predetermined range with each other, so as to obtain the second point cloud relation graph;

with respect to any point cloud collection trajectory in the target region, associating the frames of point clouds in the block collected at adjacent time points in accordance with the point cloud collection trajectory and a direction of the point cloud collection trajectory, so as to obtain the second point cloud relation graph; or

associating a first target frame of point cloud in the block collected in accordance with a first point cloud collection trajectory with a second target frame of point cloud in the block collected in accordance with a second point cloud collection trajectory, so as to obtain the second point cloud relation graph, the first point cloud collection trajectory and the second point cloud collection trajectory being different point cloud collection trajectories with respect to the target region, the second target frame of point cloud being located in a line perpendicular to a direction of the first point cloud collection trajectory, and an initial pose of the second target frame of point cloud being adjacent to an initial pose of the first target frame of point cloud.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2022
From: DING, WENDONG; QIN, YINGYING; DAI, YANGYANG; ZHANG, YUCHENG; PENG, LIANG; WAN, GUOWEI
To: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.
Reel/Frame 061487/0322 →
Priority Claims (1)
CN 202111260229.5 · Oct 28, 2021 · national
Continuity (1)
Related Publication 20230042968A1 · Feb 9, 2023
References Cited (39)
US 11145080B2 · Chen · 2021 [cited by examiner]
US 20160071278A1 · Leonard · 2016 [cited by examiner]
US 20190301873A1 · Prasser · 2019 [cited by examiner]
US 20200209009A1 · Zhang · 2020 [cited by examiner]
US 20200378808A1 · Platonov · 2020 [cited by examiner]
US 20210004933A1 · Wong et al. · 2021 [cited by applicant]
US 20210158546A1 · He · 2021 [cited by examiner]
US 20210327128A1 · Yu et al. · 2021 [cited by applicant]
US 20220368879A1 · Fleureau · 2022 [cited by examiner]
US 20230042968A1 · Ding · 2023 [cited by examiner]
CN 106910242A · 2017 [cited by applicant]
CN 109118582A · 2019 [cited by applicant]
CN 109754459A · 2019 [cited by applicant]
CN 109949399A · 2019 [cited by applicant]
CN 110940994A · 2020 [cited by applicant]
CN 111461980A · 2020 [cited by applicant]
CN 111461981A · 2020 [cited by applicant]
CN 111462275A · 2020 [cited by applicant]
CN 111524168A · 2020 [cited by applicant]
CN 111771229A · 2020 [cited by applicant]
CN 111784835A · 2020 [cited by applicant]
CN 111966773A · 2020 [cited by applicant]
CN 112509142A · 2021 [cited by applicant]
CN 112561975A · 2021 [cited by applicant]
CN 112762923A · 2021 [cited by applicant]
JP 2010276485A · 2010 [cited by applicant]
WO 20201549664A1 · 2020 [cited by applicant]
The extended European Search Report for European application No. 2202930.8, dated Mar. 28, 2023. [cited by applicant]
Siheng et al., “3D Point Cloud Processing and Learning for Autonomous Driving”, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY14853, Mar. 2020. [cited by applicant]
Estrada et al., “Hierarchical SLAM: Real-Time Accurate Mapping of Large Environments” , IEEE Transactions on Robotics, IEEE Service Center, Piscataway, NJ, US, vol. 21, No. 4, Aug. 2005, p. 588-596. [cited by applicant]
Grisetti et al., “Robust optimization of factor graphs by using condensed measurements”, Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on, IEEE, Oct. 7, 2012, p. 581-588. [cited by applicant]
Han et al., “Robust RGB-D Camera 1-15 Tracking using Optimal Key-frame Selection” , 2020 IEEE International Conference on Robotics and Automation (ICRA), IEEE, May 31, 2020, p. 6275-6281. [cited by applicant]
Fernandes et al., “Visual and Inertial Data Fusion for Globally Consistent Point Cloud Registration” Proceedings—Brazilian Symposium on Computer Graphics and Imageprocessing, IEEE Computer Society, Los Alamitos, CA, US,… [cited by applicant]
Chinese First Office Action for Chinese application No. CN2021112602295, dated Jun. 19, 2023. [cited by applicant]
Shi et al., “Reference-plane-based approach for accuracy assessment of mobile mapping point clouds,” ScienceDirect, www.elsevier.com/locate/measurement, 2021. [cited by applicant]
“Research on Key Technologies of Localization and Navigation Based on Visual SLAM,” A Dissertation Submitted to Zhejiang University for the Degree of Master of Engineering, Jan. 12, 2020. [cited by applicant]
Zhou Leimeng, “Research on Mapping Technology for ORB-SLAM,” Dissertation Submitted to Hangzhou Dianzi University for the Degree of Master, Mar. 2019. [cited by applicant]
Japanese Office Action for Japanese application No. JP2022-171511, dated Sep. 5, 2023. [cited by applicant]
Kiyoshi et al., “Motion estimation of three-dimensional point groups based on alignment using ICP,” Law and Political University, Department of Information Science. [cited by applicant]