IP Library › Granted Patent US 12,430,707
Granted Patent B2
US 12,430,707 · App. 18/266,374 · Granted Sep 30, 2025

Method and apparatus for 2D regularized planar projection of point cloud

Inventors: Wei Zhang (Shenzhen, CN); Fuzheng Yang (Shenzhen, CN); Yuxin Du (Shenzhen, CN); Jiarun Song (Shenzhen, CN)
Assignee: HONOR DEVICE CO., LTD.
G06T3/067
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,707
App. No.
18/266,374
Granted
Sep 30, 2025
Kind
B2
Abstract

The present invention discloses a method and an apparatus for 2D regularized planar projection of a point cloud. The method includes: obtaining original point cloud data; initializing a planar structure of 2D projection of the point cloud; calculating horizontal azimuth information of the point cloud based on the original point cloud data; and determining a mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information, to obtain a planar structure of 2D regularized projection of the point cloud. In the present invention, a large-scale point cloud may be projected to a 2D regularized planar structure without 2D local search. Therefore, complexity of an algorithm can be reduced, time spent on 2D regularized planar projection of the point cloud can be reduced, and algorithm performance can be improved.

Claims (199)

1. A method, performed by a computing device, for 2D regularized planar projection of a point cloud, comprising:

obtaining original point cloud data;

initializing a planar structure of 2D projection of the point cloud;

calculating horizontal azimuth information of the point cloud based on the original point cloud data; and

determining a mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information, to obtain a planar structure of 2D regularized projection of the point cloud, wherein determining the mapping relationship comprises determining a column index of the original point cloud data in the planar structure of 2D projection based on the horizontal azimuth information, comprising

establishing a relationship between the horizontal azimuth information of the point cloud and an original collection azimuth information of the point cloud, and obtaining a corresponding relational expression, wherein the relational expression between the horizontal azimuth information of the point cloud and the original collection azimuth information of the point cloud is as follows:

φ

=

φ

0

-

α

-

arctan

⁢

H

o

r

;

or

φ

=

φ

0

-

α

-

arccos

⁡

(

-

H

o

r

)

+

90

⁢

°

;

wherein φ represents the horizontal azimuth information of a current point in the original point cloud data, φ 0 represents the original collection azimuth information of the current point, α represents a horizontal correction angle of a laser to which the current point belongs, H o represents a horizontal offset of the laser to which the current point belongs, and r represents depth information of the current point.

2. The method according to claim 1 , wherein the original point cloud data includes a group of 3D spatial points, wherein each of the 3D spatial points is associated with respective geometric position information, and the geometric position information of each of the 3D spatial points is expressed based on a Cartesian coordinate system.

3. The method according to claim 1 , wherein

the planar structure of 2D projection of the point cloud is a data structure including pixels of M rows and N columns, and a point in the original point cloud data corresponds to a pixel in the data structure after projection.

4. The method according to claim 3 , wherein M is initialized by using a quantity of lasers in the regularization parameters laserNum, and Nis initialized by using a sampling angle resolution φ speed of the laser or a quantity of sampling points per laser

M

=

laserNum

;

N

=

360

⁢

°

φ

speed

⁢

or

⁢

N

=

point

⁢

NumPerLaser

.

5. The method according to claim 1 , wherein calculating the horizontal azimuth information of the point cloud based on the original point cloud data is based on:

φ=arctan x/y;

wherein φ represents horizontal azimuth information of the current point in the original point cloud data, and x and y are Cartesian coordinate components of the current point respectively.

6. The method according to claim 1 , wherein the determining the mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information further comprises:

determining a row index of the original point cloud data in the planar structure of 2D projection.

7. The method according to claim 6 , wherein the determining the column index of the original point cloud data in the planar structure of 2D projection based on the horizontal azimuth information further comprises:

calculating the original collection azimuth information of the point cloud based on the relational expression; and

calculating the column index of the original point cloud data in the planar structure of 2D projection based on the original collection azimuth information.

8. The method according to claim 7 , wherein calculating the column index of the original point cloud data in the planar structure of 2D projection is based on:

j

=

round

⁢

(

φ

0

+

180

⁢

°

φ

speed

)

;

wherein j represents a column index of a current point in the original point cloud data in the planar structure of 2D projection, φ 0 represents the original collection azimuth information of the current point, and φ speed represents a sampling angle resolution of the laser.

9. The method according to claim 6 , wherein the determining the row index of the original point cloud data in the planar structure of 2D projection comprises: the row index i of the current point in the original point cloud data in the planar structure of 2D projection is determined as follows:

i

=

arg

min

k

=

1

...

⁢

laserNum

❘

"\[LeftBracketingBar]"

z

-

V

o

k

-

r

×

tan

⁢

θ

o

k

❘

"\[RightBracketingBar]"

;

wherein z is a Cartesian coordinate component of the current point, r is depth information of the current point and r=√{square root over (x 2 +y 2 )}, laserNum represents a quantity of lasers included in a laser radar, V o k is offset information of a k th laser along a vertical direction, θ o k is offset information of a k th laser along a pitch angle, and both V o k and θ o k and are calibration parameters of the laser radar.

10. A device for 2D regularized planar projection of a point cloud, the device comprising:

a processor; and

a memory storing instruction that, when executed by the processor, cause the device to perform operations comprising:

obtaining original point cloud data;

initializing a planar structure of 2D projection of the point cloud;

calculating horizontal azimuth information of the point cloud based on the original point cloud data; and

determining a mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information, to obtain a planar structure of 2D regularized projection of the point cloud, wherein determining the mapping relationship comprises determining a column index of the original point cloud data in the planar structure of 2D projection based on the horizontal azimuth information, including establishing a relationship between the horizontal azimuth information of the point cloud and an original collection azimuth information of the point cloud, and obtaining a corresponding relational expression, wherein calculating the column index of the original point cloud data in the planar structure of 2D projection is based on:

j

=

round

⁢

(

φ

0

+

180

⁢

°

φ

speed

)

;

wherein j represents the column index of a current point in the original point cloud data in the planar structure of 2D projection, φ 0 represents the original collection azimuth information of the current point, and φ speed represents a sampling angle resolution of a laser to which the current point belongs.

11. The device according to claim 10 , wherein the original point cloud data includes a group of 3D spatial points, wherein each of the 3D spatial points is associated with respective geometric position information, and the geometric position information of each of the 3D spatial points is expressed based on a Cartesian coordinate system.

12. The device according to claim 10 , wherein

the planar structure of the 2D projection of the point cloud is a data structure including pixels of M rows and N columns, and a point in the original point cloud data corresponds to a pixel in the data structure after projection.

13. The device according to claim 10 , wherein calculating the horizontal azimuth information is based on:

φ=arctan x/y;

wherein φ represents horizontal azimuth information of a current point in the original point cloud data, and x and y are Cartesian coordinate components of the current point respectively.

14. The device according to claim 10 , wherein the determining the mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information further comprises:

determining a row index of the original point cloud data in the planar structure of 2D projection.

15. The device according to claim 14 , wherein the determining the column index of the original point cloud data in the planar structure of 2D projection based on the horizontal azimuth information further comprises:

calculating the original collection azimuth information of the point cloud based on the relational expression; and

calculating the column index of the original point cloud data in the planar structure of 2D projection based on the original collection azimuth information.

16. The device according to claim 15 , wherein the relational expression between the horizontal azimuth information of the point cloud and the original collection azimuth information of the point cloud is as follows:

φ

=

φ

0

-

α

-

arctan

⁢

H

o

r

;

wherein φ represents the horizontal azimuth information of the current point in the original point cloud data, φ 0 represents the original collection azimuth information of the current point, α represents a horizontal correction angle of the laser to which the current point belongs, H o represents a horizontal offset of the laser to which the current point belongs, and r represents depth information of the current point.

17. The device according to claim 15 , wherein the relational expression between the horizontal azimuth information of the point cloud and the original collection azimuth information of the point cloud is as follows:

φ

=

φ

0

-

α

-

arccos

⁡

(

-

H

o

r

)

+

90

⁢

°

;

wherein φ represents the horizontal azimuth information of the current point in the original point cloud data, φ 0 represents the original collection azimuth information of the current point, α represents a horizontal correction angle of the laser to which the current point belongs, H o represents a horizontal offset of the laser to which the current point belongs, and r represents depth information of the current point.

18. A non-transitory computer-readable medium storing machine executable instructions that, when executed by a processing device, causes the processing device to perform operations for 2D regularized planar projection of a point cloud, comprising:

obtaining original point cloud data;

initializing a planar structure of 2D projection of the point cloud;

calculating horizontal azimuth information of the point cloud based on the original point cloud data; and

determining a mapping relationship between the original point cloud data and the planar structure of 2D projection based on the horizontal azimuth information, to obtain a planar structure of 2D regularized projection of the point cloud, wherein determining the mapping relationship comprises determining a column index of the original point cloud data in the planar structure of 2D projection based on the horizontal azimuth information, comprising

establishing a relationship between the horizontal azimuth information of the point cloud and an original collection azimuth information of the point cloud, and obtaining a corresponding relational expression, wherein the relational expression between the horizontal azimuth information of the point cloud and the original collection azimuth information of the point cloud is as follows:

φ=φ 0 −α−arccos(− H o /r )+90°;

wherein φ represents the horizontal azimuth information of a current point in the original point cloud data, φ 0 represents the original collection azimuth information of the current point, α represents a horizontal correction angle of a laser to which the current point belongs, H o represents a horizontal offset of the laser to which the current point belongs, and r represents depth information of the current point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 29, 2023
From: ZHANG, WEI; YANG, FUZHENG; DU, YUXIN; SONG, JIARUN
To: HONOR DEVICE CO., LTD.
Reel/Frame 065701/0403 →
Priority Claims (1)
CN 202110578726.3 · May 26, 2021 · national
Continuity (1)
Related Publication 20240112300A1 · Apr 4, 2024
References Cited (19)
US 7804498B1 · Graham et al. · 2010 [cited by applicant]
US 10346998B1 · Anderberg · 2019 [cited by examiner]
US 20050057559A1 · Komarechka · 2005 [cited by examiner]
US 20180088214A1 · O'Keeffe · 2018 [cited by examiner]
US 20190156520A1 · Mammou et al. · 2019 [cited by applicant]
US 20190195998A1 · Campbell · 2019 [cited by applicant]
US 20220011102A1 · Yamamoto · 2022 [cited by examiner]
US 20220353531A1 · Hur · 2022 [cited by examiner]
US 20230260153A1 · Saric · 2023 [cited by examiner]
US 20240094337A1 · Fernandez · 2024 [cited by examiner]
CN 103279989A · 2013 [cited by applicant]
CN 105574905A · 2016 [cited by applicant]
CN 109509143A · 2019 [cited by applicant]
CN 110428372A · 2019 [cited by applicant]
CN 111009011A · 2020 [cited by applicant]
CN 112150595A · 2020 [cited by applicant]
WO 2016185637A1 · 2016 [cited by applicant]
WO 2019013430A1 · 2019 [cited by applicant]
S. Ko and S. Lee, “3D Point Cloud Matching Based on Its 2D Representation for Visual Odometry,” 2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS), Sophia Antipolis, France, 2018, pp… [cited by applicant]