IP Library › Granted Patent US 11,935,186
Granted Patent B2
US 11,935,186 · App. 17/780,726 · Granted Mar 19, 2024

Point cloud data based modeling method and apparatus, device and storage medium

Inventor: Xianyu Cheng (Beijing, CN)
Assignee: REALSEE (BEIJING) TECHNOLOGY CO., LTD.
G06T17/00G06T2200/08G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,935,186
App. No.
17/780,726
Granted
Mar 19, 2024
Kind
B2
Abstract

A modeling method and apparatus based on point cloud data, an electronic device, and a storage medium are provided, and relate to the field of three-dimensional panoramic technologies. The modeling method based on point cloud data includes: obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target, a first time information, first rotation position information of an electric motor, and a second time information; determining second rotation position information based on the first time information and the second time information; and obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information, to construct a three-dimensional panoramic model corresponding to the scanned target.

Claims (78)

1. A modeling method based on point cloud data, comprising:

obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target and a first time information when the three-dimensional point cloud information is collected;

obtaining first rotation position information of an electric motor and a second time information corresponding to the first rotation position information, wherein the electric motor is configured to drive the point cloud collection device to rotate;

determining second rotation position information corresponding to the three-dimensional point cloud information based on the first time information and the second time information; and

obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information, to construct a three-dimensional panoramic model corresponding to the scanned target based on the position information of the scanned target.

2. The method according to claim 1 , wherein the obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target and a first time information when the three-dimensional point cloud information is collected comprises:

receiving a point cloud data packet collected by the point cloud collection device from the scanned target at a data collection point, wherein the electric motor drives the point cloud collection device to rotate to the data collection point; and

extracting the three-dimensional point cloud information, the first time information, and a scanning angle of the point cloud collection device from the point cloud data packet,

wherein the scanning angle is an included angle between a scanning direction of the point cloud collection device and a plane of rotation of the point cloud collection device.

3. The method according to claim 1 , wherein the obtaining first rotation position information of an electric motor and a second time information corresponding to the first rotation position information comprises:

receiving a pulse signal sent by a controller or an encoder and the second time information corresponding to the pulse signal,

wherein the controller is configured to drive the electric motor to run, and the encoder is mounted on an output shaft of the electric motor to measure a rotation speed of the electric motor.

4. The method according to claim 3 , wherein the determining second rotation position information corresponding to the three-dimensional point cloud information based on the first time information and the second time information comprises:

generating a first timestamp based on the first time information, and generating a second timestamp based on the second time information;

establishing a correspondence between the second timestamp and the pulse signal; and

obtaining, based on the correspondence, a pulse signal corresponding to the second timestamp that is the same as or closest to the first timestamp, and using the pulse signal to determine a rotation angle of the electric motor.

5. The method according to claim 4 , wherein the position information of the scanned target comprises: an X-axis coordinate value, a Y-axis coordinate value, and a Z-axis coordinate value of the scanned target; and the obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information comprises:

establishing an X-axis coordinate conversion relationship and a Y-axis coordinate conversion relationship based on the rotation angle and the scanning angle respectively;

establishing a Z-axis coordinate conversion relationship based on the scanning angle; and

converting the three-dimensional point cloud information based on the X-axis coordinate conversion relationship, the Y-axis coordinate conversion relationship, and the Z-axis coordinate conversion relationship to obtain the position information of the scanned target.

6. The method according to claim 5 , wherein the three-dimensional point cloud information comprises: a distance between the point cloud collection device and the scanned target;

the established X-axis coordinate conversion relationship is: x n =d n *cos β n *cos α n ;

the established Y-axis coordinate conversion relationship is: y n =d n *sin β n *cos α n ; and

the established Z-axis coordinate conversion relationship is: z n =d n *sin α n ,

where d n is the distance, x n is the X-axis coordinate value, y n is the Y-axis coordinate value, z n is the Z-axis coordinate value, β n is the rotation angle of the electric motor, the point cloud collection device rotates in a horizontal plane, α n is the scanning angle, and the scanning angle is a pitch angle.

7. A non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, implements a modeling method based on point cloud data, the method comprising:

obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target and a first time information when the three-dimensional point cloud information is collected;

obtaining first rotation position information of an electric motor and a second time information corresponding to the first rotation position information, wherein the electric motor is configured to drive the point cloud collection device to rotate;

determining second rotation position information corresponding to the three-dimensional point cloud information based on the first time information and the second time information; and

obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information, to construct a three-dimensional panoramic model corresponding to the scanned target based on the position information of the scanned target.

8. The medium according to claim 7 , wherein the obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target and a first time information when the three-dimensional point cloud information is collected comprises:

receiving a point cloud data packet collected by the point cloud collection device from the scanned target at a data collection point, wherein the electric motor drives the point cloud collection device to rotate to the data collection point; and

extracting the three-dimensional point cloud information, the first time information, and a scanning angle of the point cloud collection device from the point cloud data packet,

wherein the scanning angle is an included angle between a scanning direction of the point cloud collection device and a plane of rotation of the point cloud collection device.

9. The medium according to claim 7 , wherein the obtaining first rotation position information of an electric motor and a second time information corresponding to the first rotation position information comprises:

receiving a pulse signal sent by a controller or an encoder and the second time information corresponding to the pulse signal,

wherein the controller is configured to drive the electric motor to run, and the encoder is mounted on an output shaft of the electric motor to measure a rotation speed of the electric motor.

10. The medium according to claim 9 , wherein the determining second rotation position information corresponding to the three-dimensional point cloud information based on the first time information and the second time information comprises:

generating a first timestamp based on the first time information, and generating a second timestamp based on the second time information;

establishing a correspondence between the second timestamp and the pulse signal; and

obtaining, based on the correspondence, a pulse signal corresponding to the second timestamp that is the same as or closest to the first timestamp, and using the pulse signal to determine a rotation angle of the electric motor.

11. The medium according to claim 10 , wherein the position information of the scanned target comprises: an X-axis coordinate value, a Y-axis coordinate value, and a Z-axis coordinate value of the scanned target; and the obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information comprises:

establishing an X-axis coordinate conversion relationship and a Y-axis coordinate conversion relationship based on the rotation angle and the scanning angle respectively;

establishing a Z-axis coordinate conversion relationship based on the scanning angle; and

converting the three-dimensional point cloud information based on the X-axis coordinate conversion relationship, the Y-axis coordinate conversion relationship, and the Z-axis coordinate conversion relationship to obtain the position information of the scanned target.

12. The medium according to claim 11 , wherein the three-dimensional point cloud information comprises: a distance between the point cloud collection device and the scanned target;

the established X-axis coordinate conversion relationship is: x n =d n *cos β n *cos α n ;

the established Y-axis coordinate conversion relationship is: y n =d n *sin β n *cos α n ; and

the established Z-axis coordinate conversion relationship is: z n =d n *sin α n ,

where d n is the distance, x n is the X-axis coordinate value, y n is the Y-axis coordinate value, z n is the Z-axis coordinate value, β n is the rotation angle of the electric motor, the point cloud collection device rotates in a horizontal plane, α n is the scanning angle, and the scanning angle is a pitch angle.

13. An electronic device, comprising:

a processor; and

a memory and a computer program stored on the memory,

wherein the processor is configured to execute the computer program to implement a modeling method based on point cloud data, the method comprising:

obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target and a first time information when the three-dimensional point cloud information is collected;

obtaining first rotation position information of an electric motor and a second time information corresponding to the first rotation position information, wherein the electric motor is configured to drive the point cloud collection device to rotate;

determining second rotation position information corresponding to the three-dimensional point cloud information based on the first time information and the second time information; and

obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information, to construct a three-dimensional panoramic model corresponding to the scanned target based on the position information of the scanned target.

14. The device according to claim 13 , wherein the obtaining three-dimensional point cloud information collected by a point cloud collection device from a scanned target and a first time information when the three-dimensional point cloud information is collected comprises:

receiving a point cloud data packet collected by the point cloud collection device from the scanned target at a data collection point, wherein the electric motor drives the point cloud collection device to rotate to the data collection point; and

extracting the three-dimensional point cloud information, the first time information, and a scanning angle of the point cloud collection device from the point cloud data packet,

wherein the scanning angle is an included angle between a scanning direction of the point cloud collection device and a plane of rotation of the point cloud collection device.

15. The device according to claim 13 , wherein the obtaining first rotation position information of an electric motor and a second time information corresponding to the first rotation position information comprises:

receiving a pulse signal sent by a controller or an encoder and the second time information corresponding to the pulse signal,

wherein the controller is configured to drive the electric motor to run, and the encoder is mounted on an output shaft of the electric motor to measure a rotation speed of the electric motor.

16. The device according to claim 15 , wherein the determining second rotation position information corresponding to the three-dimensional point cloud information based on the first time information and the second time information comprises:

generating a first timestamp based on the first time information, and generating a second timestamp based on the second time information;

establishing a correspondence between the second timestamp and the pulse signal; and

obtaining, based on the correspondence, a pulse signal corresponding to the second timestamp that is the same as or closest to the first timestamp, and using the pulse signal to determine a rotation angle of the electric motor.

17. The device according to claim 16 , wherein the position information of the scanned target comprises: an X-axis coordinate value, a Y-axis coordinate value, and a Z-axis coordinate value of the scanned target; and the obtaining position information of the scanned target based on the three-dimensional point cloud information and the second rotation position information comprises:

establishing an X-axis coordinate conversion relationship and a Y-axis coordinate conversion relationship based on the rotation angle and the scanning angle respectively;

establishing a Z-axis coordinate conversion relationship based on the scanning angle; and

converting the three-dimensional point cloud information based on the X-axis coordinate conversion relationship, the Y-axis coordinate conversion relationship, and the Z-axis coordinate conversion relationship to obtain the position information of the scanned target.

18. The device according to claim 17 , wherein the three-dimensional point cloud information comprises: a distance between the point cloud collection device and the scanned target;

the established X-axis coordinate conversion relationship is: x n =d n *cos β n *cos α n ;

the established Y-axis coordinate conversion relationship is: y n =d n *sin β n *cos α n ; and

the established Z-axis coordinate conversion relationship is: z n =d n *sin α n ,

where d n is the distance, x n is the X-axis coordinate value, y n is the Y-axis coordinate value, z n is the Z-axis coordinate value, β n is the rotation angle of the electric motor, the point cloud collection device rotates in a horizontal plane, α n is the scanning angle, and the scanning angle is a pitch angle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2022
From: CHENG, XIANYU
To: REALSEE (BEIJING) TECHNOLOGY CO., LTD.
Reel/Frame 060390/0430 →
Priority Claims (1)
CN 201911194067.2 · Nov 28, 2019 · national
Continuity (1)
Related Publication 20220292767A1 · Sep 15, 2022