IP Library › Granted Patent US 12,315,098
Granted Patent B2
US 12,315,098 · App. 18/169,985 · Granted May 27, 2025

Method for multi-view point cloud registration for whole aircraft based on spherical harmonic feature (SHF)

Inventors: Jun Wang (Jiangsu Province, CN); Yuan Zhang (Jiangsu Province, CN); Hu Li (Jiangsu Province, CN); Zikuan Li (Jiangsu Province, CN)
Assignee: Nanjing University of Aeronautics and Astronautics
G06T19/20G06T3/08G06T5/70G06T7/64G06T2207/10028G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,315,098
App. No.
18/169,985
Granted
May 27, 2025
Kind
B2
Abstract

The present disclosure discloses a method for multi-view point cloud registration for a whole aircraft based on a spherical harmonic feature (SHF). Gaussian sphere projection is mainly performed on a local point cloud. An SHF of each point is obtained by using a spherical harmonic transform technology. A constraint correspondence between feature points is found based on an SHF of each point in the point cloud. Multi-view point cloud data registration is performed according to an optimization graph method under a constraint of the SHF. A key of multi-view point cloud registration is to search for feature constraint relationships between different observation stations and perform non-linear solution based on these relationships, so as to obtain a pose parameter of a point cloud in each viewing angle.

Claims (16)

1. A method for multi-view point cloud registration for a whole aircraft based on a spherical harmonic feature (SHF), specifically comprising the following steps:

step S 1 : developing a measurement solution for a whole aircraft, and performing data preprocessing after point cloud data of the whole aircraft is obtained;

step S 2 : calculating a preprocessed point cloud based on step S 1 , performing local spherical projection on each point, and calculating a local SHF based on spherical harmonic transform; and

step S 3 : calculating a constraint correspondence between overlapping point cloud views based on the local SHF calculated in step S 2 , filtering the established constraint correspondence to remove an incorrect constraint correspondence, and based on an equation of an optimization graph, resolving transformation of point clouds from different viewing angles to implement multi-view point cloud registration.

2. The method for multi-view point cloud registration for a whole aircraft based on an SHF according to claim 1 , wherein the measurement solution in step S 1 specifically comprises deploying different viewing angles to scan the aircraft, and there are overlapping degrees of 40% to 60% between the point clouds from different viewing angles.

3. The method for multi-view point cloud registration for a whole aircraft based on an SHF according to claim 1 , wherein data preprocessing in step S 1 comprises:

step S 101 : performing downsampling on the point cloud data, making a sampled point set be S, randomly adding one point from the point clouds to S, finding, from a remaining point, a point with a largest sum of distances from all points in S, adding the point to S, and continuously updating S until a point quantity in S reaches a specified point quantity;

step S 102 : performing denoising on the point cloud data, traversing all points with a given radius r 1 and a threshold N by using point cloud denoising based on density, calculating a point quantity in the radius r 1 of each point which is denoted as M, and if M<N, deleting the point, otherwise, retaining the point; and

step S 103 : performing coarse registration on point clouds from multiple viewing angles, and roughly estimating gesture parameters of the point clouds by manually selecting at least three points at a same location in an overlapped region from different viewing angles, to implement coarse registration of multi-view point clouds.

4. The method for multi-view point cloud registration for a whole aircraft based on an SHF according to claim 1 , wherein step S 2 specifically comprises the following steps:

step S 201 : based on the point cloud data obtained in step S 1 , establishing a local sphere by using each point as a center of the sphere and by using r 2 as a radius, and constructing a Gaussian sphere feature by projecting a point in the local sphere onto a local sphere surface; and

step S 202 : performing spherical harmonic transform on the Gaussian sphere feature, converting the feature into a frequency domain, and resolving the feature into a form of a spherical harmonic function coefficient; and calculating energy of a spherical harmonic at different frequencies as the local SHF.

5. The method for multi-view point cloud registration for a whole aircraft based on an SHF according to claim 1 , wherein step S 3 specifically comprises the following steps:

step S 301 : judging a corresponding point based on the local SHF, and determining a constraint correspondence between corresponding points in overlapped point clouds in viewing angles;

step S 302 : performing filtering based on curvature of the point clouds, and when a difference between curvature of a pair of initially matched feature points is less than a specified threshold, judging that the points are corresponding points; and

step S 303 : establishing a target equation of a global optimization graph, applying local error diffusion to the entire graph, that is, evenly distributing an accumulated error to all views, and performing transformation on the point clouds based on a calculation result of the optimization graph, to implement multi-view point cloud registration, and complete splicing of point clouds of the whole aircraft.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 18, 2025
From: WANG, JUN; ZHANG, YUAN; LI, HU; LI, ZIKUAN
To: NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS
Reel/Frame 070876/0908 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2023
From: WANG, JUN; ZHANG, YUAN; LI, HU; LI, ZIKUAN
To: NANJING UNIVERSITY OF AERONAUTICS AND ASTRONAUTICS
Reel/Frame 062718/0602 →
Priority Claims (1)
CN 202210261663.3 · Mar 17, 2022 · national
Continuity (1)
Related Publication 20230298296A1 · Sep 21, 2023
References Cited (4)
US 20180158235A1 · Wu · 2018 [cited by examiner]
US 20200096328A1 · Raab · 2020 [cited by examiner]
US 20230113647A1 · Zeng · 2023 [cited by examiner]
US 20230194722A1 · Son · 2023 [cited by examiner]