Method and apparatus for automatic registration and visualization of occluded targets using ladar data
View Patent ↗A method and apparatus for high-resolution 3D imaging ladar system which can penetrate foliage and camouflage to sample fragments of concealed surfaces of interest is disclosed. Samples collected while the ladar moves can be integrated into a coherent object shape. In one embodiment, a system and method for automatic data-driven registration of ladar frames, comprises a coarse search stage, a pairwise fine registration stage using an iterated closest points algorithm, and a multi-view registration strategy. After alignment and aggregation, it is often difficult for human observers to find, assess and recognize objects from a point cloud display. Basic display manipulations, surface fitting techniques, and clutter suppression to enhance visual exploitation of 3D imaging ladar data may be utilized.
1. A method of registering ladar data, comprising:
receiving a plurality of ladar frames; and
registering at least two of said plurality of ladar frames for determining a sensor pose with respect to a reference, said registering step comprises performing a coarse search for determining a translation shift, wherein said performing said coarse search comprises constructing range images from point sets derived from said at least two ladar frames, estimating a 2D image shift from said at least two ladar frames, scaling said 2D image shift for generating said translation shift in cross-range directions and estimating said translation shift in a down-range direction from said at least two ladar frames.
2. The method of claim 1 , wherein said registering step uses information provided by a Global Positioning System (GPS) or Inertial Navigation System (INS).
3. The method of claim 1 , wherein said registering step further comprises:
performing a fine registration.
4. The method of claim 1 , wherein performing said coarse search comprises:
binning point sets from each frame of said at least two ladar frames into coarse 3D grids of binary voxels; and
correlating the grids for generating said translation shift.
5. The method of claim 3 , wherein performing said fine registration employs an iterated closest points (ICP) method.
6. The method of claim 5 , wherein said ICP method performs a bounds test for eliminating false matches.
7. The method of claim 5 , wherein said ICP method is accelerated by using an extrapolated point to compute motion.
8. The method of claim 5 , wherein said ICP method removes points in either ladar frame on an interior of a smooth densely sampled surface from consideration.
9. The method of claim 5 , wherein said ICP method ignores closest point pairs within said at least two ladar frames with distance exceeding a limit.
10. The method of claim 5 , wherein said ICP method incrementally estimates rotation and translation from point pairs of said at least two ladar frames.
11. The method of claim 10 , wherein translation is estimated as ΔT=median{q k− (Rp k +T)}, a robust center of translation-corrected points c k =R pk +T+ΔT is computed as μ=median{c k }, and rotation around each axis is estimated from median {∠ x (c k −μ), (q k −μ)}where ∠ x a,b denotes the angle between vectors projected onto the yz plane.
12. The method of claim 5 , wherein said ICP method comprises:
a) creating a point cloud from said at least two ladar frames at a plurality of resolution levels; and
b) performing said ICP method at each of said plurality of resolution levels.
13. The method of claim 1 , wherein said sensor pose is determined using a hierarchical approach, where groups of nearby ladar frames are first registered and then are aggregated into composite point sets.
14. The method of claim 1 , wherein said sensor pose is determined using a bundle approach, where pairwise registration is performed on said plurality of ladar frames separated by different temporal distances.
15. The method of claim 14 , wherein a visual representation of said at least two ladar frames is produced.
16. The method of claim 1 , wherein static noise cleaning is performed before said registering step.
17. The method of claim 1 , wherein dynamic noise cleaning is performed before said registering step.
18. An apparatus for registering ladar data, comprising:
means for receiving a plurality of ladar frames; and
means for registering at least two of said plurality of ladar frames for determining a sensor pose with respect to a reference, said means for registering comprises means for performing a coarse search for determining a translation shift, wherein said means for performing said coarse search comprises means for constructing range images from point sets derived from said at least two ladar frames, means for estimating a 2D image shift from said at least two ladar frames, means for scaling said 2D image shift for generating said translation shift in cross-range directions, and means for estimating said translation shift in a down-range direction from said at least two ladar frames.
19. The apparatus of claim 18 , wherein said means for registering further comprises:
means for performing a fine registration.
20. The apparatus of claim 18 , wherein said means for performing said coarse search further comprises:
means for binning point sets from each frame of said at least two ladar frames into coarse 3D grids of binary voxels; and
means for correlating the grids for generating said translation shift.