System and method for generating motion-stabilized images of a target using lidar and video measurements
A system uses range and Doppler velocity measurements from a lidar system and images from a video system to estimate a six degree-of-freedom trajectory of a target. The system estimates this trajectory in two stages: a first stage in which the range and Doppler measurements from the lidar system along with various feature measurements obtained from the images from the video system are used to estimate first stage motion aspects of the target (i.e., the trajectory of the target); and a second stage in which the images from the video system and the first stage motion aspects of the target are used to estimate second stage motion aspects of the target. Once the second stage motion aspects of the target are estimated, a three-dimensional image of the target may be generated.
1. A system for tracking a target from lidar measurements and video images, the system comprising:
a lidar subsystem configured to provide both a range measurement and a Doppler velocity measurement for each of a plurality of points on the target;
a video subsystem configured to capture a plurality of two-dimensional images of the target; and
a processor configured to:
receive, from the lidar subsystem, both the range measurement and the Doppler velocity measurement for each of the plurality of points on the target, receive, from the video subsystem, the plurality of images of the target,
generate at least two motion aspects of the target from the plurality of images of the target,
combine the range measurements and the Doppler velocity measurements for each of the plurality of points on the target with the at least two motion aspects of the target to resolve a trajectory of the target, and
generate a motion-stabilized, three-dimensional image of the target using the trajectory, the range measurement and the Doppler velocity measurement for each of the plurality of points on the target, and the plurality of two-dimensional images of the target.
2. The system of claim 1 , wherein the trajectory comprises a three-dimensional trajectory of the target.
3. The system of claim 2 , wherein the motion-stabilized image of the target comprises a three-dimensional motion-stabilized image of the target.
4. The system of claim 2 , wherein the three-dimensional trajectory of the target comprises a six degree of freedom trajectory of the target.
5. The system of claim 2 , wherein the three-dimensional trajectory of the target comprises three translational velocity components.
6. The system of claim 5 , wherein the three-dimensional trajectory of the target further comprises three rotational velocity components.
7. The system of claim 5 , wherein the three translational velocity components comprise translational velocity components v x trans , v y trans , and V z trans .
8. The system of claim 2 , wherein the three-dimensional trajectory of the target comprises three rotational velocity components.
9. The system of claim 8 , wherein the three rotational velocity components comprise angular velocity components ω x , ω y , and ω z .
10. The system of claim 1 , wherein the trajectory comprises three translational velocity components and three angular velocity components, wherein the three translational velocity components comprise v x trans , v y trans , and v z trans , and wherein the three angular velocity components comprise ω x , ω y , and ω z .