3D asset inspection
Systems and methods for physical asset inspection are provided. According to one embodiment, a probe is positioned to multiple data capture positions with reference to a physical asset. For each position: odometry data is obtained from an encoder and/or an IMU; a 2D image is captured by a camera; a 3D sensor data frame is captured by a 3D sensor, having a view plane overlapping that of the camera; the odometry data, the 2D image and the 3D sensor data frame are linked and associated with a physical point in real-world space based on the odometry data; and switching between 2D and 3D views within the collected data is facilitated by forming a set of points containing both 2D and 3D data by performing UV mapping based on a known positioning of the camera relative to the 3D sensor.
1. A method of using a suspended probe carrying onboard first and second cameras, an odometer, a 3D sensor, and a central processing unit, the onboard first and second cameras having vertically aligned nodal points and a fixed separation distance, and further carrying an odometer, the method comprising:
using the first camera to produce one or more images of a physical asset;
raising or lowering the suspended probe by the fixed separation distance; and
using the second camera to produce one or more images, in which the steps are carried out within an underground vertical structure, in which a human may enter the vertical structure through a manhole;
recording odometer data as the probe is raised or lowered;
using the 3D sensor to capture one or more 3D data frames of the physical asset as the probe is raised or lowered;
performing a data synthesis process including:
using the central processing unit to link the odometer data to the one or more produced images and the one or more 3D data frames;
using the central processing unit to associate the one or more produced images and the one or more 3D data frames with a physical point in real-world space based on the odometry data;
relating the one or more produced images to the 3D data frames by relating a point in each 3D data frame to a pixel in each of the one or more images based on a known physical geometry of the positioning of the 3D sensor relative to the first and second cameras;
displaying the synthesized data to a user as a 3D computer graphics model; and
measuring a distance between a first point and a second point on the displayed 3D graphics model.
2. The method of claim 1 in which the probe is suspended from one or more flexible cables and is lowered by extending the one or more flexible cables.
3. The method of claim 1 in which the fields of view of the first and second cameras differ, but overlap, when positioned at the same nodal point.
4. The method of claim 1 in which at least one of the first and second cameras has a field of view greater than 90 degrees.
5. The method of claim 2 in which extension of the at least one cable is controlled by a winch supported at a location remote from the probe.
6. The method of claim 1 in which the first camera and the second camera are axially spaced along a longitudinal axis, in which first camera has a first field of view and the second camera has a second field of view, and in which the second field of view is angularly offset about the longitudinal axis from the first field of view.
7. The method of claim 6 in which the angular offset is 90 degrees.
8. The method of claim 1 , in which the fixed separation distance between the first and second cameras is consider a first fixed separation distance, and in which the suspended probe further carries an onboard third camera having a nodal point that is vertically aligned with the nodal points of the first and second cameras and is spaced from the second camera by a second fixed separation distance, the method further comprising:
after the second camera produces one or more images, raising or lowering the suspending probe by the second fixed separation distance; and
using the third camera to produce one or more images.
9. The method of claim 1 , in which the physical asset is the vertical structure.
10. A method of using a suspended probe carrying onboard first and second cameras having vertically aligned nodal points and a fixed separation distance, in which the suspended probe further carries an odometer, a 3D sensor, and a central processing unit, the method further comprising:
using the first camera to produce one or more images of a physical asset;
raising or lowering the suspended probe by the fixed separation distance; and
using the second camera to produce one or more images of the physical asset; in which the steps are carried out within an underground vertical structure, in which a human may enter the vertical structure through a manhole;
recording odometer data as the probe is raised or lowered;
using the 3D sensor to capture one or more 3D data frames of the physical asset as the probe is raised or lowered; and
performing a data synthesis process including:
using the central processing unit to link the odometer data to the one or more produced images and the one or more 3D data frames;
using the central processing unit to associate the one or more produced images and the one or more 3D data frames with a physical point in real-world space based on the odometry data; and
relating the one or more produced images to the 3D data frames by relating a point in each 3D data frame to a pixel in each of the one or more images based on a known physical geometry of the positioning of the 3D sensor relative to the first and second cameras;
displaying the synthesized data to a user as a 3D computer graphics model;
measuring a distance between a first point and a second point on the displayed 3D graphics model;
observing an area of interest on the 3D computer graphics model; and
thereafter, performing the above steps a second time using the same physical asset so as to display a new set of synthesized data to the user as a new 3D computer graphics model, and so as to observe the area of interest on the new 3D computer graphics model.