Dynamic-baseline imaging array with real-time spatial data capture and fusion
Spatial image data captured at plural camera modules is fused into rectangular prism coordinates to support rapid processing and efficient network communication. The rectangular prism spatial imaging data is remapped to a truncated pyramid at render time to align with a spatial volume encompassed by a superset of imaging devices. A presentation of a reconstructed field of view is provide with near and far field image capture from the plural imaging devices.
1. An information handling system comprising:
a processor operable to execute instructions that process information;
a memory interfaced with the processor and operable to store the information;
plural camera modules directed at an object and interfaced with the processor, each of the plural camera modules operable to capture spatial visual images; and
a non-transitory memory storing instructions that when executed on the processor cause;
a calibration of at least a first and second of the plural camera modules; and
a fusion of spatial image information of the first and second of the plural camera modules to a rectangular prism coordinate space.
2. The information handling system of claim 1 further comprising:
a display operable to present the spatial image information as visual images;
wherein the instructions further map the rectangular prism coordinates to a truncated pyramid to render at the display.
3. The information handling system of claim 2 wherein the instructions further pre-optimize spatial visual information captured by the first and second camera modules to resolution associated with the display before fusion of the spatial image information.
4. The information handling system of claim 1 wherein the instructions further stores depth information associated with the fusion of the spatial image information as a distinct stream.
5. The information handling system of claim 1 wherein the instructions for calibration further:
capture spatial visual information with one of the plural camera modules at a first resolution;
select one or more features at the first resolution to assign a coarse depth value;
capture spatial visual information with a second of the plural camera modules at a second resolution of greater than the first resolution; and
stereo matching the one or more features of the spatial visual information captured in the first and second resolutions.
6. The information handling system of claim 1 wherein each of the plural camera modules comprises three cameras that each capture visible and infrared illumination and a pattern projector that illuminates infrared light.
7. The information handling system of claim 1 wherein the instructions further temporally compare the spatial visual information to detect image outliers for suppression.
8. The information handling system of claim 1 wherein the instructions further compress and quantize depth information of the spatial visual information into a series of plural depth planes.
9. The information handling system of claim 1 wherein the instructions further segment the spatial visual image into regions that include at least background and the object.
10. A method for managing spatial visual image information of an object, the method comprising:
capturing spatial visual image information at plural camera modules;
calibrating the spatial visual images with estimates of at least depth of the plural camera modules relative to the object;
fusing the spatial visual image information of the plural camera modules to a common dataset; and
quantizing the combined dataset into a series of depth planes of equal resolution, with each plane represented in memory as an X/Y matrix of RGB pixel values.
11. The method of claim 10 further comprising:
rendering a novel view of the dataset by arranging each depth plane of the dataset at the appropriate distance and scale from a virtual observer so as to align the edges of each depth plane with the edges of the virtual observer field of view.
12. The method of claim 11 further comprising pre-optimizing spatial visual information captured by the plural camera modules to a resolution associated with the rendering before the fusing.
13. The method of claim 10 further comprising storing depth information associated with the fusing as a distinct stream.
14. The method of claim 10 wherein the calibrating further comprises:
capturing spatial visual information with one of the plural camera modules at a first resolution;
selecting one or more features at the first resolution to assign a coarse depth value;
capturing spatial visual information with a second of the plural camera modules at a second resolution of greater than the first resolution; and
stereo matching the one or more features of the spatial visual information captured in the first and second resolutions.
15. The method of claim 10 wherein each of the plural camera modules comprises three cameras that each capture visible and infrared illumination and a pattern projector that illuminates infrared light.
16. The method of claim 10 further comprising temporally comparing the spatial visual information to detect image outliers for suppression.
17. The method of claim 10 further comprising
compressing and quantizing depth information of the spatial visual information into a series of plural depth planes; and
communicating the plural depth planes through a network.
18. The method of claim 10 further comprising segmenting the spatial visual image into regions that include at least a background and the object.