Multi-array camera imaging system and method therefor
An imaging system and method for enabling the capture and rendering of an image without the latency and bandwidth requirements of the prior art is presented. Embodiments of the present invention employ a plurality of imagers that provide image data to a plurality of capture and hosting servers to which they are connected via a first communications bus. One or more rendering systems are interconnected to the plurality of servers via a second communications bus. The servers perform parallel processing of only raw image data necessary to satisfy individual rendering requests from the rendering systems. Since image processing is performed only on the image data required to render the particular view of interest, an entire high-resolution image is not formed to satisfy the rendering request and the desired image can be rendered with less latency and requires less bandwidth for transmission to the rendering system.
1. A method for high-speed capture and rendering of a first image of a scene that includes a plurality of object points, the method comprising:
storing a first set of raw image data points ( 214 ) at a plurality of servers ( 204 ), the servers being operatively coupled with a first plurality of sensor arrays ( 212 ) and a first rendering system ( 206 - i ), and the first set of raw image data points including raw-image data points from each of the first plurality of sensor arrays;
determining a second set of raw image data points ( 222 - i ) based on a rendering request ( 218 - i ) received from the first rendering system;
determining a second set of sensor arrays, the second set of sensor arrays being the sensor arrays of the first set of sensor arrays that provided the second set of raw image data points; and
generating a set of calibrated image data points ( 224 - i ) by applying a first set of calibration factors to the second set of raw image data points, the first set of calibration factors being based on the second set of sensor arrays, wherein the first image of the scene is based on the set of calibrated image data points.
2. The method of claim 1 further comprising:
transmitting the first set of calibration factors to the first rendering system; and
transmitting the second set of raw image data points to the first rendering system;
wherein the first set of calibration factors are applied to the second set of raw image data points at the first rendering system.
3. The method of claim 1 further comprising applying a scaling factor to the second set of raw image data points ( 222 - i ), the scaling factor being based on the rendering request.
4. The method of claim 1 further comprising determining a second set of calibration factors that includes the first set of calibration factors, the second set of calibration factors being based on the first set of sensor arrays.
5. The method of claim 4 wherein the second set of calibration factors include at least one of radiometric calibration factors and geometric calibration factors.
6. The method of claim 4 wherein the second set of calibration factors include both radiometric calibration factors and geometric calibration factors.
7. The method of claim 1 wherein the second set of sensor arrays includes fewer elements than the first set of sensor arrays.
8. The method of claim 7 wherein the first set of calibration factors is based on only the second set of sensor arrays.
9. The method of claim 1 further comprising:
determining a second set of calibration factors that includes the first set of calibration factors, the second set of calibration factors being based on a first set of images;
computing a model that is based on the second set of calibration factors; and
generating the first set of calibration factors based on the model.
10. The method of claim 9 further comprising:
providing a first raw image data point that corresponds to a first object point, the first raw image data point being provided by a first sensor array of the first set thereof;
providing a second raw image data point that corresponds to the first object point, the second raw image data point being provided by a second sensor array of the first set thereof; and
selecting only one of the first raw image data point and second raw image point for inclusion in the second set of raw image data points based on the first set of calibration factors.