Image sensor alignment in a multi-camera system accelerator architecture
An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
1. A camera system, comprising:
a first image sensor chip configured to produce first image data representative of light incident upon the first image sensor chip; and
an image signal processor chip (“ISP”) comprising:
one or more inputs configured to receive the first image data and to receive a second sub-band component representative of second image data from a second camera system, the camera system and the second camera system comprising at least partially overlapping fields of view;
a compression engine configured to decimate the first image data into a plurality of image sub-band components including a first sub-band component representative of the first image data; and
an alignment engine configured to adjust one or both of the fields of view of the camera system and the second camera system based on a comparison of the first sub-band component and the second sub-band component.
2. The camera system of claim 1 , wherein the first image sub-band component comprises a first low/low sub-band component, and wherein the second image sub-band component comprises a second low/low sub-band component, the first low/low sub-band component comprising a resolution lower than the first image data, and the second low/low sub-band component comprising a resolution lower than the second image data.
3. The camera system of claim 1 , wherein comparing the first sub-band component and the second sub-band component comprises aligning the first sub-band component and the second sub-band component.
4. The camera system of claim 3 , wherein aligning the first sub-band component and the second sub-band component comprises determining a pixel difference between the first sub-band component and the second sub-band component.
5. The camera system of claim 4 , wherein adjusting one or both of the fields of view of the camera system and the second camera system comprises adjusting one of the fields of view by the determined pixel difference between the first sub-band component and the second sub-band component.
6. The camera system of claim 1 , wherein the second camera system comprises a compression engine configured to decimate the second image data to produce the second image sub-band component, and wherein the second camera system is configured to output the second image sub-band component to the ISP in response to the second image data being captured by the second camera system.
7. The camera system of claim 1 , wherein the camera system is configured as a master camera system and wherein the second camera system is configured as a slave camera system.
8. A method for aligning cameras in a multi-camera system, comprising:
capturing, by a first image sensor chip of a first camera, light incident upon the first image sensor chip to produce first image data representative of light incident upon the first image sensor chip;
decimating, by a compression engine of the first camera, the first image data to produce a first sub-band component representative of the first image data;
receiving, by an input of the first camera, a second sub-band component from a second camera representative of second image data captured by the second camera, the first camera and the second camera having at least partially overlapping fields of view;
comparing, by the first camera, the first sub-band component and the second sub-band component; and
adjusting, by an alignment engine of the first camera, one or both of the fields of view of the first camera and the second camera based on the comparison of the first sub-band component and the second sub-band component.
9. The method of claim 8 , wherein the first image sub-band component comprises a first low/low sub-band component, and wherein the second image sub-band component comprises a second low/low sub-band component, the first low/low sub-band component comprising a resolution lower than the first image data, and the second low/low sub-band component comprising a resolution lower than the second image data.
10. The method of claim 8 , wherein comparing the first sub-band component and the second sub-band component comprises aligning the first sub-band component and the second sub-band component.
11. The method of claim 10 , wherein aligning the first sub-band component and the second sub-band component comprises determining a pixel difference between the first sub-band component and the second sub-band component.
12. The method of claim 11 , wherein adjusting one or both of the fields of view of the camera and the second camera comprises adjusting one of the fields of view by the determined pixel difference between the first sub-band component and the second sub-band component.
13. The method of claim 8 , wherein the second camera comprises a compression engine configured to decimate the second image data to produce the second image sub-band component, and wherein the second camera is configured to output the second image sub-band component to the ISP in response to the second image data being captured by the second camera.
14. The method of claim 8 , wherein the first camera is configured as a master camera and wherein the second camera is configured as a slave camera.
15. An integrated circuit chip for aligning cameras in a multi-camera system, comprising:
a first input configured to receive a first sub-band component representative of first
image data captured by a first image sensor chip of a first camera; a second input configured to receive a second sub-band component representative of second image data captured by a second image sensor chip of a second camera, the first camera and the second camera having at least partially overlapping fields of view;
a comparison engine configured to compare the first sub-band component and the second sub-band component;
an alignment engine configured to adjust one or both of the fields of view of the first camera and the second camera based on the comparison of the first sub-band component and the second sub-band component; and
wherein the first image sub-band component comprises a first low/low sub-band component, and wherein the second image sub-band component comprises a second low/low sub-band component, the first low/low sub-band component comprising a resolution lower than the first image data, and the second low/low sub-band component comprising a resolution lower than the second image data.
16. The integrated circuit chip of claim 15 , wherein comparing the first sub-band component and the second sub-band component comprises aligning the first sub-band component and the second sub-band component.
17. The integrated circuit chip of claim 16 , wherein aligning the first sub-band component and the second sub-band component comprises determining a pixel difference between the first sub-band component and the second sub-band component.
18. The integrated circuit chip of claim 17 , wherein adjusting one or both of the fields of view of the camera system and the second camera system comprises adjusting one of the fields of view by the determined pixel difference between the first sub-band component and the second sub-band component.
19. The integrated circuit chip of claim 15 , wherein the first input and the second input comprise the same input.