Camera system transmission in bandwidth constrained environments
An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
1. A camera system, comprising:
an image sensor chip configured to produce image data representative of light incident upon the image sensor chip;
an image signal processor chip (“ISP”) configured to detect an amount of bandwidth available to the camera system, the ISP comprising:
an input to receive the image data from the image sensor chip;
a compression engine configured to decimate the received image data into a plurality of image sub-band components including a first image sub-band component representative of the image data; and
an encoder configured to:
in response to the amount of bandwidth available to the camera system being less than a threshold amount of bandwidth, encode the first image sub-band component and output the encoded first image sub-band component; and
in response to the amount of bandwidth available to the camera system being greater than the threshold amount of bandwidth, encode the image data and output the encoded image data.
2. The camera system of claim 1 , wherein the ISP further comprises an output configured to output the encoded first image sub-band component and the encoded image data.
3. The camera system of claim 1 , wherein the first image sub-band component is selected from the plurality of image sub-band components by the encoder based on the detected amount of bandwidth available to the camera system.
4. The camera system of claim 3 , wherein the first image sub-band component comprises a low/low sub-band component.
5. The camera system of claim 4 , wherein the first image sub-band component comprises a resolution lower than a resolution of the image data.
6. The camera system of claim 1 , wherein the encoder is further configured to:
after outputting the encoded first image sub-band component, in response to determining that the amount of bandwidth available to the camera system increases above the threshold amount of bandwidth, encoding the image data and outputting the encoded image data.
7. The camera system of claim 1 , wherein the encoder is further configured to:
after outputting the encoded first image sub-band component, storing the image data at the camera system until the amount of bandwidth available to the camera system increases above the threshold amount of bandwidth.
8. A method of capturing image data by a camera system, comprising:
capturing, by an image sensor chip, image data representative of light incident upon the image sensor chip;
determining, by an image signal processor chip (“ISP”), an amount of bandwidth available to the camera system;
decimating, by a compression engine, the received image data into a plurality of image sub-band components including a first image sub-band component representative of the image data;
in response to the amount of bandwidth available to the camera system being less than a threshold amount of bandwidth:
encoding, by an encoder, the first image sub-band component; and
outputting, by an output, the encoded first image sub-band component; and
in response to the amount of bandwidth available to the camera system being greater than the threshold amount of bandwidth:
encoding, by the encoder, the image data; and
outputting, by the output, the encoded image data.
9. The method of claim 8 , wherein the first image sub-band component is selected from the plurality of image sub-band components by the encoder based on the determined amount of bandwidth available to the camera system.
10. The method of claim 9 , wherein the first image sub-band component comprises a low/low sub-band component.
11. The method of claim 10 , wherein the first image sub-band component comprises a resolution lower than a resolution of the image data.
12. The method of claim 8 , further comprising:
after outputting the encoded first image sub-band component, in response to determining that the amount of bandwidth available to the camera system increases above the threshold amount of bandwidth:
encoding, by the encoder, the image data; and
outputting, by the output, the encoded image data.
13. The method of claim 8 , further comprising:
after outputting the encoded first image sub-band component:
storing, in a camera system memory, the image data until the amount of bandwidth available to the camera system increases above the threshold amount of bandwidth.
14. An integrated circuit chip for use in a camera system, comprising:
an input to receive image data captured by an image sensor chip;
a bandwidth engine configured to determine an amount of bandwidth available to the camera system to output data;
a compression engine configured to decimate the received image data into a plurality of image sub-band components including a first image sub-band component representative of the image data; and
an encoder configured to:
in response to the amount of bandwidth available to the camera system being less than a threshold amount of bandwidth, encode the first image sub-band component and output the encoded first image sub-band component; and
in response to the amount of bandwidth available to the camera system being greater than the threshold amount of bandwidth, encode the image data and output the encoded image data.
15. The integrated circuit chip of claim 14 , further comprising an output configured to output the encoded first image sub-band component and the encoded image data.
16. The integrated circuit chip of claim 14 , wherein the first image sub-band component is selected from the plurality of image sub-band components by the encoder based on the detected amount of bandwidth available to the camera system.
17. The integrated circuit chip of claim 16 , wherein the first image sub-band component comprises a low/low sub-band component.
18. The integrated circuit chip of claim 17 , wherein the first image sub-band component comprises a resolution lower than a resolution of the image data.
19. The integrated circuit chip of claim 15 , wherein the encoder is further configured to:
after outputting the encoded first image sub-band component, in response to determining that the amount of bandwidth available to the camera system increases above the threshold amount of bandwidth, encoding the image data and outputting the encoded image data.
20. The integrated circuit chip of claim 15 , wherein the encoder is further configured to:
after outputting the encoded first image sub-band component, storing the image data at the camera system until the amount of bandwidth available to the camera system increases above the threshold amount of bandwidth.