On-chip upscaling and downscaling in a camera architecture
An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
1. A camera system, comprising:
an image sensor chip configured to produce image data representative of light incident upon the image sensor chip;
an accelerator chip comprising:
a decimator configured to decimate the image data into a plurality of image sub-band components;
a downscale engine configured to downscale the image data using one or more of the image sub-band components; and
an upscale engine configured to upscale the image data using one or more of the image sub-band components; and
an image signal processor chip configured to process image data outputted by the image sensor chip or the accelerator chip and to output the processed image data.
2. The camera system of claim 1 , wherein the accelerator chip further comprises an H.264 engine configured to decode image sub-band components encoded as H.264 video.
3. The camera system of claim 2 , wherein upscaling the image data comprises decoding the one or more of the image sub-band components using the H.264 engine.
4. The camera system of claim 1 , wherein the accelerator chip further comprises an VC-5 engine configured to decode image sub-band components encoded as VC-5 video.
5. The camera system of claim 4 , wherein upscaling the image data comprises decoding the one or more of the image sub-band components using the VC-5 engine.
6. The camera system of claim 1 , wherein the downscale engine is configured to downscale the image data by outputting a low/low image sub-band component.
7. The camera system of claim 1 , wherein the upscale engine is configured to upscale the one or more image sub-band components by decoding a first image sub-band component using a first decoding algorithm, decoding a second image sub-band component using a second decoding algorithm, and combining the decoded first image sub-band component and the decoded second image sub-band component.
8. A camera system, comprising:
an image sensor chip configured to produce image data representative of light incident upon the image sensor chip; and
an image signal processor chip comprising:
a decimator configured to decimate the image data into a plurality of image sub-band components;
a downscale engine configured to downscale the image data using one or more of the image sub-band components;
an upscale engine configured to upscale the image data using one or more of the image sub-band components;
an encoder configured to encode one or more of the image data, the downscaled image data, and the upscaled image data to produce encoded image data; and
and output configured to output the encoded image data.
9. The camera system of claim 8 , wherein the image signal processor chip further comprises an H.264 engine configured to decode image sub-band components encoded as H.264 video.
10. The camera system of claim 9 , wherein upscaling the image data comprises decoding the one or more of the image sub-band components using the H.264 engine.
11. The camera system of claim 8 , wherein the image signal processor chip further comprises an VC-5 engine configured to decode image sub-band components encoded as VC-5 video.
12. The camera system of claim 11 , wherein upscaling the image data comprises decoding the one or more of the image sub-band components using the VC-5 engine.
13. The camera system of claim 8 , wherein the downscale engine is configured to downscale the image data by outputting a low/low image sub-band component.
14. The camera system of claim 8 , wherein the upscale engine is configured to upscale the one or more image sub-band components by decoding a first image sub-band component using a first decoding algorithm, decoding a second image sub-band component using a second decoding algorithm, and combining the decoded first image sub-band component and the decoded second image sub-band component.
15. An image signal processor chip comprising:
an input configured to receive image data captured by an image sensor chip representative of light incident upon the image sensor chip;
a decimator configured to decimate the image data into a plurality of image sub-band components;
a downscale engine configured to downscale the image data using one or more of the image sub-band components;
an upscale engine configured to upscale the image data using one or more of the image sub-band components;
an encoder configured to encode one or more of the image data, the downscaled image data, and the upscaled image data to produce encoded image data; and
an output configured to output the encoded image data.
16. The image signal processor chip of claim 15 , wherein the image signal processor chip further comprises an H.264 engine configured to decode image sub-band components encoded as H.264 video.
17. The image signal processor chip of claim 16 , wherein upscaling the image data comprises decoding the one or more of the image sub-band components using the H.264 engine.
18. The image signal processor chip of claim 15 , wherein the image signal processor chip further comprises an VC-5 engine configured to decode image sub-band components encoded as VC-5 video.
19. The image signal processor chip of claim 18 , wherein upscaling the image data comprises decoding the one or more of the image sub-band components using the VC-5 engine.
20. The image signal processor chip of claim 15 , wherein the downscale engine is configured to downscale the image data by outputting a low/low image sub-band component.