Camera system dual-encoder architecture
View Patent ↗An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
1. A camera system, comprising:
an image sensor chip configured to produce image data representative of light incident upon the image sensor chip;
an image signal processor chip (“ISP”) configured to process the image data; and
an image capture accelerator chip (“ICA”) coupled between the image sensor chip and the ISP, the image capture accelerator comprising:
an input configured to receive the image data from the image sensor chip;
a decimator configured to, when the camera system is configured to operate in an accelerated capture mode, decimate the received image data into a first portion of the received image data and a second portion of the received image data;
a first entropy encoder configured to encode the first portion of the received image data to produce first encoded image data;
a second entropy encoder configured to encode the second portion of the received image data to produce second encoded image data;
a memory configured to store the first encoded image data and the second encoded image data; and
an output configured to, when the camera system is configured to operate in a normal capture mode, output the received image data to the ISP.
2. The camera system of claim 1 , wherein the first portion of the received image data comprises a first set of sub-frames, and wherein the second portion of the received image data comprises a second set of sub-frames.
3. The camera system of claim 1 , wherein the first portion of the received image data and the second portion of the received image data include sub-portions corresponding to overlapping portions of an image frame.
4. The camera system of claim 3 , wherein the first entropy encoder and the second entropy encoder are each configured to encode the first portion of the received image data and the second portion of the received image data, respectively, based on the sub-portions corresponding to overlapping portions of an image frame.
5. The camera system of claim 1 , wherein the first entropy encoder and the second entropy encoder are each configured to perform a first encoding operation for a border of a portion of received image data, and to perform a second encoding operation for an interior of a portion of received image data.
6. The camera system of claim 5 , wherein performing the first encoding operation comprises encoding a one-pixel boundary of the portion of received image data using the first encoding operation.
7. The camera system of claim 1 , wherein the first entropy encoder encodes the first portion of the received image data in parallel with the second entropy encoder encoding the second portion of the received image data.
8. The camera system of claim 1 , wherein the first entropy encoder and the second entropy encoder each comprise wavelet encoders.
9. The camera system of claim 1 , wherein the first entropy encoder and the second entropy encoder each comprise VC-5 encoders.
10. The camera system of claim 1 , wherein the ICA further comprises one or more decoders configured to, when the camera system is configured to operate in a standby mode, decode the first encoded image data and the second encoded image data to produce decoded image data, and to output the decoded image data to the ISP.
11. An image capture accelerator integrated circuit (“ICA”), comprising:
an input configured to receive the image data captured by an image sensor chip;
a decimator configured to, when the ICA is configured to operate in an accelerated capture mode, decimate the received image data into a first portion of the received image data and a second portion of the received image data;
a first entropy encoder configured to encode the first portion of the received image data to produce first encoded image data;
a second entropy encoder configured to encode the second portion of the received image data to produce second encoded image data;
a memory configured to store the first encoded image data and the second encoded image data; and
an output configured to, when the ICA is configured to operate in a normal capture mode, output the received image data to an image signal processor chip (“ISP”).
12. The ICA of claim 11 , wherein the first portion of the received image data comprises a first set of sub-frames, and wherein the second portion of the received image data comprises a second set of sub-frames.
13. The ICA of claim 11 , wherein the first portion of the received image data and the second portion of the received image data include sub-portions corresponding to overlapping portions of an image frame.
14. The ICA of claim 13 , wherein the first entropy encoder and the second entropy encoder are each configured to encode the first portion of the received image data and the second portion of the received image data, respectively, based on the sub-portions corresponding to overlapping portions of an image frame.
15. The ICA of claim 11 , wherein the first entropy encoder and the second entropy encoder are each configured to perform a first encoding operation for a border of a portion of received image data, and to perform a second encoding operation for an interior of a portion of received image data.
16. The ICA of claim 15 , wherein performing the first encoding operation comprises encoding a one-pixel boundary of the portion of received image data using the first encoding operation.
17. The ICA of claim 11 , wherein the first entropy encoder encodes the first portion of the received image data in parallel with the second entropy encoder encoding the second portion of the received image data.
18. The ICA of claim 11 , wherein the first entropy encoder and the second entropy encoder each comprise wavelet encoders.
19. The ICA of claim 11 , wherein the first entropy encoder and the second entropy encoder each comprise VC-5 encoders.
20. The ICA of claim 11 , wherein the ICA further comprises one or more decoders configured to, when the ICA is configured to operate in a standby mode, decode the first encoded image data and the second encoded image data to produce decoded image data, and to output the decoded image data to the ISP.