Motion estimation and detection in a camera system accelerator architecture
An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
1. A camera system, comprising:
an image sensor chip configured to produce image data representative of light incident upon the image sensor chip;
an image signal processor chip (“ISP”) configured to process the image data, the ISP comprising:
an input configured to receive the image data from the image sensor chip;
a decimator configured to decimate the received image data into a plurality of image sub-band components;
a motion detection engine configured to generate a motion map based on a first subset of the plurality of image sub-band components;
a motion estimation engine configured to generate a set of motion vectors based on the generated motion map and a second subset of the plurality of image sub-band components; and
an output configured to output one or more of the received image data and the set of motion vectors.
2. The camera system of claim 1 , wherein the first subset of image sub-band components comprises a low/low image sub-band component, a low/high image sub-band component, and a high/low image sub-band component.
3. The camera system of claim 1 , wherein the second subset of image sub-band components comprises a high/high image sub-band component.
4. The camera system of claim 1 , wherein the generated motion map identifies regions of motion between two video frames.
5. The camera system of claim 1 , wherein the motion map is generated based on identified regions of movement within a pair of image sub-band components each associated with a different resolution.
6. The camera system of claim 5 , wherein each of the pair of image sub-band components comprises a low/low image sub-band component.
7. The camera system of claim 1 , wherein the motion vectors are generated based edge data within the second subset of the plurality of image sub-band components.
8. The camera system of claim 1 , wherein the ISP further comprises:
a frame generator configured to generate difference frames representative of a change in image data between two video frames based on the generated motion vectors.
9. The camera system of claim 1 , wherein the ISP further comprises:
a stabilization engine configured to perform electronic image stabilization for subsequently captured image data using the generated motion vectors.
10. The camera system of claim 1 , wherein the ISP further comprises:
a filter engine configured to perform motion compensated temporal filtering using the generated motion vectors.
11. An image signal processor integrated circuit (“ISP”), comprising:
an input configured to receive image data captured by an image sensor chip;
a decimator configured to decimate the received image data into a plurality of image sub-band components;
a motion estimation engine configured to generate a set of motion vectors based on a motion map and a subset of the plurality of image sub-band components; and
an output configured to selectively output one or more of the received image data and the set of motion vectors to a camera memory.
12. The ISP of claim 11 , wherein the motion map is generated based on a second subset of the plurality of image sub-band components.
13. The ISP of claim 11 , wherein the subset of image sub-band components comprises a high/high image sub-band component.
14. The ISP of claim 11 , wherein the motion map identifies regions of motion between two video frames.
15. The ISP of claim 11 , wherein the motion map is generated based on identified regions of movement within a pair of image sub-band components each associated with a different resolution.
16. The ISP of claim 15 , wherein each of the pair of image sub-band components comprises a low/low image sub-band component.
17. The ISP of claim 11 , wherein the motion vectors are generated based edge data within the subset of the plurality of image sub-band components.
18. The ISP of claim 11 , further comprising:
a frame generator configured to generate difference frames representative of a change in image data between two video frames based on the generated motion vectors.
19. The ISP of claim 11 , further comprising:
a stabilization engine configured to perform electronic image stabilization for subsequently captured image data using the generated motion vectors.
20. The ISP of claim 11 , further comprising:
a filter engine configured to perform motion compensated temporal filtering using the generated motion vectors.