System and method for frame capturing and processing
Systems and methods are provided that capture and process frames of frame data. An image sensor captures frames of frame data representative of light incident upon the image sensor using a rolling shutter and outputs the frames of frame data. The image sensor captures at least one of the frames over a frame capture interval and then waits over a blanking interval before capturing another frame. A buffer receives and stores the frames output by the image sensor. An image signal processor retrieves the frames from the buffer and processes the frames over successive frame processing intervals to generate a video having a time interval per frame greater than the frame capture interval. At least one of the successive frame processing intervals is greater than the frame capture interval and is less than or equal to a sum of the frame capture interval and the blanking interval.
1. A system that captures and processes frames of frame data, comprising:
an image sensor configured to capture frames of frame data representative of light incident upon the image sensor using a rolling shutter and at a frame capture rate;
a frame processor configured to produce combined frames by combining at least some of the frames output by the image sensor, wherein production of the combined frames is at an output frame rate less than the frame capture rate; and
an image signal processor configured to process the combined frames at the output frame rate;
wherein a number of frames that are combined is selected using an input to the image signal processor.
2. The system of claim 1 wherein a number of frames is configurable from one combined frame to at least another combined frame.
3. The system of claim 1 , wherein the frame processor is configured to combine frames by summing or averaging wavelet coefficients associated with the captured frames.
4. The system of claim 1 , wherein the combined frames are produced with a greater dynamic range than the captured frames.
5. The system of claim 4 , wherein the combined frames are produced using a weighted motion blur.
6. The system of claim 5 , wherein the combined frames are produced using a simulated capture angle.
7. The system of claim 1 , wherein the frame processor produces combined frames by successively combining frames retrieved from a buffer.
8. A method for capturing and processing frames of frame data, comprising:
capturing frames of frame data representative of light incident upon an image sensor using a rolling shutter at a frame rate;
producing combined frames at another frame rate that is less than the frame rate by combining at least some of the frames captured by the image sensor using a frame processor; and
processing the combined frames at the another frame rate using an image signal processor,
wherein a number of frames that are combined is selected using an input to the image signal processor; and
wherein each combined frame includes at least one image effect.
9. The method of claim 8 , wherein a number of frames that are combined varies per combined frame.
10. The method of claim 8 , wherein the combined frames are produced by summing or averaging wavelet coefficients associated with the captured frames.
11. The method of claim 8 , wherein the combined frames are produced with a greater dynamic range than the captured frames.
12. The method of claim 11 , wherein the at least one image effect is a weighted motion blur.
13. The method of claim 12 , wherein the at least one image effect is a simulated capture angle.
14. The method of claim 8 , wherein the frame processor produces combined frames by successively combining frames retrieved from a buffer.
15. An apparatus, comprising:
an image sensor configured to:
capture frames of frame data representative of light incident upon the image sensor at a first frame rate, wherein exposure and readout from the image sensor scans across the image sensor; and
output the frames of frame data to a buffer;
a frame processor configured to combine at least some of the frames in the buffer to produce combined frames at a second frame rate less than the first frame rate; and
an image signal processor configured to process the combined frames at the second frame rate,
wherein a number of frames that are combined to produce one of the combined frames is selected using an input to the image signal processor.
16. The apparatus of claim 15 , wherein each combined frame includes at least one of a simulated capture angle and a weighted motion blur.
17. The apparatus of claim 16 , wherein the frame processor is configured to combine frames by summing or averaging wavelet coefficients associated with the captured frames.