Image processing method and apparatus and system for dynamically adjusting frame rate
An image processing method is provided. The image processing method includes the following steps: detecting an input sequence of image frames captured using an image capturing device to generate a detection result; referring to the detection result to selectively perform frame interpolation on the input sequence of image frames to generate a to-be-encoded sequence of image frames; and encoding the to-be-encoded sequence of image frames to generate an encoded video signal.
1. An image processing method, comprising:
detecting, by a detection circuit, an input sequence of image frames captured using an image capturing device to generate a detection result indicating whether or not to perform frame interpolation on the input sequence of image frames, the detection circuit capable of generating the detection result based on an exposure time of the image capturing device;
referring to the detection result to selectively perform the frame interpolation on the input sequence of image frames to generate a to-be-encoded sequence of image frames; and
encoding the to-be-encoded sequence of image frames to generate an encoded video signal,
wherein the detection result comprises a luminance of the input sequence of image frames, and
wherein when the detection result indicates that the luminance is less than a predetermined threshold, the step of performing the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames is performed.
2. The image processing method of claim 1 , wherein when the frame interpolation on the input sequence of image frames is not performed, the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
3. The image processing method of claim 1 , wherein when the frame interpolation on the input sequence of image frames is performed, the to-be-encoded sequence of image frames comprises the input sequence of image frames and an additional sequence of image frames generated by the frame interpolation.
4. The image processing method of claim 1 , wherein the detection result comprises a frame rate of the input sequence of image frames.
5. The image processing method of claim 4 , wherein when the detection result indicates that the frame rate is less than a predetermined threshold, the step of performing the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames is performed.
6. The image processing method of claim 4 , wherein when the detection result indicates that the frame rate is not less than a predetermined threshold, the step of performing the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames is not performed, and the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
7. The image processing method of claim 1 , wherein when the detection result indicates that the luminance is not less than a predetermined threshold, the step of performing the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames is not performed, and the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
8. The image processing method of claim 1 , wherein when the detection result indicates that the luminance is less than the predetermined threshold, the image processing method further comprises:
generating a feedback signal that controls a shutter device in the image capturing device to decrease a shutter speed of the shutter device.
9. The image processing method of claim 1 , wherein the detection result comprises a frame rate of the input sequence of image frames and a luminance of the input sequence of image frames.
10. The image processing method of claim 9 , wherein when the detection result indicates that the frame rate is less than a first predetermined threshold and that the luminance is less than a second predetermined threshold, the step of performing the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames is performed.
11. The image processing method of claim 9 , wherein when the detection result indicates that the frame rate is not less than a first predetermined threshold and that the luminance is not less than a second predetermined threshold, the step of performing the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames is not performed, and the input sequence of image frames is used as the to-be-encoded sequence of image frames.
12. An image processing apparatus, comprising:
a detection circuit capable of detecting an input sequence of image frames captured using an image capturing device to generate a detection result indicating whether or not to perform frame interpolation on the input sequence of image frames, the detection circuit also capable of generating the detection result based on an exposure time of the image capturing device;
a frame interpolation circuit, coupled to the detection circuit, the frame interpolation circuit arranged for referring to the detection result to selectively perform frame interpolation on the input sequence of image frames to generate a to-be-encoded sequence of image frames; and
a video encoder circuit capable of encoding the to-be-encoded sequence of image frames to generate an encoded video signal,
wherein the detection result comprises a luminance of the input sequence of image frames, and
wherein when the detection result indicates that the luminance is less than a predetermined threshold, the frame interpolation circuit performs the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames.
13. The image processing apparatus of claim 12 , wherein when the frame interpolation circuit does not perform the frame interpolation on the input sequence of image frames, the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
14. The image processing apparatus of claim 12 , wherein when the frame interpolation circuit performs the frame interpolation on the input sequence of image frames, the to-be-encoded sequence of image frames comprises the input sequence of image frames and an additional sequence of image frames generated by the frame interpolation.
15. The image processing apparatus of claim 12 , wherein the detection result comprises a frame rate of the input sequence of image frames.
16. The image processing apparatus of claim 15 , wherein when the detection result indicates that the frame rate is less than a predetermined threshold, the frame interpolation circuit performs the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames.
17. The image processing apparatus of claim 15 , wherein when the detection result indicates that the frame rate is not less than a predetermined threshold, the frame interpolation circuit does not perform the frame interpolation on the input sequence of image frames, and the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
18. The image processing apparatus of claim 12 , wherein when the detection result indicates that the luminance is not less than a predetermined threshold, the frame interpolation circuit does not perform the frame interpolation on the input sequence of image frames, and the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
19. The image processing apparatus of claim 12 , wherein when the detection result indicates that the luminance is less than the predetermined threshold, the frame interpolation circuit further generates a feedback signal that controls a shutter device in the image capturing device to decrease a shutter speed of the shutter device.
20. The image processing apparatus of claim 12 , wherein the detection result comprises a frame rate of the input sequence of image frames and a luminance of the input sequence of image frames.
21. The image processing apparatus of claim 20 , wherein when the detection result indicates that the frame rate is less than a first predetermined threshold and that the luminance is less than a second predetermined threshold, the frame interpolation circuit performs the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames.
22. The image processing apparatus of claim 20 , wherein when the detection result indicates that the frame rate is not less than a first predetermined threshold and that the luminance is not less than a second predetermined threshold, the frame interpolation circuit does not perform the frame interpolation on the input sequence of image frames, and the input sequence of image frames is provided as the to-be-encoded sequence of image frames.
23. An image processing apparatus, comprising:
a detection circuit capable of detecting an input sequence of image frames captured using an image capturing device to generate a detection result indicating whether or not to perform frame interpolation on the input sequence of image frames to adjust a frame rate of the input sequence of image frames, the detection circuit also capable of generating the detection result based on a luminance of the image capturing device;
a frame interpolation circuit, coupled to the detection circuit, the frame interpolation circuit arranged for referring to the detection result to selectively perform frame interpolation on the input sequence of image frames to generate a to-be-encoded sequence of image frames; and
a video encoder circuit capable of encoding the to-be-encoded sequence of image frames to generate an encoded video signal,
wherein the detection result comprises a luminance of the input sequence of image frames, and
wherein when the detection result indicates that the luminance is less than a predetermined threshold, the frame interpolation circuit performs the frame interpolation on the input sequence of image frames to generate the to-be-encoded sequence of image frames.