Image processing under flickering lighting conditions using estimated illumination parameters
View Patent ↗Methods for estimating illumination parameters under flickering lighting conditions are disclosed. Illumination parameters, such as phase and contrast, of a intensity-varying light source may be estimated by capturing a sequence of video images, either prior to or after a desired still image to be processed. The relative average light intensities of the adjacently-captured images are calculated and used to estimate the illumination parameters applicable to the desired still image. The estimated illumination parameters may be used to calculate the point spread function of a still image for image de-blurring processing. The estimated illumination parameters may also be used to synchronize the exposure timing of a still image to the time when there is the most light, as well as for use in motion estimation during view/video modes.
1. A method for performing image processing under flickering light conditions comprising the acts of:
receiving first image data corresponding to a plurality of captured image frames captured at a first time period under flickering light conditions;
receiving second image data corresponding to a desired still image captured at a second time period under flickering light conditions;
estimating at least one illumination parameter based on the first image data, wherein said estimating includes calculating relative average light intensities for each of the plurality of captured image frames;
calculating a point spread function of the desired still image based in part on said at least one estimated illumination parameter; and
de-blurring the desired still image based on the point spread function.
2. The method of claim 1 , wherein the flickering lighting conditions comprises fluorescent lighting.
3. The method of claim 1 , wherein the first time period occurs over a period of time that is adjacent to the second time period.
4. The method of claim 1 , wherein the first time period occurs after the second time period.
5. The method of claim 1 , wherein said first time period occurs during an image preview mode.
6. The method of claim 1 , further comprising:
receiving motion-related data corresponding to the first time period; and
aligning the plurality of captured image frames using the motion-related data.
7. The method of claim 1 , further wherein calculating the point spread function further comprises calculating the point spread function based on the at least one estimated illumination parameter, and further based on motion-related data corresponding to the second time period.
8. The method of claim 1 , wherein estimating the at least one illumination parameter further comprises estimating at least one of a contrast and a phase of a light source that is generating the flickering lighting conditions.
9. The method of claim 1 , wherein estimating the at least one illumination parameter comprises estimating the at least one illumination parameter by applying a sinusoidal model to the calculated relative average light intensities for each of said plurality of captured image frames.
10. The method of claim 9 , further comprises generating a system of independent equations, based on said sinusoidal model, that correspond to the plurality of captured image frames.
11. A camera comprising:
an image capturing system; and
an image processing circuit coupled to the image capturing system, wherein the image processing circuit is to:
receive first image data corresponding to a plurality of captured image frames captured by the image capturing system at a first time period under flickering light conditions,
receive second image data corresponding to a desired still image captured by the image capturing system at a second time period under flickering light conditions,
estimate at least one illumination parameter, which is based on the first image data, by calculating relative average light intensities for each of said plurality of captured image frames,
calculate a point spread function of the desired still image based in part on said at least one estimated illumination parameter, and
de-blur said desired still image based on said point spread function.
12. The camera of claim 11 , wherein the flickering lighting conditions comprises fluorescent lighting.
13. The camera of claim 11 , wherein the first time period occurs over a period of time that is adjacent to the second time period.
14. The camera of claim 11 , wherein the first time period occurs after the second time period.
15. The camera of claim 11 , wherein the first time period occurs during an image preview mode.
16. The camera of claim 11 , wherein the camera further comprises a motion sensing circuitry electrically coupled to the image processing circuit, and wherein the image processing circuit is further to:
receive motion-related data corresponding to the first time period, and
align the plurality of captured image frames using the motion-related data.
17. The camera of claim 11 , wherein the image processing circuit is to calculate the point spread function based on the at least one estimated illumination parameter, and further based on motion-related data corresponding to the second time period.
18. The camera of claim 11 , wherein the at least one illumination parameter comprises at least one of a contrast and a phase of a light source that is generating the flickering lighting conditions.
19. The camera of claim 11 , wherein the image processing circuit is to estimate the at least one illumination parameter by applying a sinusoidal model to the calculated relative average light intensities for each of said plurality of captured image frames.
20. The camera of claim 19 , wherein the image processing circuit is further to generate a system of independent equations, based on said sinusoidal model, that correspond to the plurality of captured image frames.
21. A method for performing image processing under flickering light conditions comprising the acts of:
receiving first image data corresponding to a plurality of captured image frames captured at a first time period under flickering light conditions;
receiving second image data corresponding to a desired still image captured at a second time period under flickering light conditions;
estimating at least one illumination parameter based on the first image data, wherein said estimating includes calculating relative average light intensities for each of the plurality of captured image frames;
calculating a point spread function of the desired still image based in part on said at least one estimated illumination parameter; and
de-blurring the desired still image based on the point spread function, wherein exposure timing of the second image data is synchronized with lighting intensity based on the at least one illumination parameter.
22. The method of claim 21 , further comprising:
further wherein calculating the point spread function further comprises calculating the point spread function based on the at least one estimated illumination parameter, and further based on motion-related data corresponding to the second time period.
23. The method of claim 21 ,
wherein estimating the at least one illumination parameter further comprises estimating at least one of a contrast and a phase of a light source that is generating the flickering lighting conditions.