Method for generating an HDR image of a scene based on a tradeoff between brightness distribution and motion
View Patent ↗The present invention relates in general to a method of high dynamic range (HDR) digital imaging and determining and setting exposure parameters for detection of image data by an imaging device, such as a digital camera, to produce a high dynamic range (HDR) image of a scene. The method includes setting an exposure (E i+1 ) for a next frame (f i+1 ) as a function of the current exposure (E i ), of a first brightness distribution (Hfull i ) of colors of pixels of the current frame (f i ) and of a second brightness distribution (Hmotion i ) of colors of those pixels weighted by the motion of those pixels, such that motion is evaluated for those pixels in comparison with a previous frame (f i ), capturing the next frame (f i+1 ) under the set exposure (E i+1 ) and merging the next frame (f i+1 ) with at least the current frame (f i ) into an HDR image.
1. A method for generating an HDR image of a scene, wherein a current frame (f i ) imaging said scene has been captured under a current exposure (E i ) and a previous frame (f i+1 ) imaging said scene has been captured before said current frame (f i ), said method comprising:
setting an exposure (E i+1 ) for a next frame (f i+1 ) as a function of said current exposure (E i ), of a first brightness distribution (Hfull i ) of colors of pixels of said current frame (f i ) and of a second brightness distribution (Hmotion i ) of colors of these pixels weighted by motion of these pixels, wherein said motion is evaluated for these pixels in comparison with said previous frame (f i ),
capturing said next frame (f i+1 ) under said set exposure (E i+1 ),
merging said next frame (f i+1 ) with at least said current frame (f i ) into an HDR image.
2. Method for generating an HDR image according to claim 1 , wherein said exposure (E i+1 ) for the next frame (f i+1 ) is set as a function also of a preferred direction (dir i+1 ) of exposure change for said current frame (f i+1 ).
3. Method for generating an HDR image according to claim 2 comprising the determination of a preferred direction (dir i+2 ) of exposure change for a frame (f i+2 ) following the next frame (f i+1 ).
4. Method for generating an HDR image according to claim 1 , wherein said setting of an exposure (E i+1 ) for the next frame (f i+1 ) comprises an estimation of an initial exposure (Einit i+1 ) based on said first brightness distribution (Hfull i ) but not based on said second brightness distribution (Hmotion i ), an estimation of an adjusted exposure (Eadj i+1 ) based on said second brightness distribution (Hmotion i ), and a final estimation of said exposure (E i+1 ) for the next frame (f i+1 ) adapted to choose between said initial exposure (Einit i+1 ) and said adjusted exposure (Eadj i+1 ) as a value for said exposure (E i+1 ) for the next frame (f i+1 ).
5. A HDR image capture device comprising a frame sensor configured to capture successive frames imaging a scene, notably to capture a current frame (f i ) under a current exposure (E i ) and a previous frame (f i+1 ), and a processor configured to:
set an exposure (E i+1 ) for a next frame (f i+1 ) as a function of said current exposure (E i ), of a first brightness distribution (Hfull i ) of colors of pixels of said current frame (f i ) and of a second brightness distribution (Hmotion i ) of colors of these pixels weighted by motion of these pixels, wherein said motion is evaluated for these pixels in comparison with said previous frame (f i+1 ),
trigger the capture of said next frame (f i+1 ) under said set exposure (E i+1 ) by said frame sensor,
merge said next frame (f i+1 ) with at least said current frame (f i ) into an HDR image.
6. HDR image capture device according to claim 5 , wherein said processor is also configured to set said exposure (E i+1 ) for the next frame (f i+1 ) as a function also of a preferred direction (dir i+1 ) of exposure change for said current frame (f i+1 ).
7. HDR image capture device according to claim 6 , wherein said processor is also configured to determine a preferred direction (dir i+2 ) of exposure change for a frame (f i+2 ) following the next frame (f i+1 ).
8. HDR image capture device according to claim 5 , wherein said processor is also configured such that said setting of an exposure (E i+1 ) for the next frame (f i+1 ) comprises an estimation of an initial exposure (Einit i+1 ) based on said first brightness distribution (Hfull i ) but not based on said second brightness distribution (Hmotion i ), an estimation of an adjusted exposure (Eadj i+1 ) based on said second brightness distribution (Hmotion i ), and a final estimation of said exposure (E i+1 ) for the next frame (f i+1 ) adapted to choose between said initial exposure (Einit i+1 ) and said adjusted exposure (Eadj i+1 ) as a value for said exposure (E i+1 ) for the next frame (f i+1 ).