Local histogram matching with global regularization and motion exclusion for multi-exposure image fusion

1. A method comprising:

obtaining, using at least one sensor of an electronic device, multiple image frames of a scene, the multiple image frames including a first image frame and a second image frame captured using different exposures;

excluding, using at least one processor of the electronic device, pixels in the first and second image frames that are associated with at least a threshold amount of motion based on a coarse motion map;

generating, using the at least one processor, multiple local histogram match maps based on different portions of the first and second image frames containing non-excluded pixels; and

generating, using the at least one processor, an image of the scene using the local histogram match maps.

2. The method of claim 1 , further comprising:

generating a global histogram match map based on the first image frame and the second image frame; and

modifying at least one of the local histogram match maps based on the global histogram match map.

3. The method of claim 2 , wherein modifying at least one of the local histogram match maps comprises:

replacing zero values in a specified local histogram match map with corresponding values from the global histogram match map; and

replacing non-zero values in the specified local histogram match map with values interpolated between the specified local histogram match map and the global histogram match map.

4. The method of claim 3 , wherein the values interpolated between the specified local histogram match map and the global histogram match map are weighted based on an amount of saturation in a corresponding tile of one of the multiple image frames.

5. The method of claim 2 , wherein modifying at least one of the local histogram match maps comprises:

replacing a value in a specified local histogram match map with a corresponding value from the global histogram match map when a difference between the value in the specified local histogram match map and the corresponding value from the global histogram match map exceeds a threshold.

6. The method of claim 1 , wherein generating the image of the scene comprises:

modifying the first image frame based on the local histogram match maps to produce a histogram-matched first image frame;

generating a motion map based on the histogram-matched first image frame; and

blending the first image frame and the second image frame using the motion map to produce the image of the scene.

7. The method of claim 1 , further comprising:

aligning the first and second image frames, wherein the coarse motion map is generated as part of the aligning of the first and second image frames.

8. An electronic device comprising:

at least one image sensor; and

at least one processor configured to:

obtain multiple image frames of a scene from the at least one image sensor, the multiple image frames including a first image frame and a second image frame captured using different exposures;

exclude pixels in the first and second image frames that are associated with at least a threshold amount of motion based on a coarse motion map;

generate multiple local histogram match maps based on different portions of the first and second image frames containing non-excluded pixels; and

generate an image of the scene using the local histogram match maps.

9. The electronic device of claim 8 , wherein the at least one processor is further configured to:

generate a global histogram match map based on the first image frame and the second image frame; and

modify at least one of the local histogram match maps based on the global histogram match map.

10. The electronic device of claim 9 , wherein, to modify at least one of the local histogram match maps, the at least one processor is configured to:

replace zero values in a specified local histogram match map with corresponding values from the global histogram match map; and

replace non-zero values in the specified local histogram match map with values interpolated between the specified local histogram match map and the global histogram match map.

11. The electronic device of claim 10 , wherein the values interpolated between the specified local histogram match map and the global histogram match map are weighted based on an amount of saturation in a corresponding tile of one of the multiple image frames.

12. The electronic device of claim 9 , wherein, to modify at least one of the local histogram match maps, the at least one processor is configured to:

replace a value in a specified local histogram match map with a corresponding value from the global histogram match map when a difference between the value in the specified local histogram match map and the corresponding value from the global histogram match map exceeds a threshold.

13. The electronic device of claim 8 , wherein, to generate the image of the scene, the at least one processor is configured to:

modify the first image frame based on the local histogram match maps to produce a histogram-matched first image frame;

generate a motion map based on the histogram-matched first image frame; and

blend the first image frame and the second image frame using the motion map to produce the image of the scene.

14. The electronic device of claim 8 , wherein:

the at least one processor is further configured to align the first and second image frames; and

the at least one processor is configured to generate the coarse motion map as part of the aligning of the first and second image frames.

15. A non-transitory machine-readable medium containing instructions that when executed cause at least one processor of an electronic device to:

obtain, using at least one sensor of the electronic device, multiple image frames of a scene, the multiple image frames including a first image frame and a second image frame captured using different exposures;

exclude pixels in the first and second image frames that are associated with at least a threshold amount of motion based on a coarse motion map;

generate multiple local histogram match maps based on different portions of the first and second image frames containing non-excluded pixels; and

generate an image of the scene using the local histogram match maps.

16. The non-transitory machine-readable medium of claim 15 , further containing instructions that when executed cause the at least one processor to:

generate a global histogram match map based on the first image frame and the second image frame; and

modify at least one of the local histogram match maps based on the global histogram match map.

17. The non-transitory machine-readable medium of claim 16 , wherein the instructions that when executed cause the at least one processor to modify at least one of the local histogram match maps comprise:

instructions that when executed cause the at least one processor to:

replace zero values in a specified local histogram match map with corresponding values from the global histogram match map; and

replace non-zero values in the specified local histogram match map with values interpolated between the specified local histogram match map and the global histogram match map.

18. The non-transitory machine-readable medium of claim 17 , wherein the values interpolated between the specified local histogram match map and the global histogram match map are weighted based on an amount of saturation in a corresponding tile of one of the multiple image frames.

19. The non-transitory machine-readable medium of claim 16 , wherein the instructions that when executed cause the at least one processor to modify at least one of the local histogram match maps comprise:

instructions that when executed cause the at least one processor to replace a value in a specified local histogram match map with a corresponding value from the global histogram match map when a difference between the value in the specified local histogram match map and the corresponding value from the global histogram match map exceeds a threshold.

20. The non-transitory machine-readable medium of claim 15 , wherein the instructions that when executed cause the at least one processor to generate the image of the scene comprise:

instructions that when executed cause the at least one processor to:

modify the first image frame based on the local histogram match maps to produce a histogram-matched first image frame;

generate a motion map based on the histogram-matched first image frame; and

blend the first image frame and the second image frame using the motion map to produce the image of the scene.

21. The non-transitory machine-readable medium of claim 15 , further containing instructions that when executed cause the at least one processor to align the first and second image frames;

wherein the coarse motion map is generated as part of the aligning of the first and second image frames.