Dynamic range extension to produce high dynamic range images
Described are examples for generating a high dynamic range image from a plurality of images. A plurality of images of a real world scene can be obtained from one or more image sensors, wherein at least two of the plurality of images are captured based on different intensity parameters. Intensity information for the real world scene can be determined based at least in part on processing the at least two of the plurality of images. A high dynamic range image corresponding to the real world scene can be generated based at least in part on adding the intensity information to pixels of at least one of the plurality of images.
1. A method for generating a high dynamic range image from a plurality of images, comprising:
obtaining, via one or more image sensors, the plurality of images of a real world scene, wherein at least two of the plurality of images are captured at a first bit depth and based on different intensity parameters, and wherein the at least two of the plurality of images are captured as standard dynamic range images;
determining light intensity information for the real world scene based at least in part on processing the at least two of the plurality of images; and
generating the high dynamic range image corresponding to the real world scene, at a second bit depth that is larger than the first bit depth, based at least in part on adding the light intensity information in additional bits added by the second bit depth to pixels of at least one of the plurality of images captured at the first bit depth.
2. The method of claim 1 , wherein obtaining the plurality of images comprises obtaining multiple frames of the real world scene captured based on the different intensity parameters.
3. The method of claim 2 , wherein the multiple frames of the real world scene correspond to multiple sequential frames.
4. The method of claim 2 , wherein the multiple frames of the real world scene include at least a first frame obtained from one of the one or more image sensors and a second frame obtained from another one of the one or more image sensors at a similar time.
5. The method of claim 1 , wherein obtaining the plurality of images comprises obtaining interleaved pixels of the real world scene based on the different intensity parameters.
6. The method of claim 1 , wherein the different intensity parameters correspond to at least one of different photon sensitivities, different light intensities, or differing exposures.
7. The method of claim 6 , wherein the at least one of different photon sensitivities or different light intensities correspond to at least one of different exposure parameters, international standards organization (ISO) speeds, analog gains, or digital gains.
8. The method of claim 1 , wherein generating the high dynamic range image comprises globally aligning the plurality of images, mapping pixel values from the plurality of images to a linear light intensity scale, and blending values of the linear light intensity scale for each of the pixel values.
9. The method of claim 1 , wherein the light intensity information includes a linear light intensity scale value determined for each of one or more pixels of the plurality of images.
10. A device for generating a high dynamic range image from a plurality of images, comprising:
one or more image sensors configured to obtain the plurality of images of a real world scene, wherein at least two of the plurality of images are captured at a first bit depth and based on different intensity parameters, and wherein the at least two of the plurality of images are captured as standard dynamic range images;
a memory for storing one or more parameters or instructions for generating the high dynamic range image from the plurality of images; and
at least one processor coupled to the memory, wherein the at least one processor is configured to:
determine light intensity information for the real world scene based at least in part on processing the at least two of the plurality of images; and
generate the high dynamic range image corresponding to the real world scene, at a second bit depth that is larger than the first bit depth, based at least in part on adding the light intensity information in additional bits added by the second bit depth to pixels of at least one of the plurality of images captured at the first bit depth.
11. The device of claim 10 , wherein the one or more image sensors obtain the plurality of images as multiple frames of the real world scene based on the different intensity parameters.
12. The device of claim 11 , wherein the multiple frames of the real world scene correspond to multiple sequential frames.
13. The device of claim 11 , wherein the multiple frames of the real world scene include at least a first frame obtained from one of the one or more image sensors and a second frame obtained from another one of the one or more image sensors at a similar time.
14. The device of claim 10 , wherein the one or more image sensors obtain the plurality of images as interleaved pixels of the real world scene based on the different intensity parameters.
15. The device of claim 10 , wherein the different intensity parameters correspond to at least one of different photon sensitivities or different light intensities.
16. The system of claim 10 , wherein the at least one processor is configured to generate the high dynamic range image at least in part by globally aligning the plurality of images, mapping pixel values from the plurality of images to a linear light intensity scale, and blending values of the linear light intensity scale for each of the pixel values.
17. A non-transitory computer-readable medium, comprising code executable by one or more processors for generating a high dynamic range image from a plurality of images, the code comprising code for:
obtaining, via one or more image sensors, the plurality of images of a real world scene, wherein at least two of the plurality of images are captured at a first bit depth and based on different intensity parameters, and wherein the at least two of the plurality of images are captured as standard dynamic range images;
determining light intensity information for the real world scene based at least in part on processing the at least two of the plurality of images; and
generating the high dynamic range image corresponding to the real world scene, at a second bit depth that is larger than the first bit depth, based at least in part on adding the light intensity information in additional bits added by the second bit depth to pixels of at least one of the plurality of images captured at the first bit depth.
18. The non-transitory computer-readable medium of claim 17 , wherein the code for obtaining the plurality of images comprises code for obtaining multiple frames of the real world scene based on the different intensity parameters.
19. The non-transitory computer-readable medium of claim 18 , wherein the multiple frames of the real world scene correspond to multiple sequential frames.
20. The non-transitory computer-readable medium of claim 18 , wherein the multiple frames of the real world scene include at least a first frame obtained from one of the one or more image sensors and a second frame obtained from another one of the one or more image sensors at a similar time.