High dynamic range processing based on angular rate measurements
Systems and methods are disclosed for high dynamic rate processing based on angular rate measurements. For example, methods may include receiving a short exposure image that was captured using an image sensor; receiving a long exposure image that was captured using the image sensor; receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image; determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.
1. A system comprising:
an image sensor configured to capture images,
an angular rate sensor that is attached to image sensor and configured to measure changes in orientation of the image sensor, and
a processing apparatus configured to:
receive a short exposure image that was captured using the image sensor;
receive a long exposure image that was captured using the image sensor, wherein the long exposure image was captured with a longer exposure time than the short exposure image;
receive an angular rate measurement captured using the angular rate sensor during exposure of the long exposure image; and
determine, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image.
2. The system of claim 1 , in which the processing apparatus is configured to:
responsive to a determination not to apply high dynamic range processing to the image portion, select the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.
3. The system of claim 2 , in which the processing apparatus is configured to:
transmit, store, or display an image based on the output image.
4. The system of claim 1 , in which the processing apparatus is configured to:
responsive to a determination to apply high dynamic range processing to the image portion, apply high dynamic range processing to combine the image portion of the short exposure image with the image portion of the long exposure image based on pixels values in the image portion of the long exposure image.
5. The system of claim 1 , in which the processing apparatus is configured to determine, based on the angular rate measurement, whether to apply high dynamic range processing by performing operations comprising:
determining a blur metric for the image portion based on the angular rate measurement;
comparing the blur metric to a threshold; and
responsive to the blur metric exceeding the threshold, determining not to apply high dynamic range processing to the image portion.
6. The system of claim 5 , in which the threshold depends on an exposure duration of the long exposure image.
7. The system of claim 1 , in which the image portion is a block of one or more pixels that corresponds to less than a whole image.
8. The system of claim 1 , in which the image portion corresponds to a whole image, and the determination of whether to apply high dynamic range processing is for the whole image.
9. The system of claim 1 , in which processing apparatus is attached to the image sensor.
10. A method comprising:
receiving a short exposure image that was captured using an image sensor;
receiving a long exposure image that was captured using the image sensor, wherein the long exposure image was captured with a longer exposure time than the short exposure image;
receiving an angular rate measurement captured using an angular rate sensor attached to the image sensor during exposure of the long exposure image;
determining, based on the angular rate measurement, whether to apply high dynamic range processing to an image portion of the short exposure image and the long exposure image; and
responsive to a determination not to apply high dynamic range processing to the image portion, selecting the image portion of the short exposure image for use as the image portion of an output image and discard the image portion of the long exposure image.
11. The method of claim 10 , in which determining, based on the angular rate measurement, whether to apply high dynamic range processing comprises:
determining a blur metric for the image portion based on the angular rate measurement;
comparing the blur metric to a threshold; and
responsive to the blur metric exceeding the threshold, determining not to apply high dynamic range processing to the image portion.
12. The method of claim 11 , in which the threshold depends on an exposure duration of the long exposure image.
13. The method of claim 10 , in which the image portion corresponds to a whole image, and the determination of whether to apply high dynamic range processing is for the whole image.
14. The method of claim 10 , comprising:
transmitting, storing, or displaying an image based on the output image.
15. A system comprising:
an image sensor configured to capture images,
an angular rate sensor that is attached to image sensor and configured to measure changes in orientation of the image sensor, and
a processing apparatus configured to:
receive a short exposure image that was captured using the image sensor;
receive a long exposure image that was captured using the image sensor, wherein the long exposure image was captured with a longer exposure time than the short exposure image;
receive an angular rate measurement captured using the angular rate sensor during exposure of the long exposure image;
select, based on the angular rate measurement, whether to use an image portion of the short exposure image or the long exposure image; and
determine the image portion of an output image based on the image portion of the selected image.
16. The system of claim 15 , in which the processing apparatus is configured to select, based on the angular rate measurement, whether to use an image portion of the short exposure image or the long exposure image by performing operations comprising:
determining a blur metric for the image portion based on the angular rate measurement;
determining a noise estimate for the image portion of the short exposure image;
comparing the blur metric to the noise estimate; and
based on comparison of the blur metric and the noise estimate, selecting the short exposure image for use in the image portion.
17. The system of claim 16 , in which the noise estimate depends on an exposure duration of the short exposure image and one or more pixel values of the image portion of the short exposure image.
18. The system of claim 15 , in which the image portion is a block of one or more pixels that corresponds to less than a whole image.
19. The system of claim 15 , in which the image portion corresponds to a whole image.
20. The system of claim 15 , in which the processing apparatus is configured to:
transmit, store, or display an image based on the output image.