Depth-based image blurring
Depth information can be used to assist with image processing functionality, such as to generate modified image data including foreground image data and background image data having different amounts of blur. In at least some embodiments, depth information obtained from first image data associated with a first sensor and second image data associated with a second sensor, for example, can be used to determine the foreground object and background object(s) for an image or frame of video. The foreground object then can be located in later frames of video or subsequent images. Small offsets of the foreground object can be determined, and the offset accounted for by adjusting the subsequent frames or images and merging the adjusted subsequent frames or images. Such an approach provides modified image data including a foreground object having a first amount of blur (e.g., a lesser amount of blur) and/or background object(s) having a second amount of blur (e.g., a greater amount of blur), while providing simplified processing and reduced power consumption.
1. A computer-implemented method, comprising:
generating first image data associated with a first sensor;
generating second image data associated with a second sensor;
generating depth information using the first image data and the second image data;
identifying, using the depth information, foreground image data;
identifying, using the depth information, background image data;
generating modified foreground image data by reducing blur in a portion of at the foreground image data; and
generating modified image data using the modified foreground image data and the background image data, the modified image data showing the background image data having a greater amount of blur than the modified foreground image data.
2. The computer-implemented method of claim 1 , further comprising identifying, using the depth information, a background object.
3. The computer-implemented method of claim 1 , further comprising generating merged image data from at least a portion of the first image data and at least a portion of the second image data.
4. The computer-implemented method of claim 3 , further comprising generating the modified image data using at least the merged image data.
5. The computer-implemented method of claim 1 , further comprising:
determining, using at least the first image data and the second image data, disparity information representing at least two objects; and
determining the depth information based at least in part of the disparity information.
6. The computer-implemented method of claim 1 , further comprising:
generating the first image data using frames of video from a first video camera; and
generating the second image data using frames of video from a second video camera.
7. The computer-implemented method of claim 1 , wherein the first sensor and the second sensor are configured as a stereo-image camera pair, the method further comprising:
generating the first image data using a still image from the first sensor; and
generating the second image data using a still image from the second sensor.
8. The computer-implemented method of claim 1 , wherein the second sensor is an infrared (IR) camera, the method further comprising determining the depth information using at least reflected IR represented in the second image data.
9. A computing device, comprising:
at least one processor;
a first sensor;
a second sensor;
a display element; and
non-transitory computer-readable storage medium including instructions that, when executed by the at least one processor, cause the computing device to:
generate first image data associated with the first sensor;
generate second image data associated with the second sensor;
generate depth information using the first image data and the second image data; identify, using the depth information, foreground image data;
identify, using the depth information, background image data;
generate modified foreground image data by reducing blur in a portion of the foreground image data;
generate modified image data using the modified foreground image data and the background image data, the modified image data showing the background image data having a greater amount of blur than the modified foreground image data; and
display, on the display element, the modified image data.
10. The computing device of claim 9 , wherein the first sensor is a first video camera, and the second sensor is a second video camera, the instructions further causing the computing device to:
generate the first image data using frames of video from the first video camera; and
generate the second image data using frames of video from the second video camera.
11. The computing device of claim 9 , wherein the first sensor and the second sensor are configured as a stereo-image camera pair, the instructions further causing the computing device to:
generate the first image data using a still image from the first sensor; and
generate the second image data using a still image from the second sensor.
12. The computing device of claim 9 , wherein the second sensor is an infrared (IR) camera, the instructions further causing the computing device to determine the depth information using at least reflected IR represented in the second image data.
13. The computing device of claim 9 , the instructions further causing the computing device to identify, using the depth information, a background object.
14. The computing device of claim 9 , the instructions further causing the computing device to generate merged image data from at least a portion of the first image data and at least a portion of the second image data.
15. The computing device of claim 14 , the instructions further causing the computing device to generate the modified image data using at least the merged image data.
16. The computing device of claim 9 , the instructions further causing the computing device to:
determine, using at least the first image data and the second image data, disparity information representing at least two objects; and
determine the depth information based at least in part of the disparity information.