Image blur based on 3D depth information
View Patent ↗Blurring is simulated in post-processing for captured images. A 3D image is received from a 3D camera, and depth information in the 3D image is used to determine the relative distances of objects in the image. One object is chosen as the subject of the image, and an additional object in the image is identified. Image blur is applied to the identified additional object based on the distance between the 3D camera and the subject object, the distance between the subject object and the additional object, and a virtual focal length and virtual f-number.
1. A method for applying image blur based on depth information, comprising:
receiving a 3D image captured by a 3D camera, the 3D image including capture of an object and including the depth information for the object, the object located at an object distance from the 3D camera when captured within the 3D image;
identifying a focus distance of a focal plane for the 3D image;
identifying a blur distance between the focal plane and the object, the blur distance comprising a difference between the object distance and the focus distance, the object distance determined based on the depth information;
calculating a blur factor for the object based on the blur distance, wherein:
based on the object distance being less than the focus distance, a first blur factor is calculated based on a given value of the blur distance;
based on the object distance being greater than the focus distance, a second blur factor is calculated based on the given value of the blur distance, the first blur factor being greater than the second blur factor; and
generating a blurred image by blurring a portion of the 3D image including the object by the blur factor such that the portion of the 3D image is blurred based on the object distance between the 3D camera and the object when the 3D image was captured.
2. The method of claim 1 , wherein the 3D image comprises a first image and a second image, the first image captured by a first camera and the second image captured by a second camera, the first camera and the second camera separated by a separation distance and pointed in a same direction.
3. The method of claim 2 , wherein the object distance is determined based on an offset between the object's position in the first image and the object's position in the second image.
4. The method of claim 1 , wherein the object distance comprises parallax information for the object.
5. The method of claim 1 , wherein the object is selected by a user from a plurality of objects included in the 3D image.
6. The method of claim 1 , wherein the focal plane is selected by a user.
7. The method of claim 1 , wherein blurring the portion of the 3D image including the object comprises:
generating an image layer comprising an object region associated with the object and a transparent region;
generating a blur spot, a size of the blur spot based on a size of the object region;
convolving the blur spot with the image layer, the convolution operation generating a blurred image layer, the blurred image layer comprising a blurred object region and the transparent region; and
applying a transparency function to a boundary between the blurred object region and the transparent region.
8. A system for applying image blur based on depth information, comprising:
a non-transitory computer-readable storage medium storing executable computer instructions that, when executed by a processor, perform steps comprising:
receiving a 3D image captured by a 3D camera, the 3D image including capture of an object and including the depth information for the object, the object located at an object distance from the 3D camera when captured within the 3D image;
identifying a focus distance of a focal plane for the 3D image;
identifying a blur distance between the focal plane and the object, the blur distance comprising a difference between the object distance and the focus distance, the object distance determined based on the depth information;
calculating a blur factor for the object based on the blur distance, wherein:
based on the object distance being less than the focus distance, a first blur factor is calculated based on a given value of the blur distance;
based on the object distance being greater than the focus distance, a second blur factor is calculated based on the given value of the blur distance, the first blur factor being greater than the second blur factor; and
generating a blurred image by blurring a portion of the 3D image including the object by the blur factor such that the portion of the 3D image is blurred based on the object distance between the 3D camera and the object when the 3D image was captured; and
a processor configured to execute the instructions.
9. The system of claim 8 , wherein the 3D image comprises a first image and a second image, the first image captured by a first camera and the second image captured by a second camera, the first camera and the second camera separated by a separation distance and pointed in a same direction.
10. The system of claim 9 , wherein the object distance is determined based on an offset between the object's position in the first image and the object's position in the second image.
11. The system of claim 8 , wherein the object distance comprises parallax information for the object.
12. The system of claim 8 , wherein the object is selected by a user from a plurality of objects included in the 3D image.
13. The system of claim 8 , wherein the focal plane is selected by a user.
14. The system of claim 8 , wherein blurring the portion of the 3D image including the object comprises:
generating an image layer comprising an object region associated with the object and a transparent region;
generating a blur spot, a size of the blur spot based on a size of the object region;
convolving the blur spot with the image layer, the convolution operation generating a blurred image layer, the blurred image layer comprising a blurred object region and the transparent region; and
applying a transparency function to a boundary between the blurred object region and the transparent region.
15. A non-transitory computer-readable storage medium storing executable computer instructions for applying image blur based on depth information, the instructions configured to, when executed by a processor, perform steps comprising:
receiving a 3D image captured by a 3D camera, the 3D image including capture of an object and including the depth information for the object, the object located at an object distance from the 3D camera when captured within the 3D image;
identifying a focus distance of a focal plane for the 3D image;
identifying a blur distance between the focal plane and the object, the blur distance comprising a difference between the object distance and the focus distance, the object distance determined based on the depth information;
calculating a blur factor for the object based on the blur distance, wherein:
based on the object distance being less than the focus distance, a first blur factor is calculated based on a given value of the blur distance;
based on the object distance being greater than the focus distance, a second blur factor is calculated based on the given value of the blur distance, the first blur factor being greater than the second blur factor; and
generating a blurred image by blurring a portion of the 3D image including the object by the blur factor such that the portion of the 3D image is blurred based on the object distance between the 3D camera and the object when the 3D image was captured.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the 3D image comprises a first image and a second image, the first image captured by a first camera and the second image captured by a second camera, the first camera and the second camera separated by a separation distance and pointed in a same direction.
17. The non-transitory computer-readable storage medium of claim 16 , wherein the object distance is determined based on an offset between the object's position in the first image and the object's position in the second image.
18. The non-transitory computer-readable storage medium of claim 15 , wherein the object distance comprises parallax information for the object.
19. The non-transitory computer-readable storage medium of claim 15 , wherein the object is selected by a user from a plurality of objects included in the 3D image.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the focal plane is selected by a user.
21. The non-transitory computer-readable storage medium of claim 15 , wherein blurring the portion of the 3D image including the object comprises:
generating an image layer comprising an object region associated with the object and a transparent region;
generating a blur spot, a size of the blur spot based on a size of the object region;
convolving the blur spot with the image layer, the convolution operation generating a blurred image layer, the blurred image layer comprising a blurred object region and the transparent region; and
applying a transparency function to a boundary between the blurred object region and the transparent region.