IP Library › Granted Patent US 9,466,113
Granted Patent B2
US 9,466,113 · App. 14/574,280 · Granted Oct 11, 2016

Post-processed bokeh rendering using asymmetric recursive gaussian filters

Inventor: Quang Tuan Pham (North Ryde, AU)
Assignee: CANON KABUSHIKI KAISHA
G06T7/0051G06K9/52G06K9/6256G06T5/002G06T5/20G06T2207/10028G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,466,113
App. No.
14/574,280
Filed
Dec 17, 2014
Granted
Oct 11, 2016
Kind
B2
Art Unit
2665
USPC
382/154
Abstract

A method of blurring an image using a spatially variable blur is disclosed. The method comprises the steps of: for each pixel of a scan line of pixels in the image: obtaining a measure representative of image depth at the pixel; determining a blur kernel width for the pixel based on the measure representative of image depth at the pixel; and where an increase in the determined blur kernel width with respect to a blur kernel width of a previous pixel in the scan line is detected: determining, from the determined blur kernel width, a tapered blur width adapted to provide an asymmetric filter response for the pixel; and applying the tapered blur width to a filter to output a blurred pixel value for the pixel by using a plurality of filter coefficients determined based on blur width values of one or more previously blurred pixels.

Claims (46)

1. A method of blurring an image using a spatially variable blur, said method comprising the steps of:

for each pixel of a scan line of pixels in the image:

obtaining a measure representative of image depth at the pixel;

determining a blur kernel width for the pixel based on said measure representative of image depth at the pixel; and

where an increase in the determined blur kernel width with respect to a blur kernel width of a previous pixel in the scan line is detected:

determining, from the determined blur kernel width, a tapered blur width adapted to provide an asymmetric filter response for the pixel; and

applying the tapered blur width to a filter to output a blurred pixel value for the pixel by using a plurality of filter coefficients determined based on blur width value of one or more previously blurred pixels.

2. A method according to claim 1 , wherein said blurred pixel value comprises a weighted average of an initial pixel value of the pixel, and an initial value and a blurred value of a previously blurred pixel on the scan line.

3. A method according to claim 1 , wherein the tapered blur width is modified from the blur kernel width to limit the rate of increase of the tapered blur width to a maximum of one third per pixel.

4. A method according to claim 1 , wherein the tapered blur width is modified from the blur kernel width by adding an intensity-dependent offset.

5. A method according to claim 1 , wherein the tapered blur width at a current pixel on the scan line is determined recursively based on the tapered blur width at a previous pixel on the scan line and the blur kernel width at the current pixel.

6. A method according to claim 1 , wherein the plurality of filter coefficients is retrieved from a look-up table for each value of the associated tapered blur width.

7. A method according to claim 1 , wherein the spatially variable blur is applied separably along a horizontal scan line followed by a vertical scan line.

8. A method according to claim 1 , wherein the spatially variable blur is applied separably along a vertical scan line followed by a horizontal scan line.

9. A method according to claim 1 , wherein the spatially variable blur is applied on an inverse tone-mapped image, the result of which is tone-mapped back using a forward tone mapping.

10. A method according to claim 1 , wherein the spatially variable blur is applied on different segmentation layers of an input image, the results of which are blended together to form an output image.

11. A method according to claim 1 , wherein said measure representative of image depth comprises a gradient measure at the pixel.

12. A computer system for blurring an image using a spatially variable blur, said computer system comprising:

a memory unit for storing data and instructions; and

at least one processing unit coupled to said memory unit, said at least one processing unit programmed to:

for each pixel of a scan line of pixels in the image:

obtain a measure representative of image depth at the pixel;

determine a blur kernel width for the pixel based on said measure representative of image depth at the pixel; and

where an increase in the determined blur kernel width with respect to a blur kernel width of a previous pixel in the scan line is detected:

determine, from the determined blur kernel width, a tapered blur width adapted to provide an asymmetric filter response for the pixel; and

apply the tapered blur width to a filter to output a blurred pixel value for the pixel by using a plurality of filter coefficients determined based on blur width value of one or more previously blurred pixels.

13. The computer system of claim 12 , wherein said blurred pixel value comprises a weighted average of an initial pixel value of the pixel, and an initial value and a blurred value of a previously blurred pixel on the scan line.

14. The computer system of claim 12 , wherein the tapered blur width is modified from the blur kernel width to limit the rate of increase of the tapered blur width to a maximum of one third per pixel.

15. The computer system of claim 12 , wherein the tapered blur width is modified from the blur kernel width by adding an intensity-dependent offset.

16. A non-transitory computer readable storage medium having a computer program stored thereon for blurring an image using a spatially variable blur, said computer program comprising code for processing scan lines of pixels in the image and for each pixel in a scan line:

obtaining a measure representative of image depth at the pixel;

determining a blur kernel width for the pixel based on said measure representative of image depth at the pixel; and

where an increase in the determined blur kernel width with respect to a blur kernel width of a previous pixel in the scan line is detected:

determining, from the determined blur kernel width, a tapered blur width adapted to provide an asymmetric filter response for the pixel; and

applying the tapered blur width to a filter to output a blurred pixel value for the pixel by using a plurality of filter coefficients determined based on blur width value of one or more previously blurred pixels.

17. The non-transitory computer readable storage medium of claim 16 , wherein said blurred pixel value comprises a weighted average of an initial pixel value of the pixel, and an initial value and a blurred value of a previously blurred pixel on the scan line.

18. The non-transitory computer readable storage medium of claim 16 , wherein the tapered blur width is one of:

(i) modified from the blur kernel width to limit the rate of increase of the tapered blur width to a maximum of one third per pixel;

(ii) modified from the blur kernel width by adding an intensity-dependent offset; and

(iii) determined, at a current pixel on the scan line, recursively based on the tapered blur width at a previous pixel on the scan line and the blur kernel width at the current pixel.

19. The non-transitory computer readable storage medium of claim 16 , wherein the plurality of filter coefficients is retrieved from a look-up table for each value of the associated tapered blur width.

20. The non-transitory computer readable storage medium of claim 16 , wherein the spatially variable blur is applied by one of:

(i) separably along a horizontal scan line followed by a vertical scan line;

(ii) separably along a vertical scan line followed by a horizontal scan line;

(iii) on an inverse tone-mapped image, the result of which is tone-mapped back using a forward tone mapping; and

(iv) on different segmentation layers of an input image, the results of which are blended together to form an output image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2015
From: PHAM, QUANG TUAN
To: CANON KABUSHIKI KAISHA
Reel/Frame 035365/0174 →
Priority Claims (1)
AU 2013273830 · Dec 23, 2013 · national
Continuity (1)
Related Publication 20150178970A1 · Jun 25, 2015