IP Library Granted Patent US 8,989,517
Granted Patent B2
US 8,989,517 · App. 14/079,481 · Granted Mar 24, 2015

Bokeh amplification

Inventors: David Peter Morgan-Mar (Wollstonecraft, AU); Kieran Gerard Larkin (Putney, AU); Matthew Raphael Arnison (Umina Beach, AU)
Assignee: Canon Kabushiki Kaisha
H04N5/23212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,989,517
App. No.
14/079,481
Granted
Mar 24, 2015
Kind
B2
Abstract

A method of modifying the blur in at least a part of an image of a scene captures at least two images of the scene with different camera parameters to produce a different amount of blur in each image. A corresponding patch in each of the captured images is selected each having an initial amount of blur is used to calculate a set of frequency domain pixel values from a function of transforms of the patches. Each of the pixel values in the set are raised to a predetermined power, forming an amplified set of frequency domain pixel values. The amplified set of frequency domain pixel values is combined with the pixels of the patch in one of the captured images to produce an output image patch with blur modified relative to the initial amount of blur in the image patch.

Claims (45)

1. A method of modifying blur in at least a part of an image of a scene, said method comprising:

capturing at least two images of the scene, said images being captured with different camera parameters to produce a different amount of blur in each of the captured images;

selecting a corresponding image patch in each of the captured images, each of the selected image patches having an initial amount of blur;

calculating a set of frequency domain pixel values from a combined function of Fourier transforms of two of the selected image patches;

raising each of the pixel values in the set of frequency domain pixel values to a predetermined power, thereby forming an amplified set of frequency domain pixel values; and

combining the amplified set of frequency domain pixel values with the pixels of the selected image patch in one of the captured images to produce an output image patch with blur modified with respect to the initial amount of blur in the image patch, wherein the amount of modification with respect to blur varies across different regions of the image patch.

2. A method according to claim 1 , wherein the set of frequency domain pixel values are modified before being raised to the predetermined power.

3. A method according to claim 2 , wherein the modification includes a median filtering operation.

4. A method according to claim 2 , wherein the modification includes a smoothing filtering operation.

5. A method according to claim 2 , wherein the modification includes a normalisation operation.

6. A method according to claim 2 , wherein the modification includes a weighting operation.

7. A method according to claim 6 , wherein weights for the weighting operation are determined by the phases of the set of frequency domain pixel values.

8. A method according to claim 1 , wherein:

the at least two images of the scene are divided into a plurality of corresponding image patches in each of the captured images; and

the output image patches are combined to produce an output image.

9. A method according to claim 8 , wherein the plurality of corresponding image patches in each of the captured images form a tiling substantially covering the area of the captured images, and the output image is formed by tiling the output image patches.

10. A method according to claim 8 , wherein the plurality of corresponding image patches in each of the captured images overlap, and the output image is formed by combining the pixel values of the output image patches.

11. A method according to claim 8 , wherein:

the plurality of corresponding image patches in each of the captured images cover part of the area of the captured images; and

the output image patches are combined with the area of at least one of the captured images not covered by the plurality of corresponding image patches to produce an output image.

12. A method according to claim 11 , wherein at least part of the area of the at least one of the captured images not covered by the plurality of corresponding image patches is blurred by convolution with a blur kernel.

13. A camera comprising an image capture system coupled to memory in which captured images are stored, a processor, and a program executable by the processor to modify blur in at least a part of an image of a scene, said program comprising:

code for causing the capture system to capture at least two images of the scene, said images being captured with different camera parameters to produce a different amount of blur in each of the captured images;

code for selecting a corresponding image patch in each of the captured images, each of the selected image patches having an initial amount of blur;

code for calculating a set of frequency domain pixel values from a combined function of Fourier transforms of two of the selected image patches;

code for raising each of the pixel values in the set of frequency domain pixel values to a predetermined power, thereby forming an amplified set of frequency domain pixel values; and

code for combining the amplified set of frequency domain pixel values with the pixels of the selected image patch in one of the captured images to produce an output image patch with blur modified with respect to the initial amount of blur in the image patch, wherein the amount of modification with respect to blur varies across different regions of the image patch.

14. A camera system comprising:

a lens formed of optics producing a relatively large depth of field;

a sensor configured to capture an image of a scene focussed through the lens;

a memory in which images captured by the sensor are stored;

a capture mechanism configured to capture at least two images of the scene with different capture parameters and to store the images in the memory;

a processor;

a program stored in the memory and executable by the processor to modify blur in at least a part of one of the captured images of the scene, said program comprising:

code for causing the capture system to capture at least two images of the scene with different camera parameters to produce a different amount of blur in each of the captured images;

code for selecting a corresponding image patch in each of the captured images, each of the selected image patches having an initial amount of blur;

code for calculating a set of frequency domain pixel values from a combined function of Fourier transforms of two of the selected image patches;

code for raising each of the pixel values in the set of frequency domain pixel values to a predetermined power, thereby forming an amplified set of frequency domain pixel values; and

code for combining the amplified set of frequency domain pixel values with the pixels of the selected image patch in one of the captured images to produce an output image patch with blur modified with respect to the initial amount of blur in the image patch, wherein the amount of modification with respect to blur varies across different regions of the image patch.

15. A non-transitory computer readable storage medium having a program recorded thereon, the program being executable by a processor to modify blur in at least a part of an image of a scene, said program comprising:

code for receiving at least two images of the scene, said images being captured with different camera parameters to produce a different amount of blur in each of the captured images;

code for selecting a corresponding image patch in each of the captured images, each of the selected image patches having an initial amount of blur;

code for calculating a set of frequency domain pixel values from a combined function of Fourier transforms of two of the selected image patches;

code for raising each of the pixel values in the set of frequency domain pixel values to a predetermined power, thereby forming an amplified set of frequency domain pixel values; and

code for combining the amplified set of frequency domain pixel values with the pixels of the selected image patch in one of the captured images to produce an output image patch with blur modified with respect to the initial amount of blur in the image patch, wherein the amount of modification with respect to blur varies across different regions of the image patch.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2013
From: MORGAN-MAR, DAVID PETER; LARKIN, KIERAN GERARD; ARNISON, MATTHEW RAPHAEL
To: CANON KABUSHIKI KAISHA
Reel/Frame 031635/0691 →
Priority Claims (1)
AU 2012258467 · Dec 3, 2012 · national
Continuity (1)
Related Publication 20140152886A1 · Jun 5, 2014