IP Library Granted Patent US 8,750,643
Granted Patent B2
US 8,750,643 · App. 13/850,213 · Granted Jun 10, 2014

Removing blur from an image

Inventors: Jian Sun (Beiijing, CN); Heung-Yeung Shum (Beiijing, CN); Lu Yuan (Hong Kong, CN); Long Quan (Hong Kong, CN)
Assignee: Microsoft Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,750,643
App. No.
13/850,213
Granted
Jun 10, 2014
Kind
B2
Abstract

Embodiments related to the removal of blur from an image are disclosed. One disclosed embodiment provides a method of performing an iterative non-blind deconvolution of a blurred image to form an updated image. The method comprises downsampling the blurred image to form a blurred image pyramid comprising images of two or more different resolution scales, downsampling a blur kernel to form a blur kernel pyramid comprising kernels of two or more different sizes, and deconvoluting a selected image in the blurred image pyramid according to a Richardson-Lucy deconvolution process in which a bilateral range/spatial filter is employed.

Claims (55)

1. On a computing device, a method of deconvoluting a blurred image via a non-blind deconvolution, the method comprising:

iteratively downsampling the blurred image to form a blurred image pyramid comprising images of a plurality of different resolution scales;

at a lower resolution scale in the blurred image pyramid, deconvoluting a lower resolution image according to a Bilateral Richardson-Lucy (BRL) deconvolution process in which a bilateral range/spatial filter is employed to form a lower resolution deconvoluted image;

upsampling the lower resolution deconvoluted image to form an upsampled image; and

at a higher resolution scale in the blurred image pyramid, deconvoluting a higher resolution image according to the BRL deconvolution process.

2. The method of claim 1 , further comprising employing a filter reliant on an external guide image in addition to the bilateral range/spatial filter.

3. The method of claim 2 , wherein the external guide image comprises a previously deconvoluted image from a same scale in the blurred image pyramid.

4. The method of claim 2 , wherein the external guide image comprises an image that is upsampled from a previously deconvoluted image at a next-lowest resolution scale in the blurred image pyramid.

5. The method of claim 2 , wherein the JBRL deconvolution process proceeds as following:

I

t

+

1

=

I

t

1

+

λ

E

B

(

I

t

)

[

K

*

B

(

I

t

K

)

]

wherein I t+1 is a value of a pixel in the updated image, I t is a value of the pixel in a current image, B is a value of the pixel in the original degraded image, K is a blur kernel, K* is an adjoint of K, λ is a regularization strength, and ∇E B comprises the bilateral range/spatial filter and the filter reliant on the external guide image.

6. The method of claim 5 , wherein ∇E B comprises a high pass filter as an additional filter for the BRL deconvolution process in an intra-scale deconvolution at each scale in the blurred image pyramid.

7. On a computing device, a method of deconvoluting an original blurred image to form an updated image, the method comprising:

iteratively downsampling the original blurred image to form a blurred image pyramid comprising i layers of blurred images of progressively lower resolution scales, wherein i=0 is a lowest-resolution scale;

for each resolution scale 0 to i:

performing an inter-scale Bilateral Richardson-Lucy (BRL) deconvolution process in which a bilateral range/spatial filter is employed;

performing one or more intra-scale BRL deconvolution processes in which the bilateral range/spatial filter is employed to form an intra-scale deconvoluted image; and

upsampling the intra-scale deconvoluted image.

8. The method of claim 7 , further comprising, for scales 1-n, employing an additional filter reliant on an external guide image.

9. The method of claim 8 , wherein the external guide image comprises an image upsampled from a next-lowest resolution scale after deconvolution at the next-lowest resolution scale.

10. The method of claim 8 , wherein the external guide image comprises a previously-deconvoluted image from a same resolution scale.

11. The method of claim 7 , wherein upsampling the intra-scale deconvoluted image comprises performing a bicubic or bilinear interpolation to form an intermediate upscaled image.

12. The method of claim 7 , further comprising employing a high pass filter as an additional filter for one or more intra-scale BRL deconvolution processes.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2016
From: MICROSOFT TECHNOLOGY LICENSING, LLC
To: ZHIGU HOLDINGS LIMITED
Reel/Frame 040354/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0541 →
Continuity (2)
Continuation 12237126 · Sep 24, 2008
Related Publication 20130223754A1 · Aug 29, 2013