IP Library › Granted Patent US 8,620,100
Granted Patent B2
US 8,620,100 · App. 13/201,439 · Granted Dec 31, 2013

Motion blur device, method and program

Inventors: Kenjiro Miura (Hamamatsu, JP); Kenji Takahashi (Hamamatsu, JP)
Assignee: National University Corporation Shizuoka University
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,620,100
App. No.
13/201,439
Granted
Dec 31, 2013
Kind
B2
Abstract

A motion blur control device uses inter-frame movement computation means to compute an inter-frame movement direction and an inter-frame movement amount from plural frame images acquired at a specific time interval. Motion blur correction means then generates a corrected frame image by correcting motion blur in a specific frame image in plural frame images based on the blur amount set within a range not exceeding the inter-frame movement amount and based on the inter-frame movement direction. Evaluation means evaluates the corrected frame image using a motion blur evaluation function. The motion blur control device controls the blur amount such that the motion blur evaluation function satisfies a specific condition.

Claims (216)

1. A motion blur control device for controlling motion blur in a specific frame image among a plurality of frame images acquired during a specific time interval, the motion blur control device comprising:

a image processing device having a processor circuit and configured to,

perform an inter-frame movement computation for computing an inter-frame movement direction and an inter-frame movement amount from the plurality of frame images acquired during the specific time interval,

perform a motion blur correction for generating a corrected frame image by correcting motion blur in the specific frame image based on a blur amount set in a range not exceeding the inter-frame movement amount and based on the inter-frame movement direction, and

perform an evaluation for evaluating the corrected frame image using a motion blur evaluation function, wherein the motion blur evaluation function includes a third order differential of the corrected frame image, wherein the blur amount is adjustable using the evaluation during blur correction such that the motion blur evaluation function satisfies a specific condition.

2. The motion blur control device of claim 1 , wherein the image processing device is configured such that the motion blur correction is to perform:

an unsharp mask setting for setting an unsharp mask based on the blur amount set in the range not exceeding the inter-frame movement amount and based on the inter-frame movement direction; and

an unsharp processing for generating the corrected frame image by correcting motion blur in the specific frame image based on the unsharp mask.

3. The motion blur control device of claim 1 , wherein the image processing device is configured such that the motion blur correction generates the corrected frame image by correcting motion blur in the specific frame image by performing deconvolution computation based on the blur amount set in the range not exceeding the inter-frame movement amount and based on the inter-frame movement direction.

4. The motion blur control device of claim 1 , wherein the image processing device is configured such that the inter-frame movement computation estimates global motion between the plurality of frame images and computes the inter-frame movement direction and the inter-frame movement amount based on affine transform parameters including a parallel movement amount and a rotation movement amount.

5. The motion blur control device of claim 4 , wherein the affine transform parameters further include an image enlargement-reduction ratio.

6. The motion blur control device of claim 1 , wherein the plurality of frame images are frame images that are components of a video image.

7. The motion blur control device of claim 1 , wherein the blur amount is changed, correction is repeatedly performed by the motion blur correction, and evaluation is repeatedly performed by the evaluation, until the motion blur evaluation function satisfies the specific condition, thereby reducing the motion blur of the specific frame image.

8. The motion blur control device of claim 7 , wherein correction is repeatedly performed by the motion blur correction and evaluation is repeatedly performed by the evaluation, until the motion blur evaluation function is a maximum value or a minimum value.

9. The motion blur control device of claim 1 , wherein the motion blur evaluation function (E) is given by the following equation:

⁢

[

Equation

⁢

⁢

⁢

1

]

E

=

∑

x

⁢

∑

y

⁢

(

(

(

I

⁡

(

x

+

2

,

y

)

-

I

⁡

(

x

+

1

,

y

)

)

-

(

I

⁡

(

x

+

1

,

y

)

-

I

⁡

(

x

,

y

)

)

)

-

(

(

I

⁡

(

x

+

1

,

y

)

-

I

⁡

(

x

,

y

)

)

-

(

I

⁡

(

x

,

y

)

-

I

⁡

(

x

-

1

,

y

)

)

)

×

(

(

I

⁡

(

x

,

y

+

2

)

-

I

⁡

(

x

,

y

+

1

)

)

-

(

I

⁡

(

x

,

y

+

1

)

-

I

⁡

(

x

,

y

)

)

)

-

(

(

I

⁡

(

x

,

y

+

1

)

-

I

⁡

(

x

,

y

)

)

-

(

I

⁡

(

x

,

y

)

-

I

⁡

(

x

,

y

-

1

)

)

)

)

wherein I (x,y) is a pixel value at coordinate (x,y) in an image subject to evaluation.

10. A motion blur control method for controlling motion blur of a specific frame image among a plurality of frame images acquired during a specific time interval, the motion blur control method comprising:

computing an inter-frame movement direction and an inter-frame movement amount from the plurality of frame images acquired during the specific time interval;

generating a corrected frame image by correcting motion blur in the specific frame image based on a blur amount set in a range not exceeding the inter-frame movement amount and based on the inter-frame movement direction; and

evaluating the corrected frame image using a motion blur evaluation function, wherein the motion blur evaluation function includes a third order differential of the corrected frame image, and wherein the blur amount is adjustable during blur correction such that the motion blur evaluation function satisfies a specific condition.

11. A non-transitory computer-readable storage medium having stored thereon a set of instructions, executable by a processor, for controlling motion blur of a specific frame image among a plurality of frame images acquired during a specific time interval, the instructions comprising:

instructions for performing an inter-frame movement computation for computing an inter-frame movement direction and an inter-frame movement amount from the plurality of frame images acquired during the specific time interval;

instructions for performing a motion blur correction for generating a corrected frame image by correcting motion blur in the specific frame image based on a blur amount set in a range not exceeding the inter-frame movement amount and based on the inter-frame movement direction; and

instructions for performing an evaluation for evaluating the corrected frame image using a motion blur evaluation function, wherein the motion blur evaluation function includes a third order differential of the corrected frame image, and wherein the blur amount is adjustable during blur correction such that the motion blur evaluation function satisfies a specific condition.

12. The motion blur control device of claim 1 , wherein the motion blur evaluation function evaluates a sharpness of the corrected frame image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 12, 2011
From: MIURA, KENJIRO; TAKAHASHI, KENJI
To: NATIONAL UNIVERSITY CORPORATION SHIZUOKA UNIVERSITY
Reel/Frame 026745/0941 →
Priority Claims (1)
JP 2009-031418 · Feb 13, 2009 · national
Continuity (1)
Related Publication 20110299793A1 · Dec 8, 2011