IP Library Granted Patent US 8,155,467
Granted Patent B2
US 8,155,467 · App. 12/218,355 · Granted Apr 10, 2012

Image data processing method and imaging apparatus

Assignee: Morpho, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,155,467
App. No.
12/218,355
Granted
Apr 10, 2012
Kind
B2
Abstract

An image data processing method for sharpening a captured image; the method defines a first transformation equation to change the pixel values of a defocused image into a focused image using the coordinates of the defocused image and the focused image as arguments, calculates a DetailedFocus function from the optimal solution of the first transformation equation by giving the pixel values of the focused image and the defocused image as educational data, extracts a predetermined number of important points on the DetailedFocus function, defines a second transformation equation to change the pixel values of the important points of a defocused image into a focused image using the coordinates of the defocused image and the focused image as arguments, calculates a SmartFocus function from the second transformation equation, and produces a focused image from a defocused image using the SmartFocus function.

Claims (125)

1. An image data processing method for sharpening a captured image using a focus function produced based on a focused image and a defocused image of a subject, comprising:

defining a first transformation equation that includes a DetailedFocus function, to change the pixel values of a defocused image into the pixel values of a focused image using the coordinates of the defocused image and the coordinates of the focused image as arguments;

calculating a DetailedFocus function as the optimal solution for the first transformation equation by using the pixel values of the focused image and the defocused image as educational data;

performing an important point selection process for extracting a predetermined number of important points on the DetailedFocus function;

defining a second transformation equation that includes a SmartFocus function, to change the pixel values of a defocused image into the pixel values of a focused image based on the important points using the coordinates of the defocused image and the coordinates of the focused image as arguments, after the important point selection process;

calculating a SmartFocus function as the optimal solution for the second transformation equation by using the pixel values of the focused image and the defocused image as educational data; and

producing a focused image from a defocused image captured by an imaging device using the SmartFocus function as said focus function.

2. The image data processing method according to claim 1 ,

wherein the first transformation equation is described as

I

focus

(

x

,

y

)

=

-

m

<=

i

<=

m

-

n

<=

j

<=

n

F

detail

(

i

,

j

)

·

I

defocus

(

x

+

i

,

y

+

j

)

where Fdetail(i, j) is values of the DetailedFocus function, Ifocus(x, y) is focused image pixel values, Idefocus(x+i, y+j) is defocused image pixel values, x and y are integers, and m and n are natural numbers.

3. The image data processing method according to claim 1 ,

wherein the important point selection process comprises the following steps:

(Step 1) selecting 4 corners of the DetailedFocus function as important points;

(Step 2) performing Delaunay triangulation on existing important points;

(Step 3) calculating the predictive focus function values for all points by interpolating from the focus function values of the triangulation apex that the point belongs to;

(Step 4) comparing the predictive focus function value and the actual focus function value for all points, and then add the point with the greatest difference in value as an important point; and

(Step 5) repeating Step 2 to Step 4 until the number of important points is greater than a predetermined value.

4. The image data processing method according to claim 1 ,

wherein the second transformation equation is described as

I

focus

(

x

,

y

)

=

-

m

<=

i

<=

m

-

n

<=

j

<=

n

w

·

F

smart

(

i

,

j

)

·

I

defocus

(

x

+

i

,

y

+

j

)

where Fsmart(i, j) is values of the SmartFocus function, If Fsmart(i, j) is an important point then set w=1, if Fsmart(i, j) is not an important point then set w=0, x and y are integers, and m and n are natural numbers.

5. The image data processing method for sharpening image data that is defocused and blurred from being out of focus and from camera shake, comprising:

capturing multiple images in one shot;

producing a focused image of each of the multiple images using any one of image data processing methods according to claim 1 ; and thereafter

designating one of the focused images as a reference image and calculating the motion data between the reference image and each of other focused images; and

producing a blur compensation image by overlaying the reference image and other focused images using the motion data.

6. The imaging apparatus which possesses the SmartFocus function calculated based on any one of the image data processing methods according to claims 1 to 5 , comprising:

a memory device for storing multiple SmartFocus functions for each different focal distance;

a imaging means for capturing an image; and

a focused image production means for producing focused images using each of the multiple SmartFocus functions to the captured image, selecting one SmartFocus function among the multiple SmartFocus functions depending on the edge or corner values obtained from pixel values of the focused images, and outputting the focused image produced by the selected SmartFocus function as the captured image.

7. The imaging apparatus which possesses the SmartFocus function calculated based on any one of the image data processing methods according to claims 1 to 5 , comprising:

a memory device for storing multiple SmartFocus functions corresponding to coordinates on an image;

an imaging means for capturing an image; and

a focused image production means for producing a focused image by applying one or more SmartFocus functions that correspond to coordinates on the captured image, and outputting the focused image as the captured image.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
SECURITY INTEREST Recorded Jun 29, 2018
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC
Reel/Frame 046486/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2017
From: MORPHO, INC.
To: RPX CORPORATION
Reel/Frame 041052/0708 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 12, 2008
From: HIRAGA, MASAKI; HABUKA, KENSUKE
To: MORPHO, INC.
Reel/Frame 021271/0259 →
Priority Claims (1)
JP 2007-185096 · Jul 13, 2007 · national
Continuity (1)
Related Publication 20090039233A1 · Feb 12, 2009