IP Library › Granted Patent US 9,727,585
Granted Patent B2
US 9,727,585 · App. 14/625,262 · Granted Aug 8, 2017

Image processing apparatus and method for controlling the same

Inventor: Tomonori Iida (Tokyo, JP)
Assignee: CANON KABUSHIKI KAISHA
G06F17/30268G06K9/00255G06K9/3241G06K9/46G06T5/50H04N5/23212G06K2209/27G06T2207/10052H04N5/23219H04N5/23229
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,727,585
App. No.
14/625,262
Granted
Aug 8, 2017
Kind
B2
Abstract

An image processing apparatus that processes light field information indicating the intensity distribution of light and incident directions of light, and a method for controlling the same are disclosed. A derivative information analyzing unit 113 analyzes a derivative information that is generated by a derivative information generating unit 112 from light field information, and obtains information representing features of the derivative information. An additional information editing unit 114 generates additional information to be attached to a derivative information, based on the information representing features of the derivative information.

Claims (37)

1. An image processing apparatus for processing light field information indicating an intensity distribution of light and an incident direction of light, the image processing apparatus comprising:

a processor; and

a memory that stores a program executable by the processor;

wherein the program, when executed by the processor, causes the processor to function as:

an image generating unit configured to generate a refocus image from the light field information;

a first obtaining unit configured to obtain a depth of field of the refocus image;

an information generating unit configured to generate first additional information to be attached to the refocus image, based on the depth of field of the refocus image;

an attaching unit configured to attach the first additional information to the refocus image;

a second obtaining unit configured to obtain second additional information, which is provided together with the light field information and includes subject information; and

a distance calculating unit configured to determine a subject distance with regard to each piece of subject information included in the second additional information, from the light field information and the second additional information,

wherein the information generating unit generates the first additional information by extracting subject information, of which subject distance determined by the distance calculating unit is included in the depth of field, from among pieces of subject information included in the second additional information.

2. The image processing apparatus according to claim 1 ,

wherein the distance calculating unit includes:

a distance map generating unit configured to generate a distance map representing a distribution of subject distances in an imaging range of the light field information, from the light field information; and

a calculating unit configured to determine the subject distance, from position information on a subject included in subject information included in the second additional information and the distance map.

3. The image processing apparatus according to claim 1 , wherein the second additional information is provided as tag information of the light field information.

4. The image processing apparatus according to claim 1 , wherein the refocus image is an image in which any one of subject distances is focused.

5. The image processing apparatus according to claim 1 , wherein the refocus image is an image to which corresponding light field information has a smaller range in which a subject distance is focusable than the light field information.

6. The image processing apparatus according to claim 1 ,

wherein the information representing the feature of the refocus image is a depth of field of the refocus image, and

wherein the obtaining unit obtains the depth of field of the refocus image based on a focus distance used when the refocus image is generated, a focal distance and an aperture value of a lens when the light field information is generated.

7. A method for controlling an image processing apparatus for processing light field information indicating an intensity distribution of light and an incident direction of light, the method comprising:

generating a refocus image from the light field information;

obtaining a depth of field of the refocus image;

generating first additional information to be attached to the refocus image, based on the depth of field of the refocus image;

attaching the first additional information to the refocus image;

obtaining second additional information, which is provided together with the light field information and includes subject information; and

determining a subject distance with regard to each piece of subject information included in the second additional information, from the light field information and the second additional information,

wherein the first additional information is generated by extracting subject information, of which subject distance determined in the determining is included in the depth of field, from among pieces of subject information included in the second additional information.

8. A non-transitory computer-readable recording medium that stores a program for causing a computer to function as an image processing apparatus for processing light field information indicating an intensity distribution of light and an incident direction of light, comprising:

an image generating unit configured to generate a refocus image from the light field information;

a first obtaining unit configured to obtain a depth of field of the refocus image;

an information generating unit configured to generate first additional information to be attached to the refocus image, based on the depth of field of the refocus image;

an attaching unit configured to attach the first additional information to the refocus image;

a second obtaining unit configured to obtain second additional information, which is provided together with the light field information and includes subject information; and

a distance calculating unit configured to determine a subject distance with regard to each piece of information included in the second additional information, from the field information and the second additional information,

wherein the information generating unit generates the first additional information by extracting subject information, of which subject distance determined by the distance calculating unit is included in the depth of field, from among pieces of subject information included in the second additional information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2015
From: IIDA, TOMONORI
To: CANON KABUSHIKI KAISHA
Reel/Frame 035975/0418 →
Priority Claims (1)
JP 2014-029962 · Feb 19, 2014 · national
Continuity (1)
Related Publication 20150234865A1 · Aug 20, 2015