IP Library › Granted Patent US 9,270,902
Granted Patent B2
US 9,270,902 · App. 14/195,951 · Granted Feb 23, 2016

Image processing apparatus, image capturing apparatus, image processing method, and storage medium for obtaining information on focus control of a subject

Inventors: Kazuhiro Watanabe (Tokyo, JP); Osamu Sakata (Yokohama, JP); Keita Takatani (Yokohama, JP); Wataru Kaku (Yokohama, JP)
Assignee: CANON KABUSHIKI KAISHA
H04N5/272H04N5/142H04N5/23212H04N5/23232H04N5/23293H04N5/265H04N5/2624H04N5/2628G01S17/08H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,270,902
App. No.
14/195,951
Granted
Feb 23, 2016
Kind
B2
Abstract

Conventionally, on a subject in which range, refocus can be performed at the time of image capturing or at the time of editing an image is not specified clearly, and therefore, it is difficult for a user to capture an image or to edit an image in a manner the user intends. An image processing apparatus has an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas and a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information.

Claims (44)

1. An image processing apparatus comprising:

an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas; and

a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information,

wherein the generation unit combines an index indicative of at least one of a focus position and a depth of field in an image acquired by the acquisition unit with the shifted image.

2. The image processing apparatus according to claim 1 , further comprising:

a reception unit configured to receive a user's operation; and

a change unit configured to generate an image acquired by the acquisition unit in which a focus state is changed in response to the user's operation.

3. The image processing apparatus according to claim 2 , wherein the acquisition unit further acquires light field data corresponding to the image including a plurality of subject areas, and the change unit generates the image acquired by the acquisition unit in which the focus state is changed from the light field data.

4. The image processing apparatus according to claim 1 , further comprising an extraction unit configured to extract the plurality of subject areas based on the distance information corresponding to the plurality of subject areas,

wherein the generation unit generates the shifted image based on subject areas extracted by the extraction unit.

5. The image processing apparatus according to claim 1 , further comprising a unit configured to combine a lattice pattern based on a shift direction of the plurality of subject areas in the shifted image with the shifted image.

6. An image capturing apparatus having the image processing apparatus according to claim 1 , the image capturing apparatus comprising:

a display unit configured to display an image with which the index is combined; and

a unit configured to adjust a focus and a depth of field in accordance with a user's operation based on the index in the image with which the index is combined.

7. An image capturing apparatus having the image processing apparatus according to claim 1 , the image capturing apparatus comprising:

a unit configured to generate an image including the plurality of subject areas from light field data;

a display unit configured to display an image with which the index is combined; and

a unit configured to change a focus distance and a depth of field in an image with which the index is combined using the light field data in response to a user's operation based on the index in the image with which the index is combined.

8. An image processing apparatus comprising:

an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas; and

a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information,

wherein the generation unit generates, using an area forming a background as a reference in the image acquired by the acquisition unit, a shifted image in which positions of the plurality of subject areas are shifted.

9. The image processing apparatus according to claim 8 , wherein the area forming the background is one area including all subjects located farther than a predetermined distance.

10. The image processing apparatus according to claim 8 , further comprising a unit configured to combine a lattice pattern based on a shift direction of the plurality of subject areas in the shifted image with the shifted image, wherein the unit configured to combine a lattice pattern does not combine the lattice pattern with the area forming the background.

11. An image processing apparatus comprising:

an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas; and

a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information,

wherein the generation unit generates the shifted image so that a ratio of an area in which the plurality of subject areas overlaps on one another is smaller than a threshold value in the shifted image.

12. An image processing apparatus comprising:

an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas; and

a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information,

wherein the generation unit generates the shifted image so that the position of a first subject area included in the shifted image is lower than the position of a second subject area, and the second subject area is longer in distance from an image capturing apparatus than the first subject area.

13. An image processing apparatus comprising:

an acquisition unit configured to acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas;

a generation unit configured to generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information; and

a shear processing unit configured to perform shear processing to incline a horizontal direction for each subject area in the shifted image.

14. An image processing method comprising:

acquiring an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas;

generating a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information; and

combining an index indicative of at least one of a focus position and a depth of field in an image acquired in the acquiring step with the shifted image.

15. A non-transitory computer readable storage medium storing a program that, when executed, causes a computer to:

acquire an image including a plurality of subject areas and distance information corresponding to the plurality of subject areas;

generate a shifted image in which positions of the plurality of subject areas are shifted in the image based on the distance information; and

combine an index indicative of at least one of a focus position and a depth of field in the acquired image with the shifted image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 10, 2014
From: WATANABE, KAZUHIRO; SAKATA, OSAMU; TAKATANI, KEITA; KAKU, WATARU; TSUTSUMI, SHOHEI
To: CANON KABUSHIKI KAISHA
Reel/Frame 033124/0367 →
Priority Claims (2)
JP 2013-043264 · Mar 5, 2013 · national
JP 2013-134111 · Jun 26, 2013 · national
Continuity (1)
Related Publication 20140253760A1 · Sep 11, 2014