IP Library › Granted Patent US 10,649,633
Granted Patent B2
US 10,649,633 · App. 15/832,495 · Granted May 12, 2020

Image processing method, image processing apparatus, and non-transitory computer-readable storage medium

Inventors: Shinjiro Hori (Yokohama, JP); Hiroyasu Kunieda (Yokohama, JP); Ryosuke Iguchi (Inagi, JP); Masaaki Obayashi (Kawasaki, JP)
Assignee: Canon Kabushiki Kaisha
G06F3/0483G06K9/46G06T11/60G06F16/583G06Q50/01G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,649,633
App. No.
15/832,495
Granted
May 12, 2020
Kind
B2
Abstract

An image processing method includes performing an object identification process on a plurality of image data, generating layout data on the basis of at least some of the plurality of image data subjected to the identification process and template data, controlling displaying of a layout image on a display on the basis of the layout data, acquiring setting information relating to a priority of a particular object, and extracting a replacement candidate image in response to a request for replacing an image in the displayed layout image. In extracting a replacement candidate image, the replacement candidate image is extracted on the basis of the setting information relating to a priority.

Claims (72)

1. An image processing method executed by at least one processor in an information processing apparatus, the method comprising:

performing an object identification process on a plurality of image data;

acquiring setting information relating to a priority mode;

generating layout data in which at least some of the plurality of image data subjected to the identification process are arranged in template data, wherein, in a case where the priority mode is a first mode, an image including a first object is preferentially arranged, and in a case where the priority mode is a second mode, an image including a second object different from the first object is preferentially arranged;

causing a display to display a layout image on a basis of the layout data;

accepting selection of a replacement target image in the displayed layout image, from a user;

setting an extracting condition based on the priority mode, wherein, in a case where the priority mode is the first mode, an extracting condition for preferentially extracting a replacement candidate image including the first object is set, and in a case where the priority mode is the second mode, an extracting condition for preferentially extracting a replacement candidate image including the second object is set;

extracting a replacement candidate image based on the set extracting condition; and

replacing the selected replacement target image with the replacement candidate image.

2. The image processing method according to claim 1 , further comprising:

assigning, to an image including the particular object, identification information indicating the particular object on a basis of a result of the identification process,

wherein in the extracting a replacement candidate image, the replacement candidate image is extracted on a basis of the setting information relating to the priority and the identification information.

3. The image processing method according to claim 2 , further comprising:

assigning a score based on at least the template data to each of the plurality of image data subjected to the identification process,

wherein in generating layout data, the layout data is generated on a basis of the assigned score, and

wherein in the extracting a replacement candidate image, if a plurality of images extractable on a basis of the setting information relating to a priority and the identification information are present, the replacement candidate image is extracted by further using the assigned score.

4. The image processing method according to claim 1 ,

wherein in the extracting a replacement candidate image, a plurality of the replacement candidate images are extractable on a basis of a plurality of extraction conditions, and

wherein a number of the replacement candidate images extracted on a basis of a second extraction condition varies with the result of extraction of the replacement candidate images based on a first extraction condition.

5. The image processing method according to claim 1 ,

wherein in acquiring setting information, setting information of a priority mode to cause the particular object to preferentially appear is acquired as the setting information relating to a priority.

6. The image processing method according to claim 1 ,

wherein in acquiring setting information, setting information relating to a frequency of appearance of the particular object is acquired as the setting information relating to a priority, and

wherein in the extracting a replacement candidate image, the replacement candidate image is extracted on a basis of the setting information relating to the frequency of appearance of the particular object.

7. The image processing method according to claim 1 ,

wherein a plurality of extracted replacement candidate images are displayed, and

wherein in replacing an image, the selected replacement target image is replaced with an image selected from among the plurality of replacement candidate images by a user.

8. The image processing method according to claim 1 ,

wherein the particular object is a particular individual.

9. The image processing method according to claim 1 ,

wherein the object is one of categories into which individuals are classified.

10. A non-transitory computer-readable storage medium storing a computer program causing a computer to perform an image processing method comprising:

performing an object identification process on a plurality of image data;

acquiring setting information relating to a priority mode;

generating layout data in which at least some of the plurality of image data subjected to the identification process are arranged in template data, wherein, in a case where the priority mode is a first mode, an image including a first object is preferentially arranged, and in a case where the priority mode is a second mode, an image including a second object different from the first object is preferentially arranged;

causing a display to display a layout image on a basis of the layout data;

accepting selection of a replacement target image in the displayed layout image, from a user;

setting an extracting condition based on the priority mode, wherein, in a case where the priority mode is the first mode, an extracting condition for preferentially extracting a replacement candidate image including the first object is set, and in a case where the priority mode is the second mode, an extracting condition for preferentially extracting a replacement candidate image including the second object is set;

extracting a replacement candidate image based on the set extracting condition; and

replacing the selected replacement target image with the replacement candidate image.

11. An image processing apparatus comprising:

an identification unit configured to perform an object identification process on a plurality of image data;

an acquiring unit configured to acquire setting information relating to a priority mode;

a generation unit configured to generate layout data in which at least some of the plurality of image data subjected to the identification process performed by the identification unit are arranged in template data, wherein, in a case where the priority mode is a first mode, an image including a first object is preferentially arranged, and in a case where the priority mode is a second mode, an image including a second object different from the first object is preferentially arranged;

a display control unit configured to cause a display to display a layout image on a basis of the layout data;

an acceptance unit configured to accept selection of a replacement target image in the displayed layout image, from a user;

a setting unit configured to set an extracting condition based on the priority mode, wherein, in a case where the priority mode is the first mode, an extracting condition for preferentially extracting a replacement candidate image including the first object is set, and in a case where the priority mode is the second mode, an extracting condition for preferentially extracting a replacement candidate image including the second object is set;

an extraction unit configured to extract a replacement candidate image based on the set extracting condition; and

a replacement unit configured to replace the selected replacement target image with the replacement candidate image.

12. The image processing apparatus according to claim 11 , further comprising:

an assigning unit configured to assign, to an image including the particular object, identification information indicating the particular object on a basis of a result of the identification process,

wherein the extraction unit extracts the replacement candidate image on a basis of the setting information relating to a priority and the identification information.

13. The image processing apparatus according to claim 12 , further comprising:

a scoring unit configured to assign a score based on at least the template data to each of the plurality of image data subjected to the identification process,

wherein the generation unit generates the layout data on a basis of the score assigned by the scoring unit, and

wherein if a plurality of images extractable on a basis of the setting information relating to a priority and the identification information are present, the extraction unit extracts the replacement candidate image by further using the score assigned by the scoring unit.

14. The image processing apparatus according to claim 11 ,

wherein the extraction unit is capable of extracting a plurality of the replacement candidate images on a basis of a plurality of extraction conditions, and

wherein a number of the replacement candidate images extracted on a basis of a second extraction condition varies with the result of extraction of the replacement candidate images based on a first extraction condition.

15. The image processing apparatus according to claim 11 ,

wherein the setting acquisition unit acquires, as the setting information relating to a priority, setting information of a priority mode to cause the particular object to preferentially appear.

16. The image processing apparatus according to claim 11 ,

wherein the setting acquisition unit receives, as the setting information relating to a priority, setting information relating to a frequency of appearance of the particular object, and

wherein the extraction unit extracts the replacement candidate image on a basis of the setting information relating to the frequency of appearance of the particular object.

17. The image processing apparatus according to claim 11 , further comprising:

a replacement unit configured to replace an image,

wherein the display control unit displays the plurality of replacement candidate images extracted by the extraction unit, and

wherein the replacement unit replaces an image to be replaced in the layout image with an image selected from among the plurality of replacement candidate images by a user.

18. The image processing apparatus according to claim 11 ,

wherein the particular object is a particular individual.

19. The image processing apparatus according to claim 11 ,

wherein the object is one of categories into which individuals are classified.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2018
From: HORI, SHINJIRO; KUNIEDA, HIROYASU; IGUCHI, RYOSUKE; OBAYASHI, MASAAKI
To: CANON KABUSHIKI KAISHA
Reel/Frame 045474/0443 →
Priority Claims (1)
JP 2016-239739 · Dec 9, 2016 · national
Continuity (1)
Related Publication 20180164964A1 · Jun 14, 2018