IP Library › Granted Patent US 11,398,024
Granted Patent B2
US 11,398,024 · App. 16/676,571 · Granted Jul 26, 2022

Information processing apparatus, information processing method, and non-transitory storage medium

Inventors: Junichi Fukuda (Tokyo, JP); Ryosuke Nakamura (Tokyo, JP); Yasushi Hamada (Tokyo, JP)
Assignee: NEC CORPORATION
G06T7/0012G06K9/6215G06T11/60G06T19/20G06V40/172G06T2207/30201G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,398,024
App. No.
16/676,571
Granted
Jul 26, 2022
Kind
B2
Abstract

An information processing apparatus according to the invention includes: an acquisition unit that acquires a two-dimensional image of a person and a three-dimensional registered image of a registrant; and a generation unit that, when superimposing the two-dimensional image and the three-dimensional registered image to generate a composite image, performs an editing process for changing an appearance of the person or the registrant for at least one of the two-dimensional image, the three-dimensional registered image, and the composite image.

Claims (37)

1. An information processing apparatus comprising:

at least one memory configured to store instructions; and

a processor configured to execute the instructions to:

identify an orientation of a target person in a two-dimensional image;

identify a matching mode as a two-dimensional matching mode or a three-dimensional matching mode based on the orientation;

acquire a plurality of similarity degrees by matching the two-dimensional image of the target person with registered images of a plurality of registrants in accordance with the identified matching mode, wherein the registered images are three-dimensional registered images or two-dimensional registered images;

extract a plurality of candidates from the plurality of registrants based on the plurality of acquired similarity degrees;

generate display information for displaying a list of registered images of the plurality of candidates in an order of the plurality of similarity degrees;

combine the two-dimensional image and a registered image of a candidate selected from the list by a user operation to generate a composite image; and

perform an editing process for changing at least one of a first appearance of the target person in the two-dimensional image and a second appearance of the candidate in the registered image to generate the composite image.

2. The information processing apparatus according to claim 1 , wherein the processor is further configured to detect a difference in the appearance between the two-dimensional image and the three-dimensional registered image and perform the editing process for causing the appearance in one of the images to be closer to the appearance in the other image.

3. The information processing apparatus according to claim 1 , wherein the processor is further configured to perform the editing process on a selected item from a plurality of target items related to the appearance based on a user operation.

4. The information processing apparatus according to claim 1 , wherein the appearance corresponds to at least one of a part, an amount, a shape, and a color of hair growth on a head.

5. The information processing apparatus according to claim 1 , wherein the appearance corresponds to presence or absence of a predetermined attachment on a head.

6. The information processing apparatus according to claim 1 , wherein the appearance corresponds to facial expression.

7. The information processing apparatus according to claim 1 , wherein the appearance is an aging degree of a face.

8. The information processing apparatus according to claim 7 , wherein the processor is further configured to perform the editing process for simulating a change over the years of the aging degree for one of the two-dimensional image and the three-dimensional registered image based on attribute information of the two-dimensional image and the three-dimensional registered image.

9. The information processing apparatus according to claim claim 1 , wherein the processor is further configured to:

acquire the plurality of similarity degrees by matching the two-dimensional image with the two-dimensional registered images when the identified matching mode is the two-dimensional matching mode; and

acquire the plurality of similarity degrees by matching the two-dimensional image with the three-dimensional registered images when the identified matching mode is the three-dimensional matching mode.

10. The information processing apparatus according to claim 9 , wherein the processor is further configured to analyze the two-dimensional image to identify the orientation of the target person.

11. An information processing method comprising:

identifying an orientation of a target person in a two-dimensional image;

identifying a matching mode as a two-dimensional matching mode or a three-dimensional matching mode based on the orientation;

acquiring a plurality of similarity degrees by matching the two-dimensional image of the target person with registered images of a plurality of registrants in accordance with the identified matching mode, wherein the registered images are three-dimensional registered images or two-dimensional registered images;

extracting a plurality of candidates from the plurality of registrants based on the plurality of acquired similarity degrees;

generating display information for displaying a list of registered images of the plurality of candidates in the order of the plurality of similarity degrees;

combining the two-dimensional image and a registered image of a candidate selected from the list by a user operation to generate a composite image; and

performing an editing process for changing at least one of a first appearance of the target person in the two-dimensional image and a second appearance of the candidate in the registered image to generate the composite image.

12. A non-transitory storage medium in which a program is stored, the program being configured to cause a computer to perform:

identifying an orientation of a target person in a two-dimensional image;

identifying a matching mode as a two-dimensional matching mode or a three-dimensional matching mode based on the orientation;

acquiring a plurality of similarity degrees by matching the two-dimensional image of the target person with registered images of a plurality of registrants in accordance with the identified matching mode, wherein the registered images are three-dimensional registered images or two-dimensional registered images;

extracting a plurality of candidates from the plurality of registrants based on the plurality of acquired similarity degrees;

generating display information for displaying a list of registered images of the plurality of candidates in the order of the plurality of similarity degrees;

combining the two-dimensional image and a registered image of a candidate selected from the list by a user operation to generate a composite image; and

performing an editing process for changing at least one of a first appearance of the target person in the two-dimensional image and a second appearance of the candidate in the registered image to generate the composite image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2019
From: FUKUDA, JUNICHI; NAKAMURA, RYOSUKE; HAMADA, YASUSHI
To: NEC CORPORATION
Reel/Frame 050945/0418 →
Priority Claims (1)
JP JP2018-244573 · Dec 27, 2018 · national
Continuity (1)
Related Publication 20200211184A1 · Jul 2, 2020