Matching support apparatus, matching support method, and computer-readable recording medium
A matching support apparatus includes a first display information generation unit that generates first display information for displaying, on the screen of a display device, a first display region for displaying an image including the face of a person targeted for matching captured using an image capturing apparatus, a second display information generation unit that generates second display information for displaying, on the screen of the display device 30 , a second display region for displaying a reference face development image generated based on three-dimensional data of a head serving as a reference, and a user interface display information generation unit that generates first user interface display information for displaying, on the screen of the display device 30 , a second user interface to be used in an operation for enabling a user to designate, in the second display region, a feature region of the person targeted for matching visible on the skin surface of the person targeted for matching.
1. A matching support apparatus comprising:
at least one memory storing instructions; and
at least one processor configured to execute the instructions to:
display, on a screen of a display device, a first display region for displaying a frame image of a still image or a moving image including a face of a person targeted for matching that is captured using an image capturing apparatus;
display, on the screen of the display device, a second display region for displaying a reference face development image created by CG (Computer Graphics) based on data of one or more heads measured or previously captured, on a screen of a display device;
when a facial feature visible is not visible on a skin surface of the person targeted for matching displayed in the first display region, display, on the screen of the display device, a first user interface to be used in an operation for enabling a user to designate, in the second display region, a feature region indicating the facial feature of the person targeted for matching that is visible on a skin surface of the person targeted for matching;
in a case where the feature region designated using the first user interface is matched against matching information in which a matching-use face development image and matching-use feature region for each person of a plurality of persons registered in advance are associated with each other, and in a case where a person of the plurality of persons is selected to serve as a candidate based on a matching result, display, on the screen of the display device, the matching-use face development image corresponding to the selected person together with the matching-use feature region; and
display, on the screen of the display device, a third display region in which a face in a reference face three-dimensional image generated based on three-dimensional data of a reference head is displayed to be oriented in alignment with an orientation of the face of the person targeted for matching displayed in the first display region,
wherein the facial feature of the person is at least any one or more of a mole, a freckle, a tattoo, a birthmark, a wrinkle, a dimple, a scar, a wart, a lump, rough skin, and a discolored skin patch, which is visible on the skin surface of the person.
2. The matching support apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to:
display, on the screen of the display device, a second user interface to be used in an operation for enabling the user to designate the feature region in the third display region.
3. The matching support apparatus according to claim 2 , wherein the at least one processor is further configured to execute the instructions to:
in a case where the feature region designated using the second user interface is matched against the matching information in which the matching-use face development image and the matching-use feature region for each person of the plurality of persons registered in advance are associated with each other, and in a case where the person is selected to serve as the candidate is selected based on the matching result, display, on the screen of the display device, the matching-use face development image corresponding to the selected person together with the feature region.
4. The matching support apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to:
display, on the screen of the display device, a matching-use face three-dimensional image corresponding to the selected person, based on three-dimensional data of a head of the selected person.
5. A matching support method performed by a computer and comprising:
displaying, on a screen of a display device, a first display region for displaying a frame image of a still image or a moving image including a face of a person targeted for matching that is captured using an image capturing apparatus;
displaying, on the screen of the display device, a second display region for displaying a reference face development image created by CG (Computer Graphics) based on data of one or more heads measured or previously captured, on a screen of a display device;
when a facial feature visible is not visible on a skin surface of the person targeted for matching displayed in the first display region, displaying, on the screen of the display device, a first user interface to be used in an operation for enabling a user to designate, in the second display region, a feature region indicating the facial feature of the person targeted for matching that is visible on a skin surface of the person targeted for matching;
in a case where the feature region designated using the first user interface is matched against matching information in which a matching-use face development image and matching-use feature region for each person of a plurality of persons registered in advance are associated with each other, and in a case where a person of the plurality of persons is selected to serve as a candidate based on a matching result, displaying, on the screen of the display device, the matching-use face development image corresponding to the selected person together with the matching-use feature region; and
display, on the screen of the display device, a third display region in which a face in a reference face three-dimensional image generated based on three-dimensional data of a reference head is displayed to be oriented in alignment with an orientation of the face of the person targeted for matching displayed in the first display region,
wherein the facial feature of the person is at least any one or more of a mole, a freckle, a tattoo, a birthmark, a wrinkle, a dimple, a scar, a wart, a lump, rough skin, and a discolored skin patch, which is visible on the skin surface of the person.
6. The matching support method according to claim 5 , further comprising:
displaying, on the screen of the display device, a second user interface to be used in an operation for enabling the user to designate the feature region in the third display region.
7. The matching support method according to claim 6 , further comprising:
in a case where the feature region designated using the second user interface is matched against the matching information in which the matching-use face development image and the matching-use feature region for each person of the plurality of persons registered in advance are associated with each other, and in a case where the person is selected to serve as the candidate is selected based on the matching result, displaying, on the screen of the display device, the matching-use face development image corresponding to the selected person together with the feature region.
8. The matching support method according to claim 5 , further comprising:
displaying, on the screen of the display device, a matching-use face three-dimensional image corresponding to the selected person, based on three-dimensional data of a head of the selected person.
9. A non-transitory computer-readable recording medium storing a program executable by a computer to perform processing comprising:
displaying, on a screen of a display device, a first display region for displaying a frame image of a still image or a moving image including a face of a person targeted for matching that is captured using an image capturing apparatus;
displaying, on the screen of the display device, a second display region for displaying a reference face development image created by CG (Computer Graphics) based on data of one or more heads measured or previously captured, on a screen of a display device;
when a facial feature visible is not visible on a skin surface of the person targeted for matching displayed in the first display region, displacing, on the screen of the display device, a first user interface to be used in an operation for enabling a user to designate, in the second display region, a feature region indicating the facial feature of the person targeted for matching that is visible on a skin surface of the person targeted for matching;
in a case where the feature region designated using the first user interface is matched against matching information in which a matching-use face development image and matching-use feature region for each person of a plurality of persons registered in advance are associated with each other, and in a case where a person of the plurality of persons is selected to serve as a candidate based on a matching result, displaying, on the screen of the display device, the matching-use face development image corresponding to the selected person together with the matching-use feature region; and
display, on the screen of the display device, a third display region in which a face in a reference face three-dimensional image generated based on three-dimensional data of a reference head is displayed to be oriented in alignment with an orientation of the face of the person targeted for matching displayed in the first display region,
wherein the facial feature of the person is at least any one or more of a mole, a freckle, a tattoo, a birthmark, a wrinkle, a dimple, a scar, a wart, a lump, rough skin, and a discolored skin patch, which is visible on the skin surface of the person.
10. The non-transitory computer-readable recording medium according to claim 9 , wherein the processing further comprises:
displaying, on the screen of the display device, a second user interface to be used in an operation for enabling the user to designate the feature region in the third display region.
11. The non-transitory computer-readable recording medium according to claim 10 , wherein the processing further comprises:
in a case where the feature region designated using the second user interface is matched against the matching information in which the matching-use face development image and the matching-use feature region for each person of the plurality of persons registered in advance are associated with each other, and in a case where the person is selected to serve as the candidate is selected based on the matching result, displaying, on the screen of the display device, the matching-use face development image corresponding to the selected person together with the feature region.
12. The non-transitory computer-readable recording medium according to claim 9 , wherein the processing further comprises:
displaying, on the screen of the display device, a matching-use face three-dimensional image corresponding to the selected person, based on three-dimensional data of a head of the selected person.