Makeup application assistance device, makeup application assistance method, and makeup application assistance program
View Patent ↗To appropriately assist with the application of makeup involving referencing a makeup technique of another person, this makeup application assistance device includes: first face part acquisition unit that acquires face part regions of a first face from a first image obtained by capturing the first face; second face part acquisition unit that acquires face part regions of a second face to which makeup has been applied, from a second image obtained by capturing the second face; reference makeup technique acquisition unit that acquires, for each face part of the second face, a makeup technique, which is a makeup application method, from the second image on the basis of the face part regions of the second face; and makeup technique presentation unit that associates the acquired makeup techniques with the corresponding face part regions of the first face, and presents the makeup techniques to a user.
1. A make-up assisting apparatus that provides assistance for make-up using make-up used by others as a reference, the make-up assisting apparatus comprising a processor that, when executing instructions stored in a memory, performs operations comprising:
acquiring a first image, which is a captured image of a user face;
acquiring areas of facial parts of the user face from the first image;
acquiring a second image, which is a captured image of a model face to which make-up has been applied;
acquiring areas of facial parts of the model face from the second image;
specifying an area having a color approximate to a color of the skin of the model face, from positions of the acquired areas of the facial parts of the model face;
acquiring, from the second image, make-up for each facial part of the facial parts of the model face, based on a difference between the color of the specified area of the second image and an actual color of the facial part of the second image, the make-up including a way of applying the make-up; and
generating a simulation image obtained by superimposing, on the first image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.
2. The make-up assisting apparatus according to claim 1 , wherein:
the make-up includes at least a color, application concentration and an application range of a skin cosmetic agent; and
the processor, when executing instructions stored in the memory, further performs operations of acquiring at least the application range of the make-up based on the area of the facial part of the model face.
3. The make-up assisting apparatus according to claim 1 , wherein the processor further performs:
generating, when make-up has been applied to the user face included in the first image, a make-up removed image from the first image, the make-up removed image being an image of the user face in which no make-up is applied; and
generating a simulation image obtained by superimposing, on the make-up removed image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.
4. The make-up assisting apparatus according to claim 1 , wherein the processor further performs operations of presenting information relating to a cosmetic required for applying the make-up acquired from the second image on the user face.
5. A make-up assisting method that provides assistance for make-up using make-up used by others as a reference, the make-up assisting method comprising:
acquiring a first image, which is a captured image of a user face;
acquiring areas of facial parts of the user face from the first image;
acquiring a second image, which is a captured image of a model face to which make-up has been applied;
acquiring areas of facial parts of the model face from the second image;
specifying an area having a color approximate to a color of the skin of the model face, from positions of the acquired areas of the facial parts of the model face;
acquiring, from the second image, make-up for each facial part of the facial parts of the model face, based on a difference between the color of the specified area of the second image and an actual color of the facial part of the second image, the make-up including a way of applying the make-up; and
generating a simulation image obtained by superimposing, on the first image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.
6. A non-transitory computer-readable storage medium comprising a make-up assisting program that provides assistance for make-up using make-up used by others as a reference, the make-up assisting program causing a computer to execute processing comprising:
acquiring, a first image which is a captured image of a user face;
acquiring areas of facial parts of the user face from the first image;
acquiring, a second image which is a captured image of a model face to which make-up has been applied;
acquiring areas of facial parts of the model face from the second image;
specifying an area having a color approximate to a color of the skin of the model face, from positions of the acquired areas of the facial parts of the model face;
acquiring, from the second image, make-up for each facial part of the facial parts of the model face based on a difference between the color of the specified area of the second image and an actual color of the facial part of the second image, the make-up including a way of applying the make-up; and
generating a simulation image obtained by superimposing, on the first image, an image indicating a state of the make-up when the make-up acquired from the second image is applied to the user face, and displaying the generated simulation image.
7. The make-up assisting apparatus according to claim 1 , wherein the area having the color approximate to the color of the skin of the model face includes an ear or a neck of the model face in the second image.