Method and system for make-up simulation on portable devices having digital cameras
A system and method are capable of performing make-up virtual images obtained with portable devices with a digital camera. The method automatically detects points of interest (eyes, mouth, eyebrow, face contour) of the user's face image allowing the user to virtually apply make-up using fingers on a touch screen. Another algorithm was created to avoid “blurring” of make-up in the application from the user's fingers. The system allows the creation of virtual make-up faces with high accuracy. To carry out the virtual make-up, methods were created for automatically detecting points of interest in the facial image and enforcing transparency in the image to simulate the make-up and restrict the make-up application area within the region where the points of interest are found. The system allows testing cosmetics application in facial images to aid choosing colors of cosmetics before actually applying them.
1. A method for simulating make-up on a face of a user on a portable device equipped with a digital camera, the method comprising:
finding, by a processor, the face and constituent parts of the face;
segmenting regions of the face;
searching for points of interest in the regions of the face;
creating masks to delimit the regions;
receiving a gesture, by a finger of the user, to apply make-up to the masked regions;
avoiding blurring of the region with applied make-up; and
matching colors of the face with the make-up applied to provide a realistic effect to the applied make-up,
wherein the make-up is applied by an interaction of the user with the device, where, by touch and motion gestures of dragging his/her finger across a region where the make-up is applied, the user simulates an actual application of the make-up in that as the user passes the finger over the region, an intensity of a selected color of the make-up in the region is increased.
2. The method of claim 1 , wherein the segmenting the regions of the face comprises:
cutting a target region that includes only the face by selecting a rectangle corresponding to the target and copying pixels in the rectangle to a new image; and
finding an eye region and a mouth region of the user in the new image.
3. The method of claim 2 , further comprising converting the image from an RGB color space to a YIQ color space, wherein component Y stores luminance information, and components I and Q store chrominance information.
4. The method of claim 3 , wherein the finding the mouth region comprises analyzing the pixels of the Q channel because of the difference between the face color and a color of the mouth.
5. The method of claim 2 , wherein the mouth region is found by creating a binary mask which separates the mouth from the rest of the new image.
6. The method of claim 1 , further comprising adjusting points, in which the user manually corrects a position of the points of interest.
7. The method of claim 1 , wherein the user modifies lines delimiting the delimited regions of the face.
8. The method of claim 1 , wherein the user selects one of several styles of make-up reflected in color palettes of products to be applied on the face.
9. The method of claim 1 , wherein the user defines a position and intensity of colors for different make-up products.
10. The method of claim 1 , wherein the user can switch between an image of the face without make-up and an image of the face with the applied make-up for comparison, and remove the applied make-up.
11. The method as claim 1 , wherein an image of the face with the applied make-up may be stored locally on the device or shared.
12. A system for simulation of applying make-up on a portable device equipped with a digital camera and a touch screen, the system comprising:
the digital camera capturing an image in a real-time preview mode;
for a storage unit storing information and data including color palettes of products used in make-up and photos with applied make-up;
an information input device intercepting keyboard events and a touch of a user on the touch screen;
an audio component capturing and reproducing sound;
a connectivity component connecting remote services including social networks and email, and
a display displaying data and images presented with make-up applied by the portable device,
wherein the make-up is applied by an interaction of the user with the device, where, by touch and motion gestures of dragging his/her finger across a region where the make-up is applied, the user simulates an actual application of the make-up in that as the user passes the finger over the region, an intensity of a selected color of the make-up in the region is increased.
13. The system of claim 12 , wherein with the digital camera comprises two cameras, one front and one rear, wherein the front camera has a higher quality.
14. The system of claim 12 , wherein the make-up is applied by mapping a finger of the user on the touch screen of the portable device.
15. The system of claim 12 , wherein masks identifying regions being made-up for each product are provided.
16. The system of claim 15 , wherein the masks prevent a blurring of the applied make-up, and set a size of each region being made up.
17. The system of claim 15 , wherein the regions corresponding to simulated make-up products comprise a shadow, eyeliner, lipstick, lip liner, foundation, and blush.
18. The system of claim 15 , further comprising a mask that represents a maximum level of color intensity representing a maximum intensity of make-up color that can be achieved.
19. The system of claim 12 , wherein each product uses different make-up tools.