Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
View Patent ↗The present invention is directed at modifying digital images of faces automatically or semi-automatically. In one aspect, a method of detecting faces in digital images and matching and replacing features within the digital images is provided. Techniques for blending, recoloring, shifting and resizing or portions of digital images are disclosed. In other aspects, methods of virtual “face lifts” are methods of detecting faces within digital image are provided. Advantageously, the detection and localization of faces and facial features, such as the eyes, nose, lips and hair, can be achieved on an automated or semi-automated basis. User feedback and adjustment enables fine tuning of modified images. A variety of systems for matching and replacing features within digital images is also provided, including implementation as a website, through mobile phones, handheld computers, or a kiosk. Related computer program products are also disclosed.
1. A method, for modifying digital image comprising:
(a) detecting a face in the digital image;
(b) establishing one or more regions of interest in the face in the digital image;
(c) detecting one or more features in the regions of interest in the face in the digital image, said one or more features including one or more facial features of interest and one or more other facial features, so that the one or more facial features of interest are located and the one or more other facial features are located based on proximity to the one or more facial features of interest;
(d) isolating the one or more features in the one or more regions of interest in the face in the digital image, through detection of deviation of skin color by determining gradient magnitude
(e) augmenting the face in the digit image by smoothing one or more selective regions in the face in the digital image; and
(f) re-blending into the digital image the one or more features in the face in the digital image to produce one or more altered areas in the face in the digital image, to define a modified digital image.
2. The method of claim 1 , further comprising the step of establishing the regions of interest in the face in the digital image by using a generic template.
3. The method of claim 2 , further comprising the step of utilizing the generic template that is proportional in size to the face in the digital image.
4. The method of claim 2 , further comprising the step of detecting the features in the regions of interest in the face in the digital image by calculating gradient intensities using one or more boxes in the generic template.
5. The method of claim 1 , further comprising the step of detecting the face in the digital image and optionally the face in the modified digital image by using a fusion detection means.
6. The method of claim 5 , further comprising the step of performing the fusion detection means consisting of one or more of the following: symmetry-based face detection; template subtraction face detection; template ratio face detection; skin-detector-based face detection; eye-lip total symmetry face detection; eye total symmetry face detection; and lip total symmetry face detection.