Automatic face and skin beautification using face detection

1. A method of enhancing an appearance of a face within a digital image, comprising using a processor in:

acquiring a digital image of a scene including a depiction of a face, including capturing the image using a lens and an image sensor, or receiving said image following capture by a device that includes a lens and an image sensor, or a combination thereof;

identifying a face region, wherein the face region is a region of the digital image that includes the depiction of the face;

wherein the face region includes less than all of said digital image;

identifying within the face region one or more sub-regions to be enhanced with localized luminance smoothing;

wherein each of the one or more sub-regions includes less than all of said face region;

applying one or more localized luminance smoothing kernels each to one of the one or more sub-regions identified within the face region to produce one or more enhanced sub-regions within the face region, wherein the applying comprises applying the one or more localized luminance smoothing kernels to luminance data of the one or more sub-regions identified within said face region;

wherein the step of applying one or more localized smoothing kernels further comprises applying, to each particular sub-region of the one or more sub-regions, a localized smoothing kernel configured based, at least in part, on an average luminance around a point of interest for that particular sub-region;

generating an enhanced image including an enhanced version of the face region comprising certain original or otherwise processed pixels in combination with pixels corresponding to the one or more enhanced sub-regions within the face region; and

displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof.

2. The method of claim 1 , wherein the localized luminance smoothing comprises blurring or averaging luminance data, or a combination thereof.

3. The method of claim 1 , further comprising applying one or more localized color smoothing kernels to the one or more sub-regions, and wherein the one or more enhanced sub-regions of the enhanced image further comprise pixels modified from original pixels of the face at least by localized color smoothing.

4. The method of claim 1 , further comprising applying noise reduction or enhancement, or both, to the one or more sub-regions, and wherein the one or more enhanced sub-regions of the enhanced image further comprise pixels modified from original pixels of the face at least by localized noise reduction or enhancement, or both.

5. The method of claim 1 , wherein enhanced pixels of the one or more enhanced sub-regions comprise enhanced intensities which comprise one or more functions of a relationship between original pixel intensities and local average intensities within the one or more original or enhanced sub-regions, or combinations thereof.

6. The method of claim 1 , further comprising detecting one or more mouth or eye regions, or combinations thereof, within the face, and identifying and enhancing a natural color of one or more sub-regions within the one or more mouth or eye regions, including one or more teeth, lips, tongues, eye whites, eye brows, iris's, eye lashes, or pupils, or combinations thereof.

7. A device including a lens, an image sensor, a processor, and a processor-readable medium having code embedded therein for programming the processor to perform a method of enhancing an appearance of a face within a digital image, wherein the method comprises:

acquiring a digital image of a scene including a depiction of a face, including capturing the image using a lens and an image sensor, or receiving said image following capture by a device that includes a lens and an image sensor, or a combination thereof;

identifying a face region, wherein the face region is a region of the digital image that includes the depiction of the face;

wherein the face region includes less than all of said digital image;

identifying within the face region one or more sub-regions to be enhanced with localized luminance smoothing;

wherein each of the one or more sub-regions includes less than all of said face region;

applying one or more localized luminance smoothing kernels each to one of the one or more sub-regions identified within the face region to produce one or more enhanced sub-regions within the face region, wherein the applying comprises applying the one or more localized luminance smoothing kernels to luminance data of the one or more sub-regions identified within said face region;

wherein the step of applying one or more localized smoothing kernels further comprises applying, to each particular sub-region of the one or more sub-regions, a localized smoothing kernel configured based, at least in part, on an average luminance around a point of interest for that particular sub-region;

generating an enhanced image including an enhanced version of the face region comprising certain original or otherwise processed pixels in combination with pixels corresponding to the one or more enhanced sub-regions within the face region; and

displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof.

8. The device of claim 7 , wherein the localized luminance smoothing comprises blurring or averaging luminance data, or a combination thereof.

9. The device of claim 7 , further comprising applying one or more localized color smoothing kernels to the one or more sub-regions, and wherein the one or more enhanced sub-regions of the enhanced image further comprise pixels modified from original pixels of the face at least by localized color smoothing.

10. The device of claim 7 , further comprising applying noise reduction or enhancement, or both, to the one or more sub-regions, and wherein the one or more enhanced sub-regions of the enhanced image further comprise pixels modified from original pixels of the face at least by localized noise reduction or enhancement, or both.

11. The device of claim 7 , wherein enhanced pixels of the one or more enhanced sub-regions comprise enhanced intensities which comprise one or more functions of a relationship between original pixel intensities and local average intensities within the one or more original or enhanced sub-regions, or combinations thereof.

12. The device of claim 7 , wherein the method further comprises detecting one or more mouth or eye regions, or combinations thereof, within the face, and identifying and enhancing a natural color of one or more sub-regions within the one or more mouth or eye regions, including one or more teeth, lips, tongues, eye whites, eye brows, iris's, eye lashes, or pupils, or combinations thereof.

13. One or more non-transitory computer readable media having code embedded therein for programming a processor to perform a method of enhancing an appearance of a face within a digital image of a scene including a depiction of a face captured with a lens and an image sensor, or received following capture by a device that includes a lens and an image sensor, or a combination thereof; wherein the method comprises:

identifying a face region, wherein the face region is a region of the digital image that includes the depiction of the face;

wherein the face region includes less than all of said digital image;

identifying within the face region one or more sub-regions to be enhanced with localized luminance smoothing;

wherein each of the one or more sub-regions includes less than all of said face region;

applying one or more localized luminance smoothing kernels each to one of the one or more sub-regions identified within the face region to produce one or more enhanced sub-regions within the face region, wherein the applying comprises applying the one or more localized luminance smoothing kernels to luminance data of the one or more sub-regions identified within said face region;

wherein the step of applying one or more localized smoothing kernels further comprises applying, to each particular sub-region of the one or more sub-regions, a localized smoothing kernel configured based, at least in part, on an average luminance around a point of interest for that particular sub-region;

generating an enhanced image including an enhanced version of the face region comprising certain original or otherwise processed pixels in combination with pixels corresponding to the one or more enhanced sub-regions within the face region; and

displaying, transmitting, communicating or digitally storing or otherwise outputting the enhanced image or a further processed version, or combinations thereof.

14. The one or more non-transitory computer readable media of claim 13 , wherein the localized luminance smoothing comprises blurring or averaging luminance data, or a combination thereof.

15. The one or more non-transitory computer readable media of claim 13 , wherein the method further comprises applying one or more localized color smoothing kernels to the one or more sub-regions, and wherein the one or more enhanced sub-regions of the enhanced image further comprise pixels modified from original pixels of the face at least by localized color smoothing.

16. The one or more non-transitory computer readable media of claim 13 , wherein the method further comprises applying noise reduction or enhancement, or both, to the one or more sub-regions, and wherein the one or more enhanced sub-regions of the enhanced image further comprise pixels modified from original pixels of the face at least by localized noise reduction or enhancement, or both.

17. The one or more non-transitory computer readable media of claim 13 , wherein enhanced pixels of the one or more enhanced sub-regions comprise enhanced intensities which comprise one or more functions of a relationship between original pixel intensities and local average intensities within the one or more original or enhanced sub-regions, or combinations thereof.

18. The one or more non-transitory computer readable media of claim 13 , wherein the method further comprises detecting one or more mouth or eye regions, or combinations thereof, within the face, and identifying and enhancing a natural color of one or more sub-regions within the one or more mouth or eye regions, including one or more teeth, lips, tongues, eye whites, eye brows, iris's, eye lashes, or pupils, or combinations thereof.