IP Library Granted Patent US 9,712,743
Granted Patent B2
US 9,712,743 · App. 15/369,698 · Granted Jul 18, 2017

Digital image processing using face detection and skin tone information

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,712,743
App. No.
15/369,698
Granted
Jul 18, 2017
Kind
B2
Abstract

A technique for processing a digital image uses face detection to achieve one or more desired image processing parameters. A group of pixels is identified that corresponds to a face image within the digital image. A skin tone is detected for the face image by determining one or more default color or tonal values, or combinations thereof, for the group of pixels. Values of one or more parameters are adjusted for the group of pixels that correspond to the face image based on the detected skin tone.

Claims (50)

1. A method of processing a digital image using face detection, the method comprising:

identifying a first group of pixels that correspond to a first face region within a digital image;

determining one or more first initial color values for pixels in the first group of pixels;

based on the one or more first initial color values for the pixels in the first group of pixels, determining a first skin tone for the first face region;

identifying a second group of pixels that correspond to a second face region within the digital image;

determining one or more second initial color values for pixels in the second group of pixels;

based on the one or more second initial color values for the pixels in the second group of pixels, determining a second skin tone for the second face region;

determining whether the first skin tone is lighter than the second skin tone; and

in response to determining that the first skin tone is lighter than the second skin tone:

based on, at least in part, the first skin tone and the second skin tone, determining an initial fill-flash and applying the initial fill-flash to the first face region;

based on, at least in part, the first skin tone and the second skin tone, increasing the fill-flash and applying the increased fill-flash to the second face region.

2. The method of claim 1 , wherein the applying the initial fill-flash to the first face region comprises applying the initial fill-flash to the first face region in an amount depending on the first skin tone.

3. The method of claim 1 , wherein applying the increased fill-flash to the second face region comprises applying the increased fill-flash to the second face region in an amount depending on the second skin tone.

4. The method of claim 1 , wherein applying the initial fill-flash to the first face region comprises adjusting a luminance of the first face region depending on the first skin tone and the initial fill-flash.

5. The method of claim 1 , wherein applying the increased fill-flash to the second face region comprises adjusting a luminance of the second face region depending on the second skin tone and the increased fill-flash.

6. The method of claim 1 , wherein the initial fill-flash is further determined based on, at least in part, a background color surrounding the first face region.

7. The method of claim 1 , wherein the increased fill-flash is further determined based on, at least in part, a background color surrounding the second face region.

8. An image acquisition apparatus including an imaging optical system, a digital image detector and storage medium, and having stored therein program instructions which, when executed by one or more processors cause the one or more processors, to perform:

identifying a first group of pixels that correspond to a first face region within a digital image;

determining one or more first initial color values for pixels in the first group of pixels;

based on the one or more first initial color values for the pixels in the first group of pixels, determining a first skin tone for the first face region;

identifying a second group of pixels that correspond to a second face region within the digital image;

determining one or more second initial color values for pixels in the second group of pixels;

based on the one or more second initial color values for the pixels in the second group of pixels, determining a second skin tone for the second face region;

determining whether the first skin tone is lighter than the second skin tone; and

in response to determining that the first skin tone is lighter than the second skin tone:

based on, at least in part, the first skin tone and the second skin tone, determining an initial fill-flash and applying the initial fill-flash to the first face region;

based on, at least in part, the first skin tone and the second skin tone, increasing the fill-flash and applying the increased fill-flash to the second face region.

9. The image acquisition apparatus of claim 8 , wherein the applying the initial fill-flash for the first face region comprises applying the initial fill-flash to the first face region in an amount depending on the first skin tone.

10. The image acquisition apparatus of claim 8 , wherein applying the increased fill-flash to the second face region comprises applying the increased fill-flash to the second face region in an amount depending on the second skin tone.

11. The image acquisition apparatus of claim 8 , wherein applying the initial fill-flash to the first face region comprises adjusting a luminance of the first face region depending on the first skin tone and the initial fill-flash.

12. The image acquisition apparatus of claim 8 , wherein applying the increased fill-flash to the second face region comprises adjusting a luminance of the second face region depending on the second skin tone and the increased fill-flash.

13. The image acquisition apparatus of claim 8 , wherein the initial fill-flash is further determined based on, at least in part, a background color surrounding the first face region.

14. The image acquisition apparatus of claim 8 , wherein the increased fill-flash is further determined based on, at least in part, a background color surrounding the second face region.

15. One or more non-transitory computer-readable storage media storing one or more instructions which, when executed by one or more processors, cause the one or more processors to perform:

identifying a first group of pixels that correspond to a first face region within a digital image;

determining one or more first initial color values for pixels in the first group of pixels;

based on the one or more first initial color values for the pixels in the first group of pixels, determining a first skin tone for the first face region;

identifying a second group of pixels that correspond to a second face region within the digital image;

determining one or more second initial color values for pixels in the second group of pixels;

based on the one or more second initial color values for the pixels in the second group of pixels, determining a second skin tone for the second face region;

determining whether the first skin tone is lighter than the second skin tone; and

in response to determining that the first skin tone is lighter than the second skin tone:

based on, at least in part, the first skin tone and the second skin tone, determining an initial fill-flash and applying the initial fill-flash to the first face region;

based on, at least in part, the first skin tone and the second skin tone, increasing the fill-flash and applying the increased fill-flash to the second face region.

16. The one or more non-transitory computer-readable storage media of claim 15 , wherein the applying the initial fill-flash to the first face region comprises applying the initial fill-flash to the first face region in an amount depending on the first skin tone.

17. The one or more non-transitory computer-readable storage media of claim 15 , wherein applying the increased fill-flash to the second face region comprises applying the increased fill-flash to the second face region in an amount depending on the second skin tone.

18. The one or more non-transitory computer-readable storage media of claim 15 , wherein applying the initial fill-flash to the first face region comprises adjusting a luminance of the first face region depending on the first skin tone and the initial fill-flash.

19. The one or more non-transitory computer-readable storage media of claim 15 , wherein the initial fill-flash is further determined based on, at least in part, a background color surrounding the first face region.

20. The one or more non-transitory computer-readable storage media of claim 15 , wherein the increased fill-flash is further determined based on, at least in part, a background color surrounding the second face region.

Assignments (1)
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →