IP Library › Granted Patent US 9,516,217

Granted Patent B2

US 9,516,217 · App. 14/563,972 · Granted Dec 6, 2016

Digital image processing using face detection and skin tone information

Inventors: Peter Corcoran (Claregalway, IE); Igor Barcovschi (Galway, IE); Eran Steinberg (San Francisco, CA); Yury Prilutsky (San Mateo, CA); Petronel Bigioi (Galway, IE)

Assignee: FotoNation Limited

H04N5/23219 G06F17/30793 G06K9/00221 G06K9/00228 G06K9/00268 G06T5/00 G06T5/001 G06T7/408 H04N5/232 H04N5/23229

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 9,516,217
App. No.: 14/563,972
Granted: Dec 6, 2016
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A technique for processing a digital image uses face detection to achieve one or more desired image processing parameters. A group of pixels is identified that corresponds to a face image within the digital image. A skin tone is detected for the face image by determining one or more default color or tonal values, or combinations thereof, for the group of pixels. Values of one or more parameters are adjusted for the group of pixels that correspond to the face image based on the detected skin tone.

Claims (131)

1. A method of processing a digital image using face detection, comprising:

identifying a first group of pixels that correspond to a first face image within the digital image and a second group of pixels that correspond to a second face image within the digital image;

based on the first group of pixels, detecting a first skin tone of the first face image;

based on the second group of pixels, detecting a second skin tone of the second face image;

detecting a first attribute value of pixels that correspond to a background for the first face image;

detecting a second attribute value of pixels that correspond to a background for the second face image;

wherein the first attribute value is different from the second attribute value;

based on the first skin tone, making a first adjustment to fill-flash of the first face image;

based on the first attribute value, making a second adjustment to illumination of the first face image;

based on the second skin tone, making a third adjustment to fill-flash of the second face image;

based on the second attribute value, making a fourth adjustment to illumination of the second face image; and

wherein the second adjustment is different than the fourth adjustment.

2. The method of claim 1 , wherein detecting the first skin tone of the first face image comprises:

determining a first set of values for the first group of pixels, wherein the first set of values comprises:

one or more color values for the first group of pixels,

one or more tonal values for the first group of pixels, or

a combination of color and tonal values for the first group of pixels;

performing a comparison between the first set of values and a second set of values,

wherein the second set of values comprises:

one or more default color values,

one or more default tonal values, or

a combination of default color and tonal values; and

determining the first skin tone for the first face image based on the comparison of the first set of values to the second set of values.

3. The method of claim 2 , wherein detecting the second skin tone of the second face image comprises:

determining a third set of values for the second group of pixels, wherein the third set of values comprises:

one or more color values for the second group of pixels,

one or more tonal values for the second group of pixels, or

a combination of color and tonal values for the second group of pixels;

performing a comparison between the third set of values and the second set of values; and

determining the second skin tone for the second face image based on the comparison of the third set of values to the second set of values.

4. The method of claim 2 , wherein the first set of values for the first group of pixels comprise:

one or more average color values for the first group of pixels,

one or more average tonal values for the first group of pixels, or

a combination of average color and tonal values for the first group of pixels.

5. The method of claim 4 , wherein the first set of values comprise one or more first subsets of values for one or more corresponding regions of the first face image, wherein each of the one or more first subsets of values comprise:

one or more color values,

one or more tonal values, or

a combination of color and tonal values.

6. The method of claim 1 , further comprising:

detecting a third attribute value of pixels that correspond to the background for the first face image;

making the second adjustment to illumination of the first face image also based on the third attribute value;

wherein the first attribute value is one of a luminance value, a color value, or a tonal value; and

wherein the third attribute value is another one of, other than the first attribute value, the luminance value, the color value, or the tonal value.

7. An image acquisition apparatus comprising:

one or more processors; and

one or more memories storing instructions which, when processed by the one or more processors, cause:

identifying a first group of pixels that correspond to a first face image within a digital image and a second group of pixels that correspond to a second face image within the digital image;