IP Library Granted Patent US 8,509,498
Granted Patent B2
US 8,509,498 · App. 13/245,738 · Granted Aug 13, 2013

Real-time face tracking in a digital image acquisition device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,509,498
App. No.
13/245,738
Granted
Aug 13, 2013
Kind
B2
Abstract

An image processing apparatus for tracking faces in an image stream iteratively receives an acquired image from the image stream including one or more face regions. The acquired image is sub-sampled at a specified resolution to provide a sub-sampled image. An integral image is then calculated for a least a portion of the sub-sampled image. Fixed size face detection is applied to at least a portion of the integral image to provide a set of candidate face regions. Responsive to the set of candidate face regions produced and any previously detected candidate face regions, the resolution is adjusted for sub-sampling a subsequent acquired image.

Claims (32)

1. A method of detecting faces in an image stream, comprising:

receiving an acquired image from said image stream including one or more face regions;

sub-sampling said acquired image at a specified resolution to provide a sub-sampled image;

identifying one or more regions of said acquired image predominantly including skin tones;

calculating a corresponding integral image for at least one of said skin tone regions of said sub-sampled acquired image;

applying face detection to at least a portion of said integral image to provide a set of one or more candidate face regions each having a given size and a respective location; and

responsive to failing to detect at least one face region for said image, enhancing the contrast of the luminance characteristics for at least a region corresponding to one of said skin tone regions in a subsequently acquired image.

2. A method as claimed in claim 1 , in a face detection mode of said digital image acquisition device, each new acquired image is acquired with progressively increased exposure parameters until at least one candidate face region is detected.

3. A method as claimed in claim 1 , wherein said enhancing is responsive to a maximum value of said luminance being below a threshold value to increase low values of luminance of said candidate region or said acquired image.

4. A method as claimed in claim 1 , wherein said enhancing is responsive to a minimum value of said luminance being above a threshold value to decrease high values of luminance of said candidate region or said acquired image.

5. A method as claimed in claim 1 , wherein said enhancing is responsive to a value of said variance of said luminance being above a threshold value to stop enhancing said candidate region or said acquired image.

6. An image processing apparatus including one or more processors and one or more digital storage media having digitally-encoded instructions embedded therein for programming the one or more processors to perform an iterative method of detecting faces in an image stream, the method comprising:

receiving an acquired image from said image stream including one or more face regions;

sub-sampling said acquired image at a specified resolution to provide a sub-sampled image;

identifying one or more regions of said acquired image predominantly including skin tones;

calculating a corresponding integral image for at least one of said skin tone regions of said sub-sampled acquired image;

applying face detection to at least a portion of said integral image to provide a set of one or more candidate face regions each having a given size and a respective location; and

responsive to failing to detect at least one face region for said image, enhancing the contrast of the luminance characteristics for at least a region corresponding to one of said skin tone regions in a subsequently acquired image.

7. An apparatus as claimed in claim 6 , in a face detection mode of said apparatus, each new acquired image is acquired with progressively increased exposure parameters until at least one candidate face region is detected.

8. An apparatus as claimed in claim 6 , wherein said enhancing is responsive to a maximum value of said luminance being below a threshold value to increase low values of luminance of said candidate region or said acquired image.

9. An apparatus as claimed in claim 6 , wherein said enhancing is responsive to a minimum value of said luminance being above a threshold value to decrease high values of luminance of said candidate region or said acquired image.

10. An apparatus as claimed in claim 6 , wherein said enhancing is responsive to a value of said variance of said luminance being above a threshold value to stop enhancing said candidate region or said acquired image.

11. One or more non-transitory processor-readable digital storage media having digitally-encoded instructions embedded therein for programming one or more processors to perform an iterative method of detecting faces in an image stream, the method comprising:

receiving an acquired image from said image stream including one or more face regions;

sub-sampling said acquired image at a specified resolution to provide a sub-sampled image;

identifying one or more regions of said acquired image predominantly including skin tones by applying one of a number of filters to define said one or more regions of said acquired image predominantly including skin tones, at least one of said filters including a restrictive skin filter and at least one of said filters including a relaxed skin filter;

calculating a corresponding integral image for at least one of said skin tone regions of said sub-sampled acquired image;

applying face detection to at least a portion of said integral image to provide a set of one or more candidate face regions each having a given size and a respective location; and

responsive to failing to detect at least one face region for said image, enhancing the contrast of the luminance characteristics for at least a region corresponding to one of said skin tone regions in a subsequently acquired image.

12. One or more non-transitory processor-readable digital storage media as claimed in claim 11 , wherein said enhancing is responsive to a maximum value of said luminance being below a threshold value to increase low values of luminance of said candidate region or said acquired image.

13. One or more non-transitory processor-readable digital storage media as claimed in claim 11 , wherein said enhancing is responsive to a minimum value of said luminance being above a threshold value to decrease high values of luminance of said candidate region or said acquired image.

14. One or more non-transitory processor-readable digital storage media as claimed in claim 11 , wherein said enhancing is responsive to a value of said variance of said luminance being above a threshold value to stop enhancing said candidate region or said acquired image.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2025
From: FOTONATION LIMITED
To: ADEIA IMAGING LLC
Reel/Frame 073635/0320 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
CHANGE OF NAME Recorded Dec 3, 2014
From: DIGITALOPTICS CORPORATION EUROPE LIMITED
To: FOTONATION LIMITED
Reel/Frame 034524/0330 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 7, 2013
From: FOTONATION VISION LIMITED
To: TESSERA TECHNOLOGIES IRELAND LIMITED
Reel/Frame 029580/0863 →
CHANGE OF NAME Recorded Jan 7, 2013
From: TESSERA TECHNOLOGIES IRELAND LIMITED
To: DIGITALOPTICS CORPORATION EUROPE LIMITED
Reel/Frame 029580/0897 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2011
From: PETRESCU, STEFAN; CORCORAN, PETER; STEINBERG, ERAN; BIGIOI, PETRONEL; DRIMBAREAN, ALEXANDRU
To: FOTONATION VISION LIMITED
Reel/Frame 027268/0085 →