IP Library Granted Patent US 9,681,040
Granted Patent B2
US 9,681,040 · App. 15/211,975 · Granted Jun 13, 2017

Face tracking for controlling imaging parameters

Inventors: Peter Corcoran (Claregalway, IE); Eran Steinberg (San Francisco, CA); Petronel Bigioi (Galway, IE)
Assignee: FotoNation Limited
H04N5/23219G06K9/00228G06K9/00255G06K9/00261G06K9/00288G06K9/32G06T7/248G06T7/251H04N5/23293G06K2009/3291G06T2207/10016G06T2207/20016G06T2207/20121G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,681,040
App. No.
15/211,975
Granted
Jun 13, 2017
Kind
B2
Abstract

A method of tracking faces in an image stream with a digital image acquisition device includes receiving images from an image stream including faces, calculating corresponding integral images, and applying different subsets of face detection rectangles to the integral images to provide sets of candidate regions. The different subsets include candidate face regions of different sizes and/or locations within the images. The different candidate face regions from different images of the image stream are each tracked.

Claims (15)

1. A digital image acquisition device, comprising a lens, an image sensor, a processor, and a processor-readable memory having digital code embedded therein for programming the processor to perform a method of detecting and recognizing faces in digital images acquired by the device, wherein the method comprises:

acquiring, from an image stream, an image including one or more face regions;

calculating an integral image for at least a portion of the image or a sub-sampled version of the at least a portion of the image, or both;

applying a face detection to at least a portion of the integral image to provide one or more candidate face regions;

applying a face recognition, which uses a database, to the one or more candidate face regions to recognize a face in the one or more candidate face regions, and determining an identifier for the recognized face; storing the identifier for the recognized face in association with the image or a portion thereof that includes the recognized face; and

adjusting one or more image acquisition conditions in an image acquiring device to modify white balance, color balance, focus, or exposure, or combinations thereof, for the recognized face.

2. The device of claim 1 , wherein the method further comprises applying a face tracking to detect the recognized face from another image of the image stream.

3. The device of claim 1 , wherein the database includes an identifier and one or more associated parameters for each of one or more faces to be recognized.

4. The device of claim 1 , wherein the applying the face recognition is performed selectively, and the method further comprises selecting the one or more candidate face regions having a frontal alignment for the face recognition or including two eye regions and a mouth region within a given area of the candidate face region, or both.

5. The device of claim 1 , further comprising providing a level of confidence for each candidate face region based on the face detection; and wherein a candidate face region is designated with a first level of confidence as a face region, and wherein the face recognition is applied to the candidate face regions having a second confidence level higher than the first level of confidence.

6. The device of claim 1 , further comprising applying an Active Appearance Model (AAM) to the one or more candidate face regions, and applying the face recognition to the one or more candidate face regions having AAM parameters indicating the candidate face region that has a degree of rotation within a pre-determined range.

7. The device of claim 1 , further comprising applying chain classifiers to the image, wherein at least one of the chain classifiers includes a frontal classifier chain, and applying the face recognition to the one or more candidate face regions detected with the frontal classifier chain.

8. The device of claim 1 , further comprising calculating an average luminance for each candidate face region, and applying the face recognition to the one or more candidate face regions having the average luminance within a pre-determined range.

9. The device of claim 1 , wherein the image received from the image stream comprises a relatively low resolution preview image.

10. The device of claim 9 , further comprising determining a subsequent location or a subsequent size, or both, for the same face in a subsequent preview image; and based on an initial location or an initial size and the subsequent location or size, or combinations thereof, predicting a region of a third preview image which has just been acquired within which region the same face is expected to occur again.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2025
From: FOTONATION LIMITED
To: ADEIA IMAGING LLC
Reel/Frame 073635/0320 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
Continuity (5)
Continuation 14561905 · Dec 5, 2014
Continuation 13771061 · Feb 19, 2013
Continuation 12814245 · Jun 11, 2010
Continuation In Part 12063089 · Feb 6, 2008
Related Publication 20160330369A1 · Nov 10, 2016