IP Library Granted Patent US 8,411,912
Granted Patent B2
US 8,411,912 · App. 12/631,733 · Granted Apr 2, 2013

Face recognition using face tracker classifier data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,411,912
App. No.
12/631,733
Granted
Apr 2, 2013
Kind
B2
Abstract

A method of determining face recognition profiles for a group persons includes determining with a multi-classifier face detector that a face region within a digital image has above a threshold probability of corresponding to a first person of the group, and recording probability scores which are analyzed for each classifier, including determining a mean and variance for each classifier for the first person. The process is repeated for one or more other persons of the group. A sub-set of classifiers is determined which best differentiates between the first person and the one or more other persons. The sub-set of classifiers is stored in association with the first person as a recognition profile.

Claims (53)

1. A method of in-camera face recognition training of a specific face within digital images acquired with a portable camera-enabled device, comprising:

using a lens, image sensor and processor of a portable camera-enabled device to acquire digital images;

generating in the device, capturing or otherwise obtaining in the device multiple different images that include a face of a specific person;

identifying groups of pixels that correspond to the face within the multiple different images;

selecting sets of classifiers as matching the faces identified in the multiple different images;

statistically analyzing the sets of classifiers to generate a reference classifier profile of the face associated with the specific person;

repeating the generating, identifying, selecting and statistically analyzing one or more times to generate one or more further reference classifier profiles of the face associated with the specific person;

normalizing the reference classifier profiles to determine normalized face classifiers of an average face associated with the specific person;

generating a face recognition profile for the specific person based on the normalized face classifiers of the average face of the specific person; and

programming the processor such that when a probability exceeds a predetermined threshold that an identified face corresponds to the specific person associated with the face recognition profile, then the processor initiates a workflow, image processing or other pre- or post-image acquisition action on the portable camera-enabled device based on the recognition of the face as belonging to the specific person.

2. The method of claim 1 , wherein the different images comprise two or more different poses of the face.

3. The method of claim 2 , wherein the different images comprises two or more different lighting conditions of the face.

4. The method of claim 1 , wherein the different images comprises two or more different lighting conditions of the face.

5. The method of claim 1 , wherein the statistically analyzing comprises determining mean and variance values for the sets of classifiers.

6. The method of claim 1 , further comprising tracking said face within the plurality of the relatively low resolution images.

7. The method of claim 6 , wherein the selecting comprises aligning face region subwindows and determining probabilities for classifiers based upon which the sets of classifiers are selected.

8. The method of claim 6 , wherein the tracking is performed in parallel with determining whether the identified face corresponds to the specific person.

9. The method of claim 1 , further comprising determining probabilities for classifiers based upon which the sets of classifiers are selected.

10. A portable camera-enabled device capable of in-camera face recognition and face recognition training of a specific face within acquired digital images, comprising:

a lens and an image sensor to acquire digital images;

a processor programmed by processor-readable code embedded within one or more digital storage media, wherein the processor-readable code comprises:

a face detector component to program the processor to identify a groups of pixels that correspond to a face within the digital images;

a face recognition training component to program the processor to generate a face recognition profile for a specific person determined by programming the processor to perform the following:

selecting sets of classifiers as matching the faces identified in the multiple different images;

statistically analyzing the sets of classifiers to generate a reference classifier profile of the face associated with the specific person;

repeating the generating, identifying, selecting and statistically analyzing one or more times to generate one or more further reference classifier profiles of the face associated with the specific person;

normalizing the reference classifier profiles to determine normalized face classifiers of an average face associated with the specific person;

a face recognition component to determine when a probability exceeds a predetermined threshold that an identified face corresponds to the specific person associated with the face recognition profile, and to initiate a workflow, image processing or other pre- or post-image acquisition action on the portable camera-enabled device when the face belonging to the specific person is thereby recognized.

11. The device of claim 10 , wherein the multiple different images comprise two or more different poses of the face.

12. The device of claim 11 , wherein the multiple different images comprises two or more different lighting conditions of the face.

13. The device of claim 10 , wherein the multiple different images comprises two or more different lighting conditions of the face.

14. The device of claim 10 , wherein the multiple statistically analyzing comprises determining mean and variance values for the sets of classifiers.

15. The device of claim 10 , wherein the processor-readable code further comprises a face tracker component to program the processor to track said face within a plurality of images.

16. The device of claim 15 , wherein the selecting comprises aligning face region subwindows and determining probabilities for classifiers based upon which the sets of classifiers are selected.

17. The device of claim 15 , wherein the face tracking and recognition components are configured to operate simultaneously.

18. The device of claim 10 , wherein the processor-readable code further for programming the processor to determine probabilities for classifiers based upon which the sets of classifiers are selected.

19. One or more non-transitory processor-readable storage media having code embedded therein for programming a processor to perform a method of in-camera face recognition training of a specific face within digital images acquired with a portable camera-enabled device, wherein the method comprises:

using a processor of a portable camera-enabled device; generating in the device, capturing or otherwise obtaining in the device multiple different images that include a face of a specific person;

identifying groups of pixels that correspond to the face within the multiple different images;

selecting sets of classifiers as matching the faces identified in the multiple different images;

statistically analyzing the sets of classifiers to generate a reference classifier profile of the face associated with the specific person;

repeating the generating, identifying, selecting and statistically analyzing one or more times to generate one or more further reference classifier profiles of the face associated with the specific person;

normalizing the reference classifier profiles to determine normalized face classifiers of an average face associated with the specific person;

generating a face recognition profile for the specific person based on the normalized face classifiers of the average face of the specific person; and

programming the processor such that when a probability exceeds a predetermined threshold that an identified face corresponds to the specific person associated with the face recognition profile, then the processor initiates a workflow, image processing or other pre- or post-image acquisition action on the portable camera-enabled device based on the recognition of the face as belonging to the specific person.

20. The one or more processor-readable storage media of claim 19 , wherein the different images comprise two or more different poses of the face.

21. The one or more processor-readable storage media of claim 20 , wherein the different images comprises two or more different lighting conditions of the face.

22. The one or more processor-readable storage media of claim 19 , wherein the different images comprises two or more different lighting conditions of the face.

23. The one or more processor-readable storage media of claim 19 , wherein the statistically analyzing comprises determining mean and variance values for the sets of classifiers.

24. The one or more processor-readable storage media of claim 19 , wherein the method further comprises tracking said face within the plurality of the relatively low resolution images.

25. The one or more processor-readable storage media of claim 24 , wherein the selecting comprises aligning face region subwindows and determining probabilities for classifiers based upon which the sets of classifiers are selected.

26. The one or more processor-readable storage media of claim 24 , wherein the tracking is performed in parallel with determining whether the identified face corresponds to the specific person.

27. The one or more processor-readable storage media of claim 19 , wherein the method further comprises determining probabilities for classifiers based upon which the sets of classifiers are selected.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2025
From: FOTONATION LIMITED
To: ADEIA IMAGING LLC
Reel/Frame 073635/0320 →
SECURITY INTEREST Recorded May 3, 2023
From: ADEIA GUIDES INC.; ADEIA IMAGING LLC; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR ADVANCED TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC; ADEIA SOLUTIONS LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063529/0272 →
CHANGE OF NAME Recorded Dec 3, 2014
From: DIGITALOPTICS CORPORATION EUROPE LIMITED
To: FOTONATION LIMITED
Reel/Frame 034524/0693 →
CHANGE OF NAME Recorded Sep 22, 2011
From: TESSERA TECHNOLOGIES IRELAND LIMITED
To: DIGITALOPTICS CORPORATION EUROPE LIMITED
Reel/Frame 026949/0064 →
CHANGE OF NAME Recorded Dec 31, 2010
From: FOTONATION IRELAND LIMITED
To: TESSERA TECHNOLOGIES IRELAND LIMITED
Reel/Frame 025570/0547 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2010
From: BIGIOI, PETRONEL; CORCORAN, PETER
To: FOTONATION IRELAND LTD.
Reel/Frame 023997/0918 →