IP Library Granted Patent US 7,844,085
Granted Patent B2
US 7,844,085 · App. 11/759,460 · Granted Nov 30, 2010

Pairwise feature learning with boosting for use in face detection

Assignee: Seiko Epson Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,844,085
App. No.
11/759,460
Granted
Nov 30, 2010
Kind
B2
Abstract

Systems and methods for training an AdaBoost based classifier for detecting symmetric objects, such as human faces, in a digital image. In one example embodiment, such a method includes first selecting a sub-window of a digital image. Next, the AdaBoost based classifier extracts multiple sets of two symmetric scalar features from the sub-window, one being in the right half side and one being in the left half side of the sub-window. Then, the AdaBoost based classifier minimizes the joint error of the two symmetric features for each set of two symmetric scalar features. Next, the AdaBoost based classifier selects one of the features from the set of two symmetric scalar features for each set of two symmetric scalar features. Finally, the AdaBoost based classifier linearly combines multiple weak classifiers, each of which corresponds to one of the selected features, into a stronger classifier.

Claims (28)

1. A method for detecting an object using an AdaBoost based classifier, such as a face, in a digital image, the method comprising the following acts:

selecting a sub-window of a digital image from a set of training sub-windows that are labeled as face or non-face sub-windows;

extracting multiple sets of two symmetric scalar features from the sub-window;

minimizing the joint error of the two symmetric features for each set of two symmetric scalar features;

selecting one of the features from the set of two symmetric scalar features for each set of two symmetric scalar features; and

linearly combining multiple weak classifiers, each of which corresponds to one of the selected features, into a stronger classifier.

2. The method as recited in claim 1 , wherein the act of minimizing the joint error of the two symmetric features comprises minimizing the joint error, E(f i , f i ), of the two symmetric features, (f i , f i ), in accordance with Equation 12, in order to arrive at the optimal pair of features, (f*, f *), in accordance with Equation 13.

3. The method as recited in claim 1 , wherein the act of selecting one of the features from the set of two symmetric scalar features comprises randomly selecting one of the features from the set of two symmetric scalar features.

4. The method as recited in claim 1 , wherein the act of selecting one of the features from the set of two symmetric scalar features comprises selecting one of the features from the set of two symmetric scalar features according to the locations of features in the left or right half side of the sub-window.

5. The method as recited in claim 4 , wherein the act of selecting one of the features from the set of two symmetric scalar features according to the locations of features in the left or right half side of the sub-window comprises selecting alternating left and right half side features.

6. The method as recited in claim 1 , wherein the act of selecting one of the features from the set of two symmetric scalar features comprises selecting one of the features from the set of two symmetric scalar features according to which feature has the smaller error.

7. The method as recited in claim 1 , wherein the AdaBoost based classifier is a gentle AdaBoost based classifier.

8. The method as recited in claim 1 , wherein the AdaBoost based classifier is a discrete AdaBoost based classifier.

9. The method as recited in claim 1 , wherein the AdaBoost based classifier is a real AdaBoost based classifier.

10. One or more non-transitory computer-readable media having computer-readable instructions thereon which, when executed, implement a method for training an AdaBoost based classifier for detecting faces in a digital image, the method comprising the following acts:

selecting a sub-window of a digital image from a set of training sub-windows that are labeled as face or non-face sub-windows;

extracting multiple sets of two symmetric scalar features from the sub-window, one being in the right half side and one being in the left half side of the sub-window;

minimizing the joint error of the two symmetric features for each set of two symmetric scalar features;

selecting one of the features from the set of two symmetric scalar features for each set of two symmetric scalar features; and

linearly combining multiple weak classifiers, each of which corresponds to one of the selected features, into a stronger classifier.

11. The one or more computer-readable media recited in claim 10 , wherein the act of minimizing the joint error of the two symmetric features comprises minimizing the joint error, E(f i , f i ), of the two symmetric features, (f i , f i ), in accordance with Equation 12, in order to arrive at the optimal pair of features, (f*, f *), in accordance with Equation 13.

12. The one or more computer-readable media recited in claim 10 , wherein the act of selecting one of the features from the set of two symmetric scalar features comprises randomly selecting one of the features from the set of two symmetric scalar features.

13. The one or more computer-readable media recited in claim 10 , wherein the act of selecting one of the features from the set of two symmetric scalar features comprises selecting one of the features from the set of two symmetric scalar features according to the locations of features in the left or right half side of the sub-window.

14. The one or more computer-readable media recited in claim 13 , wherein the act of selecting one of the features from the set of two symmetric scalar features according to the locations of features in the left or right half side of the sub-window comprises selecting alternating left and right half side features.

15. The one or more computer-readable media recited in claim 10 , wherein the act of selecting one of the features from the set of two symmetric scalar features comprises selecting one of the features from the set of two symmetric scalar features according to which feature has the smaller error.

16. The one or more computer-readable media recited in claim 10 , wherein the AdaBoost based classifier is a gentle AdaBoost based classifier.

17. The one or more computer-readable media recited in claim 10 , wherein the AdaBoost based classifier is a discrete AdaBoost based classifier.

18. The one or more computer-readable media recited in claim 10 , wherein the AdaBoost based classifier is a real AdaBoost based classifier.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2019
From: SEIKO EPSON CORPORATION
To: 138 EAST LCD ADVANCEMENTS LIMITED
Reel/Frame 050710/0121 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2007
From: EPSON CANADA, LTD.,
To: SEIKO EPSON CORPORATION
Reel/Frame 019488/0430 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2007
From: LU, JUWEI; ZHOU, HUI
To: EPSON CANADA, LTD.,
Reel/Frame 019395/0676 →
Continuity (1)
Related Publication 20080304714A1 · Dec 11, 2008