Detecting Facial Expressions in Digital Images
A method and system for detecting facial expressions in digital images and applications therefore are disclosed. Analysis of a digital image determines whether or not a smile and/or blink is present on a person's face. Face recognition, and/or a pose or illumination condition determination, permits application of a specific, relatively small classifier cascade.
1 . A computer-implemented method, comprising:
acquiring, using an imaging device, a plurality of images, each image of the plurality of images comprising a group of pixels corresponding to a face;
tracking the face within the plurality of images;
for at least one subset of images within the plurality of images:
determining, using at least one classifier, a feature classification for the subset of images; and
updating a confidence parameter based on the feature classification;
determining a feature decision based, at least in part, on the confidence parameter; and
initiating one or more operations based at least in part on the feature decision.
2 . The computer-implemented method of claim 1 , further comprising applying face recognition to the face.
3 . The computer-implemented method of claim 1 , further comprising training the at least one classifier based at least in part on a pose of the face.
4 . The computer-implemented method of claim 1 , further comprising training the at least one classifier based at least in part on an illumination condition of the face.
5 . The computer-implemented method of claim 1 , wherein the feature classification comprises a Haar feature.
6 . The computer-implemented method of claim 1 , wherein the feature classification comprises a census feature.
7 . The computer-implemented method of claim 1 , wherein the feature classification comprises a smile feature.
8 . The computer-implemented method of claim 7 , wherein determining the feature decision further comprises thresholding the feature decision such that the feature decision is selected from the group consisting of a smile, no smile, and inconclusive.
9 . The computer-implemented method of claim 1 , wherein the one or more operations comprises capturing an image.
10 . The computer-implemented method of claim 1 , further comprising:
determining a plurality of feature decisions corresponding to a plurality of faces; and
wherein the one or more operations comprises capturing an image based on the plurality of feature decision being satisfied for a threshold number of faces within the plurality of faces.
11 . An imaging device, comprising:
at least one imager;
a processor; and
a memory storing instructions that, when read by the processor, cause the imaging device to:
acquire, using the at least one imager, a plurality of images, each image of the plurality of images comprising a group of pixels corresponding to a face;
track the face within the plurality of images;
for at least one subset of images within the plurality of images:
determine, using at least one classifier, a feature classification for the subset of images; and
update a confidence parameter based on the feature classification;
determine a feature decision based, at least in part, on the confidence parameter; and
initiate one or more operations based at least in part on the feature decision.
12 . The imaging device of claim 11 , wherein the instructions, when read by the processor, further cause the imaging device to apply face recognition to the face.
13 . The imaging device of claim 11 , wherein the instructions, when read by the processor, further cause the imaging device to train at least one of the at least one classifier based at least in part on a pose of the face.
14 . The imaging device of claim 11 , wherein the instructions, when read by the processor, further cause the imaging device to train at least one of the at least one classifier based at least in part on an illumination condition of the face.
15 . The imaging device of claim 11 , wherein the feature classification comprises a Haar feature.
16 . The imaging device of claim 11 , wherein the feature classification comprises a census feature.
17 . The imaging device of claim 11 , wherein the feature classification comprises a smile feature.
18 . The imaging device of claim 17 , wherein the instructions, when read by the processor, further cause the imaging device to determine the feature decision based on thresholding the feature decision such that the feature decision is selected from the group consisting of a smile, no smile, and inconclusive.
19 . The imaging device of claim 11 , wherein the one or more operations comprises capturing an image.
20 . The imaging device of claim 11 , wherein:
the instructions, when read by the processor, further cause the imaging device to determine a plurality of feature decisions for a plurality of faces; and
the one or more operations comprises capturing an image based on the plurality of feature decision being satisfied for a threshold number of faces within the plurality of faces.