Detecting facial expressions in digital images
A method and system for detecting facial expressions in digital images and applications therefore are disclosed. Analysis of a digital image determines whether or not a smile and/or blink is present on a person's face. Face recognition, and/or a pose or illumination condition determination, permits application of a specific, relatively small classifier cascade.
1. A method of in-camera processing to provide an increased number of smiling faces in a recorded digital image of a group of faces, comprising:
acquiring one or more digital images; and
providing in-camera processing which automatically:
identifies one or more faces in a first one of the images;
from among the one or more faces, identifies a particular number of non-smiling faces; and
based, at least in part, on the particular number, initiates one or more operations when a predetermined minimum number of non-smiling faces are in the first image, said one or more operations including:
delaying recording of an image until the number of non-smiling faces in a subsequently acquired image is less than the predetermined number and, when the number of non-smiling faces in a subsequently acquired image is less than the predetermined number,
forming a composite image, based on the subsequently acquired image and one or more of the other images, to further reduce the number of non-smiling faces by replacing a face region in the subsequently acquired image with a face region in one of the one or more of the other images; and
recording the composite image as digital content in a storage medium.
2. The method of claim 1 wherein the one or more operations are initiated in response to the particular number being above a threshold number.
3. The method of claim 1 wherein:
the method further comprises determining that a particular percentage of the plurality of faces are smiling; and
the one or more operations are initiated in response to determining that the particular percentage is less than a threshold percentage.
4. The method of claim 1 wherein the one or more operations include issuing a warning beep.
5. The method of claim 1 wherein the one or more images include a stream of preview images.
6. The method of claim 5 , wherein:
the method further comprises determining that a particular percentage of the plurality of faces are smiling,
the one or more operations are initiated in response to determining that the particular percentage is less than a threshold percentage; and
the composite image is of higher resolution than images in the stream of preview images.
7. A portable digital image acquisition device, including a lens and an image sensor for acquiring digital images, a processor, and one or more processor-readable media having code embedded therein for programming the processor to perform a method that provides an increased number of smiling faces in a recorded digital image of a group of faces, wherein the method comprises:
acquiring one or more digital images; and
providing in-camera processing which automatically:
identifies one or more faces in a first one of the images;
from among the one or more faces, identifies a particular number of non-smiling faces; and
based, at least in part, on the particular number, initiates one or more operations when a predetermined minimum number of non-smiling faces are in the first image, said one or more operations including:
delaying recording of an image until the number of non-smiling faces in a subsequently acquired image is less than the predetermined number and, when the number of non-smiling faces in a subsequently acquired image is less than the predetermined number,
forming a composite image, based on the subsequently acquired image and one or more of the other images, to further reduce the number of non-smiling faces by replacing a face region in the subsequently acquired image with a face region in one of the one or more of the other images; and
recording the composite image as digital content in a storage medium.
8. The device of claim 7 wherein the one or more operations are initiated in response to the particular number being above a threshold number.
9. The device of claim 7 wherein:
the method further comprises determining that a particular percentage of the plurality of faces are smiling; and
the one or more operations are initiated in response to determining that the particular percentage is less than a threshold percentage.
10. The device of claim 7 wherein the one or more operations include issuing a warning beep.
11. The device of claim 7 wherein the one or more images include a stream of preview images.
12. The device of claim 11 , wherein:
the method further comprises determining that a particular percentage of the plurality of faces are smiling, the one or more operations are initiated in response to determining that the particular percentage is less than a threshold percentage; and
the composite image is of higher resolution than images in the stream of preview images.
13. One or more non-transitory processor-readable media having code embedded therein for programming a processor to perform a method of in-camera processing, the method providing an increased number of smiling faces in a recorded digital image of a group of faces, the method comprising:
acquiring one or more digital images; and
providing in-camera processing which automatically:
identifies one or more faces in a first one of the images;
from among the one or more faces, identifies a particular number of non-smiling faces; and
based, at least in part, on the particular number, initiates one or more operations when a predetermined minimum number of non-smiling faces are in the first image, said one or more operations including:
delaying recording of an image until the number of non-smiling faces in a subsequently acquired image is less than the predetermined number and, when the number of non-smiling faces in a subsequently acquired image is less than the predetermined number,
forming a composite image, based on the subsequently acquired image and one or more of the other images, to further reduce the number of non-smiling faces by replacing a face region in the subsequently acquired image with a face region in one of the one or more of the other images; and
recording the composite image as digital content in a storage medium.
14. The one or more processor-readable media of claim 13 wherein the one or more operations are initiated in response to the particular number being above a threshold number.
15. The one or more processor-readable media of claim 13 wherein:
the method further comprises determining that a particular percentage of the plurality of faces are smiling; and
the one or more operations are initiated in response to determining that the particular percentage is less than a threshold percentage.
16. The one or more processor-readable media of claim 13 wherein the one or more operations include issuing a warning beep.