IP Library Granted Patent US 7,715,598
Granted Patent B2
US 7,715,598 · App. 11/492,076 · Granted May 11, 2010

Method for detecting facial expressions of a portrait photo by an image capturing electronic device

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,715,598
App. No.
11/492,076
Granted
May 11, 2010
Kind
B2
Abstract

In a method for detecting facial expressions of a portrait photo by an image capturing electronic device, a face captured in the portrait photo is detected. The position and range of the opened and closed facial features are detected, and the facial features within an identified range are magnified according to a specific proportion. A patch of facial features and their surroundings within a specific range is cut according to the magnified identified range, so that the patch can show a change of facial expressions and a specific range of their surroundings. A facial feature classifier is trained by a specific number of opened and closed facial feature samples based on the Adaboost algorithm and used for detecting the facial features in the patch to determine whether the facial feature is situated at an opened state or a closed state.

Claims (10)

1. A method for detecting facial expressions of a portrait photo by an image capturing electronic device, being used for an electronic image capturing device, and comprising the steps of:

capturing a current image;

detecting a position and a range of a human face on a portrait photo;

detecting a position and a range of an opened facial feature or a closed facial feature such as an eye or a mouth;

magnifying an identified range of a position of said facial feature according to a predetermined proportion, and cutting said facial feature and a patch within a predetermined surrounding range by said magnified identified range, and said patch being capable of showing a picture with a change of said facial feature and a facial expression in said predetermined surrounding range; and

training a facial expression detector by a predetermined number of opened or closed facial feature samples, and detecting an opened state or a closed state of said facial feature in said patch to determine whether or not said facial feature is situated at an opened state or a closed state.

2. The method of claim 1 , further comprising a step of issuing a warning signal when said facial feature in said patch is determined to be situated at a closed state.

3. The method of claim 1 , further comprising the steps of permitting a user to press a shutter of said electronic image capturing device to capture a portrait photo and saving said portrait photo into a memory or a storage device of said electronic image capturing device, if said facial feature in said patch is determined to be situated at an opened state.

4. The method of claim 1 , further comprising a step of capturing a current image if said facial feature does not exist in said image.

5. The method of claim 1 , further comprising a step of capturing a current image, if said opened and closed state of facial feature is determined as not existing in said image.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Nov 13, 2015
From: EAST WEST BANK
To: ARCSOFT, INC.; MULTIMEDIA IMAGE SOLUTION LIMITED; ARCSOFT (HANGZHOU) MULTIMEDIA TECHNOLOGY CO., LTD.; ARCSOFT (SHANGHAI) TECHNOLOGY CO., LTD.; ARCSOFT HANGZHOU CO., LTD.
Reel/Frame 037109/0027 →
SECURITY INTEREST Recorded Aug 14, 2014
From: ARCSOFT, INC.; ARCSOFT (SHANGHAI) TECHNOLOGY CO., LTD.; ARCSOFT (HANGZHOU) MULTIMEDIA TECHNOLOGY CO., LTD.; MULTIMEDIA IMAGE SOLUTION LIMITED; ARCSOFT HANGZHOU CO., LTD.
To: EAST WEST BANK
Reel/Frame 033535/0537 →
RELEASE OF SECURITY INTEREST Recorded Jul 19, 2011
From: EAST WEST BANK
To: ARCSOFT, INC.
Reel/Frame 026616/0643 →
SECURITY AGREEMENT Recorded Apr 13, 2010
From: ARCSOFT, INC.
To: EAST WEST BANK
Reel/Frame 024218/0828 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 25, 2006
From: LI, SHU; WANG, JIN
To: ARCSOFT, INC.
Reel/Frame 018129/0977 →