IP Library › Granted Patent US 9,298,977
Granted Patent B2
US 9,298,977 · App. 13/363,799 · Granted Mar 29, 2016

Information processing device, information processing method, and program for recognizing facial expression and permitting use of equipment based on the recognized facial emotion expression

Inventors: Junichi Rekimto (Kanagawa, JP); Hitomi Tsujita (Chiba, JP)
Assignee: Sony Corporation
G06K9/00308
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,298,977
App. No.
13/363,799
Granted
Mar 29, 2016
Kind
B2
Abstract

An information processing device includes a recognition unit which recognizes a facial expression of a user taken on a captured image, and a control unit which controls equipment to permit the user to use the equipment when the facial expression recognized by the recognition unit is a specific facial expression.

Claims (29)

1. An information processing device comprising:

a recognition unit which recognizes a facial emotion expression of a user taken on a captured image;

a control unit which controls equipment to permit the user to use the equipment when the facial emotion expression recognized by the recognition unit is a specific facial emotion expression; and

an output unit which outputs information indicating the specific facial emotion expression when the recognition unit recognizes the facial emotion expression as being the specific facial emotion expression, and outputs information indicating a different facial emotion expression that is different from the specific facial emotion expression when the recognition unit recognizes the facial emotion expression as not being the specific facial emotion expression, wherein the outputted information indicating the different facial emotion expression is not a reproduction of the captured image, and

wherein the recognition unit, the control unit, and the output unit are each implemented via at least one processor.

2. The information processing device according to claim 1 , further comprising:

a capturing unit which captures an image of the user,

wherein the recognition unit recognizes a facial emotion expression of the user taken on the image captured by the capturing unit, and

wherein the capturing unit is implemented via at least one processor.

3. The information processing device according to claim 1 , wherein the specific facial emotion expression is a smile.

4. The information processing device according to claim 1 , wherein, when the user finishes using the equipment, the control unit controls the equipment to set non-permission to the user to use the equipment.

5. An information processing method comprising:

recognizing a facial emotion expression of a user taken on a captured image;

controlling equipment to permit the user to use the equipment when the facial emotion expression recognized by the recognition unit is a specific facial emotion expression; and

outputting information indicating the specific facial emotion expression when the facial emotion expression is recognized as being the specific facial emotion expression, and outputting information indicating a different facial emotion expression that is different from the specific facial emotion expression when the facial emotion expression is recognized as not being the specific facial emotion expression,

wherein the outputted information indicating the different facial emotion expression is not a reproduction of the captured image.

6. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute processes comprising:

recognizing a facial emotion expression of a user taken on a captured image;

controlling equipment to permit the user to use the equipment when the facial emotion expression recognized by the recognition unit is a specific facial emotion expression;

outputting information indicating the specific facial emotion expression when the facial emotion expression is recognized as being the specific facial emotion expression, and outputting information indicating a different facial emotion expression that is different from the specific facial emotion expression when the facial emotion expression is recognized as not being the specific facial emotion expression,

wherein the outputted information indicating the different facial emotion expression is not a reproduction of the captured image.

7. The information processing device according to claim 1 , wherein the outputted information indicating the specific facial emotion expression is a visual notification of a positive recognition of the facial emotion expression being the specific facial emotion expression, and the outputted information indicating the different facial emotion expression is a visual notification of the facial emotion expression having not been recognized to be the specific facial emotion expression.

8. The information processing device according to claim 7 , wherein the specific facial emotion expression is a smile.

9. The information processing device according to claim 1 , wherein the information indicating the specific facial emotion expression and the information indicating the different facial emotion expression are each output respectively as an icon displayed to the user.

10. The information processing device according to claim 1 , wherein the control unit switches a state of the equipment between a locked state and an unlocked state, based on the recognized facial emotion expression.

11. The information processing device according to claim 1 , wherein when the facial emotion expression recognized by the recognition unit is the specific facial emotion expression, the control unit controls the equipment to permit the user to use the equipment by switching a state of the equipment from a locked state to an unlocked state.

12. The information processing device according to claim 1 , wherein when the facial emotion expression recognized by the recognition unit is the specific facial emotion expression, the control unit controls a function of the equipment to be activated or accessible by the user.

13. The information processing device according to claim 12 , wherein when the facial emotion expression recognized by the recognition unit is different from the specific facial emotion expression, the control unit controls the function of the equipment to be deactivated or inaccessible by the user.

14. The information processing device according to claim 1 , wherein the outputted information indicating the specific facial emotion expression is not a reproduction of the captured image.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST INVENTOR'S NAME PREVIOUSLY RECORDED ON REEL 027640 FRAME 0179. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE FROM "REKIMTO" TO "REKIMOTO". Recorded Feb 19, 2016
From: REKIMOTO, JUNICHI; TSUJITA, HITOMI
To: SONY CORPORATION
Reel/Frame 037858/0853 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2012
From: REKIMTO, JUNICHI; TSUJITA, HITOMI
To: SONY CORPORATION
Reel/Frame 027640/0179 →
Priority Claims (1)
JP 2011-027680 · Feb 10, 2011 · national
Continuity (1)
Related Publication 20120206603A1 · Aug 16, 2012