IP Library Granted Patent US 7,844,921
Granted Patent B2
US 7,844,921 · App. 11/757,159 · Granted Nov 30, 2010

Interface apparatus and interface method

Assignee: Kabushiki Kaisha Toshiba
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,844,921
App. No.
11/757,159
Granted
Nov 30, 2010
Kind
B2
Abstract

An apparatus for a user to interface with a control object apparatus by a posture or a motion of the user's physical part. An image input unit inputs an image including the user's physical part. A gesture recognition unit recognizes the posture or the motion of the user's physical part from the image. A control unit controls the control object apparatus based on an indication corresponding to the posture or the motion. A gesture information display unit displays an exemplary image of the posture or the motion recognized for the user's reference to indicate the control object apparatus.

Claims (32)

1. An apparatus for interfacing with a control object apparatus, comprising:

an image input unit configured to input an image including a user's physical part;

a gesture recognition unit configured to recognize a posture or a motion of the user's physical part from the image;

a control unit configured to control the control object apparatus based on an indication corresponding to the posture or the motion; and

a gesture information display unit configured to display an exemplary image of the posture or the motion recognized by the gesture recognition unit, wherein the gesture recognition unit includes a gesture evaluation unit configured to calculate a probability that the posture or the motion is included in each partial region of the image;

a candidate region selection unit configured to select at least one partial region having a highest probability as a physical part candidate region; and

a gesture decision unit configured to decide that the posture or the motion is included in the physical part candidate region when the probability is above a threshold, which indication the posture or motion included in the physical part candidate region represents, and the gesture information display unit displays the posture or the motion recognized by the gesture recognition unit, the probability that the posture or motion is included in each partial region of the image, and a graph of a probability that the posture or the motion represents each indication.

2. The apparatus according to claim 1 , wherein the gesture information display unit displays an image of the physical part candidate region.

3. The apparatus according to claim 2 , wherein the gesture information display unit discriminately displays the image of the physical part candidate region based on the indication represented by the posture or the region.

4. The apparatus according to claim 1 , wherein the gesture information display unit discriminately displays the probability that the posture or the motion represents each indication.

5. The apparatus according to claim 1 , wherein the gesture information display unit additionally displays a mark of the threshold on the graph.

6. The apparatus according to claim 1 , wherein the gesture information display unit discriminately displays an exemplary image of the indication represented by the posture or the motion included in the physical part candidate region.

7. The apparatus according to claim 6 , wherein the gesture information display unit displays the exemplary image and the graph, each corresponding to the same indication.

8. The apparatus according to claim 7 , wherein the gesture information display unit displays a plurality of menus, a plurality of exemplary images, and a graph of each exemplary image, and discriminately displays at least one of the plurality of menus based on the indication.

9. A method for interfacing with a control object apparatus, comprising:

inputting an image including a user's physical part; recognizing a posture or a motion of the user's physical part from the image; controlling the control object apparatus based on an indication corresponding to the posture or the motion; and displaying an exemplary image of the posture or the motion recognized for a user's reference to indicate the control object apparatus,

wherein the recognizing includes calculating a probability that the posture or the motion is included in each partial region of the image;

selecting at least one partial region having a highest probability as a physical part candidate region; deciding that the posture or the motion is included in the physical part candidate region when the probability is above a threshold, deciding which indication the posture or the motion included in the physical part candidate region represents, and the displaying includes displaying the posture or the motion recognized, and the probability that the posture or motion is included in each partial region of the image, and a graph of a probability that the posture or the motion represents each indication.

10. A computer readable medium storing computer-readable instructions thereon for a control object apparatus, the computer-readable instructions when executed by the control object apparatus cause the control object apparatus to perform a method comprising:

inputting an image including a user's physical part;

recognizing a posture or a motion of the user's physical part from the image;

controlling the control object apparatus based on an indication corresponding to the posture or the motion; and

displaying an exemplary image of the posture or the motion recognized for the user's reference to indicate the control object apparatus,

wherein the recognizing includes

calculating a probability that the posture or the motion is included in each partial region of the image;

selecting at least one partial region having a highest probability as a physical part candidate region; and

deciding that the posture or the motion is included in the physical part candidate region when the probability is above a threshold,

deciding which indication the posture or motion included in the physical part candidate region represents, and

the displaying includes displaying

the posture or the motion recognized, and

the probability that the posture or motion is included in each partial region of the image, and

a graph of a probability that the posture or motion represents each indication.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2007
From: IKE, TSUKASA; TANIGUCHI, YASUHIRO; OKADA, RYUZO; KISHIKAWA, NOBUHISA; YOKOI, KENTARO; YUASA, MAYUMI; STENGER, BJORN
To: KABUSHIKI KAISHA TOSHIBA
Reel/Frame 019555/0819 →
Priority Claims (1)
JP P2006-229572 · Aug 25, 2006 · national
Continuity (1)
Related Publication 20080052643A1 · Feb 28, 2008