IP Library Granted Patent US 9,465,443
Granted Patent B2
US 9,465,443 · App. 13/921,558 · Granted Oct 11, 2016

Gesture operation input processing apparatus and gesture operation input processing method

Inventor: Shinichi Hirata (Kanagawa, JP)
Assignees: Sony Corporation; Sony Interactive Entertainment In.
G06F3/017G06F3/0304
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,465,443
App. No.
13/921,558
Granted
Oct 11, 2016
Kind
B2
Abstract

An instruction point extraction unit extracts an instruction point of a user from an image in which a gesture of the user made while the user is looking at a display is captured. A distance calculation unit obtains a distance to the instruction point in the depth direction. A gesture recognition parameter adjustment unit adjusts a parameter related to detection sensitivity in the depth direction when operation input by the gesture of the user is recognized, based on at least one of resolution of distance measurement in the depth direction and three-dimensional display performance of a display. A gesture recognition processing unit recognizes the operation input by the gesture of the user based on the adjusted parameter in reference to the distance to the instruction point in the depth direction calculated by the distance calculation unit.

Claims (22)

1. A gesture operation input processing apparatus comprising:

an instruction point extraction unit configured to extract an instruction point of a user from an image in which a gesture of the user made while the user is looking at a display is captured;

a distance calculation unit configured to obtain a distance to the instruction point in the depth direction;

a parameter adjustment unit configured to adjust a parameter related to detection sensitivity in the depth direction when operation input by the gesture of the user is recognized, based on at least one of resolution of distance measurement in the depth direction and three-dimensional display performance of a display; and

a gesture recognition processing unit configured to recognize the operation input by the gesture of the user based on the adjusted parameter, and to detect whether the instruction point of the user passes through one or more of a plurality of virtual screens set in the depth direction, based on the distance to the instruction point in the depth direction calculated by the distance calculation unit,

wherein the parameter adjustment unit adjusts, as the parameter related to the detection sensitivity in the depth direction, at least one of an installed number, an installation interval, and dead band of the plurality of virtual screens provided in the depth direction for allowing the instruction point to pass through.

2. The gesture operation input processing apparatus according to claim 1 , wherein the gesture recognition processing unit activates the instruction point so as to recognize operation input entered by a gesture when the instruction point passes through one or more of the plurality of virtual screens.

3. The gesture operation input processing apparatus according to claim 1 , wherein the parameter adjustment unit makes, when the display allows for three-dimensional display compared to when the display allows for two-dimensional display, at least one adjustment of: increasing the installed number; reducing the installation interval; and reducing the dead band of the virtual screens.

4. The gesture operation input processing apparatus according to claim 1 , wherein the parameter adjustment unit sets, when the distance measurement in the depth direction is conducted by a measurement method of a TOF (time of flight) type, the installed number, the installation interval, and the dead band of the virtual screens to be constant with respect to the distance in the depth direction.

5. The gesture operation input processing apparatus according to claim 1 , wherein, when the distance measurement in the depth direction is conducted by a measurement method of a triangulation type, the parameter adjustment unit sets the installed number, the installation interval, and the dead band of the virtual screens to be variable with respect to the distance in the depth direction.

6. A gesture operation input processing method in a three-dimensional gesture input system provided with an interface for supporting operation input entered by a gesture of a user, the method comprising:

extracting an instruction point of a user from an image in which a gesture of the user made while the user is looking at a display is captured;

obtaining a distance to the instruction point in the depth direction;

adjusting a parameter related to detection sensitivity in the depth direction when operation input by the gesture of the user is recognized, based on at least one of resolution of distance measurement in the depth direction and three-dimensional display performance of a display; and

recognizing the operation input by the gesture of the user based on the adjusted parameter, and to detect whether the instruction point of the user passes through one or more of a plurality of virtual screens set in the depth direction, based on the distance to the instruction point in the depth direction,

wherein the adjusting step includes adjusting, as the parameter related to the detection sensitivity in the depth direction, at least one of an installed number, an installation interval, and dead band of the plurality of virtual screens provided in the depth direction for allowing the instruction point to pass through.

7. A non-transitory computer-readable recording medium storing a computer program, comprising:

a module configured to extract an instruction point of a user from an image in which a gesture of the user made while the user is looking at a display is captured;

a module configured to obtain a distance to the instruction point in the depth direction;

a module configured to adjust a parameter related to detection sensitivity in the depth direction when operation input by the gesture of the user is recognized, based on at least one of resolution of distance measurement in the depth direction and three-dimensional display performance of a display; and

a module configured to recognize the operation input by the gesture of the user based on the adjusted parameter, and to detect whether the instruction point of the user passes through one or more of a plurality of virtual screens set in the depth direction, based on the distance to the instruction point in the depth direction,

wherein the module configured to adjust adjusts, as the parameter related to the detection sensitivity in the depth direction, at least one of an installed number, an installation interval, and dead band of the plurality of virtual screens provided in the depth direction for allowing the instruction point to pass through.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2016
From: SONY INTERACTIVE ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 039687/0216 →
CHANGE OF NAME Recorded Sep 9, 2016
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 039687/0245 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2013
From: HIRATA, SHINICHI
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 030644/0991 →
Priority Claims (1)
JP 2010-290717 · Dec 27, 2010 · national
Continuity (2)
Continuation PCTJP2011007089 · Dec 19, 2011
Related Publication 20130278503A1 · Oct 24, 2013