IP Library › Granted Patent US 11,893,161
Granted Patent B2
US 11,893,161 · App. 17/999,737 · Granted Feb 6, 2024

Gesture recognition based on user proximity to a camera

Inventor: Ikushi Yoda (Tsukuba, JP)
Assignee: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
G06F3/017G06T7/20H04N23/611
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,893,161
App. No.
17/999,737
Filed
Nov 23, 2022
Granted
Feb 6, 2024
Kind
B2
Examiner
YI, RINNA
Art Unit
2144
USPC
715/863
Abstract

A gesture recognition apparatus by which a gesture for an interface operation is performed includes an image capturer that captures distance image data, a closest point detector that detects a closest point from the imaging apparatus, a gesture measurer that calculates an input switching border for switching ON and OFF of interface input, a gesture recognizer that determines whether the input is ON or OFF, and an interface controller that performs the interface control associated with the gesture if it is determined that the input has been turned on.

Claims (24)

1. A gesture recognition apparatus recognizing a gesture of a user and performing interface control associated with the recognized gesture, the gesture recognition apparatus comprising:

a processor which, by executing instructions, function as:

an image capturer that sequentially captures distance image data taken by an imaging apparatus in which a user has been imaged, and outputs the input image data and the distance data on a display screen;

a closest point detector that detects, from the distance image data displayed on the display screen, a closest point from the imaging apparatus;

a gesture measurer that calculates an input switching border, which is currently displayed with the distance image data, a tracking area associated with recognizable gestures, a gesture guideline, and an origin of the gesture, for switching ON and OFF of interface input, based on a trajectory of the closest point that is the gesture of the user detected from a plurality of distance image data items;

a gesture recognizer that determines whether the input is ON or OFF, in accordance with the input switching border; and

an interface controller that performs the interface control associated with the gesture when it is determined that the input has been turned on, wherein

the gesture measurer detects start point of the gesture of the user as the origin and an OFF side of input, and

the gesture recognizer determines ON or OFF of input by determining whether the detected closest point resides in a space that includes the origin relative to the input switching border.

2. The gesture recognition apparatus according to claim 1 , wherein the gesture measurer comprises;

a tracking area determiner that detects, as the tracking area, a range in which the closest point to the distance image data items is detected, and in gesture recognition, the closest point detector detects the closest point in the tracking area determined by the tracking area determiner.

3. The gesture recognition apparatus according to the gesture recognition apparatus according to wherein, when the gesture recognizer detects that a time to detect the closest point on an ON side of input is equal to or greater than a predetermined time, the interface controller applies a long press on a predetermined interface.

4. The gesture recognition apparatus according to claim 1 , further comprising:

an associated gesture storage that stores the gesture; and

an interface associated with the gesture, wherein, when a plurality of gestures are stored, upon detection of the closest point, the gesture recognizer identifies with which gesture the point is associated through comparison with the input switching border.

5. The gesture recognition apparatus according to claim 1 , wherein the gesture measurer calculates the gesture guideline based on the trajectory of the detected closest point, and the gesture recognizer causes a display unit to display the gesture guideline on the display screen.

6. A gesture recognition method for recognizing a gesture of a user and performing interface control associated with the recognized gesture, the method comprising:

sequentially capturing, by an image capturer, distance image data taken by an imaging apparatus in which a user has been imaged, and outputting the input image data and the distance data on a display screen;

detecting, from the distance image data displayed on the display screen by a closest point detector, a closest point from the imaging apparatus;

calculating, by a gesture measurer, an input switching border, which is currently displayed with the distance image data, a tracking area associated with recognizable gestures, a gesture guideline, and an origin of the gesture, for switching ON and OFF of interface input, based on a trajectory of the closest point that is the gesture of the user detected from a plurality of distance image data items;

determining, by a gesture recognizer, whether the input is ON or OFF, in accordance with the input switching border; and

performing, by an interface controller, the interface control associated with the gesture when it is determined that the input has been turned on, wherein

detecting, by the gesture measurer, start point of the gesture of the user as the origin and an OFF side of input, and

determining, by the gesture recognizer, ON or OFF of input by determining whether the detected closest point resides in a space that includes the origin relative to the input switching border.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 23, 2022
From: YODA, IKUSHI
To: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
Reel/Frame 061992/0719 →
Priority Claims (1)
JP 2020-095436 · Jun 1, 2020 · national
Continuity (1)
Related Publication 20230168745A1 · Jun 1, 2023