IP Library Granted Patent US 8,064,704
Granted Patent B2
US 8,064,704 · App. 11/827,272 · Granted Nov 22, 2011

Hand gesture recognition input system and method for a mobile phone

Assignee: Samsung Electronics Co., Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,064,704
App. No.
11/827,272
Granted
Nov 22, 2011
Kind
B2
Abstract

A handheld gesture recognition control apparatus and its method are provided for a mobile phone. The input method of the present invention includes collecting a plurality of images; storing the images as control images; mapping the control images to corresponding control commands; capturing an image taken by a camera as a current image; comparing the current image to the control images; selecting one of the control images as a target control image according to a comparison result; extracting a control command mapped to the target control image; and executing the control command.

Claims (44)

1. An input method for a mobile phone, comprising:

storing a plurality of images as control images;

mapping the control images to corresponding control commands;

capturing an image taken by a camera as a current image;

comparing the captured current image to the control images;

selecting one of the control images as a target control image according to a comparison result;

extracting a control command corresponding to the target control image; and

executing the control command:

wherein selecting one of the control images as a target control image comprises:

determining whether a difference offset between the current image and the control images are less than a first threshold offset;

selecting the control images of which difference offset with the current image as candidate control images;

determining whether a difference offset between the current image and the candidate control images are less than a second threshold offset; and

selecting, if there is a candidate control image of which difference offset with the current image, the candidate control image as the target control image.

2. The input method of claim 1 , wherein the control images are hand gesture images.

3. The input method of claim 1 , wherein the control commands are commands for controlling pointer operations on a screen of the mobile phone.

4. The input method of claim 3 , wherein the pointer operations comprise:

pointer activation, inter-layer navigation, inter-window navigation on an identical layer, object flip, left click, and right click, in a three dimensional coordinate space defined with x, y, and z axes.

5. The input method of claim 1 , wherein mapping the control images to corresponding control commands comprises: building a lookup table having an index field, a control image filed, and control command field.

6. The input method of claim 1 , wherein executing the control command comprises:

turning on a screen of the mobile phone;

activating menu windows on the screen;

activating a pointer; and

controlling the pointer to executing a specific operation in association with the menu windows.

7. The input method of claim 6 , wherein the screen is implemented with a virtual three-dimensional space having a depth such that the menu windows are arranged in different depths or are arranged in the form of a perspective view.

8. The input method of claim 6 , wherein the screen presents shortcut icons for executing application programs, a navigation icon for indicating a current user view, and an icon list representing menu windows on a currently activated layer.

9. An input system for a mobile phone, comprising:

a camera for taking images to be used as control images and capturing an input image;

a memory for storing the control images and control commands mapped to the control images and for temporarily storing the input image;

a screen for displaying at least one menu window and operations of the menu window in accordance with the control commands; and

a controller for controlling a menu window operation in accordance with a control command selected by comparing the input image and the control images;

wherein selecting one of the control images as a target control image comprises:

determining whether a difference offset between the current image and the control images are less than a first threshold offset;

selecting the control images of which difference offset with the current image as candidate control images;

determining whether a difference offset between the current image and the candidate control images are less than a second threshold offset; and

selecting, if there is a candidate control image of which difference offset with the current image, the candidate control image as the target control image.

10. The input system of claim 9 , wherein the controller comprises:

an image generator for generating the control images from images taken by the camera;

a control image mapper for mapping the control images to the control commands;

an image comparator for selecting a target control image by comparing the input image with the control images; and

a control image adapter for executing the control commands mapped to the target control image.

11. The input system of claim 9 , wherein the screen is implemented with a virtual three-dimensional space having a depth such that the menu windows are arranged in different depths or are arranged in the form of a perspective view.

12. The input system of claim 9 , wherein the screen presents shortcut icons for executing application programs, a navigation icon for indicating a current user view, and an icon list representing menu windows on a currently activated layer.

13. The input system of claim 9 , wherein the controller controls a pointer for operations of the at least one menu window.

14. The input system of claim 13 , wherein the control command comprises a pointer activation command, inter-layer navigation command, inter-window navigation command, object flip command, left click command, and right click command, in a three-dimensional coordinate space defined with x, y, and z axes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2007
From: KIM, SANG HEON; KIM, TEA SUL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 019641/0537 →
Priority Claims (1)
KR 10-2006-0099062 · Oct 11, 2006 · national
Continuity (1)
Related Publication 20080089587A1 · Apr 17, 2008