IP Library › Granted Patent US 7,365,737
Granted Patent B2
US 7,365,737 · App. 10/807,567 · Granted Apr 29, 2008

Non-uniform gesture precision

Assignee: Fujitsu Limited
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,365,737
App. No.
10/807,567
Granted
Apr 29, 2008
Kind
B2
Abstract

A motion controlled handheld device includes a display having a viewable surface and operable to generate an image and a gesture database maintaining a plurality of gestures. Each gesture is defined by a motion of the device with respect to a first position of the device. The device includes a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a control module operable to identify a base reference position of the device, track movement of the device, using the motion detection module, to identify a potential gesture, compare the potential gesture against the gestures in the gesture database, and determine whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold.

Claims (92)

1. A motion controlled handheld device comprising:

a display having a viewable surface and operable to generate an image;

a gesture database maintaining a plurality of gestures, each gesture defined by a motion of the device with respect to a first position of the device;

a motion detection module operable to detect motion of the handheld device within three dimensions and to identify components of the motion in relation to the viewable surface; and

a control module operable to:

identify a base reference position of the device;

track movement of the device, using the motion detection module, to identify a potential gesture;

compare the potential gesture against the gestures in the gesture database;

determine whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold; and

wherein a level of precision required by the precision threshold is based at least in part on an environmental state of the device, the environmental state comprising a motion state describing an amount of background noise expected in the components of the motion.

2. The motion controlled handheld device of claim 1 , wherein the control module is further operable to:

identify a first precision threshold associated with a first set of the gestures;

identify a second precision threshold associated with a second set of the gestures, the second precision threshold requiring greater precision than the first precision threshold; and apply a selected one of the first precision threshold and the second precision threshold based upon whether the potential gesture potentially matches to one of the first set of the gestures or one of the second set of the gestures.

3. The motion controlled handheld device of claim 2 , wherein the first set of the gestures includes basic control gestures and the second set of the gestures includes security access gestures.

4. The motion controlled handheld device of claim 2 , wherein the second set of the gestures has a greater density of potential gestures within an area of space than the first set of the gestures.

5. The motion controlled handheld device of claim 1 , wherein the control module is further operable to:

determine that the potential gesture does not match to the compared gesture within the precision threshold; and

generate a prompt indicating failure of user input to precisely match to the compared gesture.

6. The motion controlled handheld device of claim 5 , wherein the control module is further operable to:

determine that the potential gesture matches to the compared gesture within a recognition threshold;

modify the image to display the compared gesture; and

generate the prompt to indicate a simplified gesture for confirming an intent to input the compared gesture.

7. The motion controlled handheld device of claim 1 , further comprising:

a first accelerometer operable to detect acceleration along a first axis;

a second accelerometer operable to detect acceleration along a second axis, the second axis perpendicular to the first axis; and

a third accelerometer operable to detect acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis; and wherein:

the gesture database further defines each of the gestures using a sequence of accelerations;

the motion detection module is further operable to detect motion of the device using accelerations measured by the first accelerometer, the second accelerometer, and the third accelerometer; and

the control module is further operable to match the accelerations measured by the motion detection module against gesture definitions in the gesture database to identify particular ones of the gestures.

8. A method for controlling a handheld device comprising:

generating an image on a viewable surface of the handheld device;

maintaining a gesture database comprising a plurality of gestures, each gesture defined by a motion of the device with respect to a first position of the device;

identifying a base reference position of the device;

tracking movement of the device in relation to the viewable surface to identify a potential gesture;

comparing the potential gesture against the gestures in the gesture database;

determining whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold; and

wherein a level of precision required by the precision threshold is based at least in part on an environmental state of the device, the environmental state comprising a motion state describing an amount of background noise expected in the components of the motion.

9. The method of claim 8 , further comprising:

identifying a first precision threshold associated with a first set of the gestures;

identifying a second precision threshold associated with a second set of the gestures, the second precision threshold requiring greater precision than the first precision threshold; and

applying a selected one of the first precision threshold and the second precision threshold based upon whether the potential gesture potentially matches to one of the first set of the gestures or one of the second set of the gestures.

10. The method of claim 9 , wherein the second set of the gestures has a greater density of potential gestures within an area of space than the first set of the gestures.

11. The method of claim 8 , further comprising:

determining that the potential gesture does not match to the compared gesture within the precision threshold; and

generating a prompt indicating failure of user input to precisely match to the compared gesture.

12. The method of claim 11 , further comprising:

determining that the potential gesture matches to the compared gesture within a recognition threshold;

modifying the image to display the compared gesture; and

generating the prompt to indicate a simplified gesture for confirming an intent to input the compared gesture.

13. The method of claim 8 , wherein the gesture database further defines each of the gestures using a sequence of accelerations; the method further comprising:

detecting acceleration along a first axis;

detecting acceleration along a second axis, the second axis perpendicular to the first axis; and

detecting acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis;

detecting motion of the device using accelerations measured by the first accelerometer, the second accelerometer, and the third accelerometer; and

matching the accelerations against gesture definitions in the gesture database to identify potential indicated ones of the gestures.

14. Logic for controlling a handheld device, the logic embodied as a computer program stored on a computer readable medium and operable when executed to perform the steps of:

generating an image on a viewable surface of the handheld device;

maintaining a gesture database comprising a plurality of gestures, each gesture defined by a motion of the device with respect to a first position of the device;

identifying a base reference position of the device;

tracking movement of the device in relation to the viewable surface to identify a potential gesture;

comparing the potential gesture against the gestures in the gesture database;

determining whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold; and

wherein a level of precision required by the precision threshold is based at least in part on an environmental state of the device, the environmental state comprising a motion state describing an amount of background noise expected in the components of the motion.

15. The logic of claim 14 , further operable when executed to perform the steps of:

determining that the potential gesture does not match to the compared gesture within the precision threshold; and

generating a prompt indicating failure of user input to precisely match to the compared gesture.

16. The logic of claim 15 , further operable when executed to perform the steps of:

determining that the potential gesture matches to the compared gesture within a recognition threshold;

modifying the image to display the compared gesture; and

generating the prompt to indicate a simplified gesture for confirming an intent to input the compared gesture.

17. The logic of claim 14 , wherein the gesture database further defines each of the gestures using a sequence of accelerations; the logic further operable when executed to perform the steps of:

detecting acceleration along a first axis;

detecting acceleration along a second axis, the second axis perpendicular to the first axis; and

detecting acceleration along a third axis, the third axis perpendicular to the first axis and perpendicular to the second axis;

detecting motion of the device using accelerations measured by the first accelerometer, the second accelerometer, and the third accelerometer; and

matching the accelerations against gesture definitions in the gesture database to identify potential indicated ones of the gestures.

18. The logic of claim 14 , further operable when executed to perform the steps of:

identifying a first precision threshold associated with a first set of the gestures;

identifying a second precision threshold associated with a second set of the gestures, the second precision threshold requiring greater precision than the first precision threshold; and

applying a selected one of the first precision threshold and the second precision threshold based upon whether the potential gesture potentially matches to one of the first set of the gestures or one of the second set of the gestures.

19. A motion controlled handheld device comprising:

means for generating an image on a viewable surface of the handheld device;

means for maintaining a gesture database comprising a plurality of gestures, each gesture defined by a motion of the device with respect to a first position of the device;

means for identifying a base reference position of the device;

means for tracking movement of the device in relation to the viewable surface to identify a potential gesture;

means for comparing the potential gesture against the gestures in the gesture database;

means for determining whether the potential gesture matches to a compared one of the gestures based on whether a difference between the potential gesture and the compared gesture is within a precision threshold; and

wherein a level of precision required by the precision threshold is based at least in part on an environmental state of the device, the environmental state comprising a motion state describing an amount of background noise expected in the components of the motion.

20. The motion controlled handheld device of claim 19 , further comprising:

means for identifying a first precision threshold associated with a first set of the gestures;

means for identifying a second precision threshold associated with a second set of the gestures, the second precision threshold requiring greater precision than the first precision threshold; and

means for applying a selected one of the first precision threshold and the second precision threshold based upon whether the potential gesture potentially matches to one of the first set of the gestures or one of the second set of the gestures.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2004
From: MARVIT, DAVID L.; REINHARDT, ALBERT H. M.
To: FUJITSU LIMITED
Reel/Frame 015655/0739 →
Continuity (1)
Related Publication 20050210418A1 · Sep 22, 2005