IP Library Granted Patent US 8,793,621
Granted Patent B2
US 8,793,621 · App. 11/936,778 · Granted Jul 29, 2014

Method and device to control touchless recognition

Inventor: Marc Andre Boillot (Plantation, FL)
Assignee: NaviSense
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,793,621
App. No.
11/936,778
Granted
Jul 29, 2014
Kind
B2
Abstract

A sensor device ( 100 ) and method ( 300 ) for touchless finger signing and recognition is provided. The method can include detecting ( 304 ) a first pause of a finger in a touchless sensory space ( 101 ), tracking ( 306 ) a movement ( 140 ) of the finger, detecting ( 308 ) a second pause of the finger, creating ( 310 ) a trace ( 145 ) of the finger movement from the tracking, and recognizing ( 312 ) a pattern ( 146 ) from the trace. The pattern can be an alphanumeric character or a finger gesture. A user can accept or reject the recognized pattern via touchless finger control.

Claims (59)

1. A method for touchless character recognition, comprising:

detecting a first pause of a finger in a touchless sensory space at a first location;

after the first pause, tracking a movement of the finger in the touchless sensory space;

detecting a second pause of the finger in the touchless sensory space at a second location;

after the second pause, creating a trace of the finger movement between the first pause and the second pause from the tracking;

recognizing a pattern from the trace, wherein the pattern is an alphanumeric character or a finger gesture;

presenting the pattern in response to the second pause at the second location; and

consequently thereafter providing a finger gesture detection state to accept or reject the pattern, consisting of:

detecting a returning movement of the finger from the second location upon release of the second pause to the first location of the trace coinciding with the first pause for accepting the pattern corresponding to the trace,

detecting a finger discard action comprising a finger movement away from the first location for rejecting the pattern: and

either accepting the pattern corresponding to the trace when the returning movement is detected towards and returns to the first location, or rejecting the pattern when the finger action is directed away from the first location.

2. The method of claim 1 , wherein the step of creating the trace comprises generating a differential trajectory for an x, y, and a z component along three dimensions of an ultrasonic sensing field producing the touchless senory space and providing touchless control.

3. The method of claim 1 , further comprising:

wherein the finger discard action is at least one of an up and down finger movement in the touchless sensory space, a finger swipe movement in the touchless sensory space, a jitter finger movement in the touchless sensory space, or a finger sweep movement in the touchless sensory space.

4. The method of claim 1 , further comprising:

presenting the pattern in response to the second pause;

detecting a finger confirm action; and

accepting the pattern,

wherein the finger confirm action is at least one of an up and down finger movement in the touchless sensory space, a finger swipe movement in the touchless sensory space, a jitter finger movement in the touchless sensory space, or a finger sweep movement in the touchless sensory space.

5. The method of claim 1 , further comprising:

performing a software action in response to recognizing the finger gesture.

6. A method for touchless finger gesturing, comprising:

at a first time, upon detecting a first pause proceeded by detecting a finger at a first location in a touchless sensory space;

tracking a movement of the finger in the touchless sensory space;

at a second time, detecting the finger at a second location in the touchless sensory space proceeded by a second pause;

creating a trace of the finger movement between the first location and the second location from the tracking;

during the second pause, recognizing a pattern from the trace and presenting the pattern in response to detecting the finger the second time at the second location; and

consequently thereafter providing a finger gesture detection state to accept or reject the pattern, consisting of:

detecting a return movement of the finger from the second location upon release of the second pause to the first location of the trace for accepting the pattern corresponding to the trace,

detecting a finger discard action comprising a finger movement away from the first location for rejecting the pattern; and,

either accepting the pattern corresponding to the trace when the returning movement is detected towards and returns to the first location, or rejecting the pattern when the finger action is directed away from the first location.

7. The method of claim 6 , further comprising:

detecting a continued pause of the finger at the second location; and

rejecting the pattern.

8. The method of claim 6 , further comprising:

performing continuous pattern recognition of finger movements based on a returning of the finger to a center location in the touchless sensory space.

9. The method of claim 6 , wherein the first location in the touchless sensory space corresponds to a center region in a display presenting the trace.

10. The method of claim 6 , further comprising:

detecting a second pause at the first location; and

repeating the method for touchless finger gesturing.

11. A mobile device suitable for touchless finger signing having a

a sensor device for tracking a movement of a finger in a touchless sensing space; and

a recognition engine for

detecting a first pause of a finger in a touchless sensory space at a first location;

after the first pause, tracking a movement of the finger in the touchless sensory space;

detecting a second pause of the finger in the touchless sensory space at a second location;

after the second pause, creating a trace of the finger movement between the first pause and the second pause from the tracking; and

during the second pause identifying at least one pattern in the trace, wherein the pattern is an alphanumeric character, letter, finger gesture or symbol

also during the second a se presenting the pattern in response to the second pause at the second location; and

consequently thereafter providing a finger gesture detection state to accept or reject the pattern, consisting of:

detecting a return movement of the finger from the second location to the first location of the trace upon release of the second pause for accepting and processing the pattern to provide touchless user interface,

detecting a finger discard action comprising a finger movement away from the first location for rejecting the pattern and

either accepting the pattern corresponding to the trace when the returning movement is detected towards and returns to the first location or rejecting the pattern when the finger action is directed away from the first location.

12. The mobile device of claim 11 , further comprising a controller for creating the trace from the movement, wherein the trace is a differential trajectory that incorporates spatial and temporal information.

13. The mobile device of claim 12 , wherein the recognition engine includes a neural network that processes the trace and classifies the at least one pattern as an alphanumeric character or a finger gesture.

14. The mobile device of claim 11 , further comprising a display for presenting the pattern.

15. The mobile device of claim 14 , wherein the mobile device is a cell phone, a portable music player, a laptop, a headset, or an earpiece.

16. The mobile device of claim 11 , further comprising an audio module for audibly presenting the at least one pattern.

17. The mobile device of claim 16 , wherein the audio module includes a voice recognition engine for recognizing a voice command and accepting or rejecting the pattern in response to the voice command.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2010
From: MARC BOILLOT / JASON MCINTOSH
To: NAVISENSE, LLC
Reel/Frame 024420/0440 →
Continuity (3)
Provisional Application 60865167 · Nov 9, 2006
Provisional Application 60865166 · Nov 9, 2006
Related Publication 20080111710A1 · May 15, 2008