Free fingers typing technology
View Patent ↗The present invention provides the Free Fingers Typing Technology by fingers tapping on a surface, a technology that allows the user to type, point/select (on the display of a computer or computer-based-device) or play music with bare fingers without keyboard, without display pointing/selecting device and even without computer. The invention provides at least: one methodology to execute the finger movements, one convention to code the finger movements, two techniques to recognize the finger movements, a family of apparatus to optically monitor and recognize finger movements as well as the specifications of a plurality of related computer programs all used with the objective of interpreting finger-surface taps and converting them into computer characters, keyboard key strokes, functions of display-pointing/selecting device, music notes etc. . . . The invention provides means for free fingers typing, pointing/selecting and music playing suitable for all devices requiring a keyboard such as computers, personal digital assistants, cellular phones, gaming devices, musical instruments or other keyboard or display pointing/selecting based devices.
1. A method for producing user commands to execute on an information processing device, wherein said method is based on associating user commands with combinations of fingers and wherein said method comprises:
producing taps with the fingers on any surface,
acquiring optical images of said fingers and said surface,
detecting said fingers taps on said surface using image processing techniques,
identifying a combination of fingers by detecting a tap produced on a surface by said fingers all together at an instant t, and
executing, on the information processing device, the user commands associated to said combination of fingers wherein said user commands are not associated with locations of said surface.
2. The method of claim 1 wherein a finger-tap is recognized in steps including: recognizing when a finger enters in contact with the surface; recognizing that a finger is in contact with the surface; and recognizing when a finger leaves the surface.
3. The method of claim 1 wherein said taps are produced by combinations of fingers from two hands or from one hand only.
4. The method of claim 1 wherein the user can produce, with combinations of fingers, simultaneous single taps or simultaneous double taps and wherein the user command associated with a combination of fingers depends on whether the user hand palm is touching the tapping surface or not touching the tapping surface.
5. The method of claim 1 wherein the speed of movement of a finger preceding the tap and the duration of the contact of a finger with the surface are measured and exploited for producing user commands.
6. The method of claim 1 wherein the information processing device comprises one of a computer, a personal digital assistant, a cellular phone, a gaming device, a musical device, a computer based device, a keyboard and a display pointer/selector based device.
7. The method of claim 1 wherein the user commands include commands for the information processing device to carry out at least one of the following actions:
producing characters in any language;
responding as if a computer or musical instrument keyboard key, mouse button, pointer/selector button, joystick button, gaming device button has been pressed;
moving a pointer on a display; pointing to or selecting an object on a display; and
responding as if a pointer/selector, joystick, or gaming device button has been pressed.
8. The method of claim 1 wherein user commands are assigned to combinations of fingers by:
assigning codes to combinations of fingers; and
assigning user commands to codes of combinations of fingers.
9. The method according to claim 8 wherein said codes include ASCII character codes.
10. The method according to claim 8 wherein said codes can be codes assigned to each finger and codes assigned to combinations of:
left hand fingers when the hand palm touches the surface,
left hand fingers when the hand palm does not touch the surface,
right hand fingers when the hand palm touches the surface, and
right hand fingers when the hand palm does not touch the surface.
11. The method of claim 1 wherein the user is able to assign user defined commands to combinations of fingers.
12. Means making use of the method of claim 1 to produce user commands on an information processing device.
13. The means of claim 12 wherein means is used to send via wired or wireless connection user commands or user command codes to an information processing device.
14. The means of claim 12 based on means that can be attached to the user.
15. The means of claim 12 based on means that can be placed in the vicinity of the fingers.
16. The means of claim 12 based on means making use of CCD sensors, LED illumination, laser illumination or other optical devices.
17. A non-transitory machine-readable medium having executable instructions to cause one or more processing units to perform the method of claim 1 .