Granted Patent B2

US 9,529,523 · App. 14/268,926 · Granted Dec 27, 2016

Inventor: Tong Luo (Fremont, CA)

Assignee: Handscape Inc.

G06F3/0488G06F3/0418

Abstract

Claims (72)

1. A method for controlling an input from a user to a computerized system including a touchpad, the method comprising:

obtaining data from the touchpad, the data being associated with the location and movement of arbitrarily positioned fingers and/or a hand of the user and not associated with an image of said fingers from an image sensor, when the user operates the computerized system using the touchpad;

communicating the data from the touchpad to the computerized system;

analyzing the data in accordance with a model of a human hand;

determining, using the model, that at least one identified finger of the user is positioned above but not touching a first control region of the touchpad;

determining that the at least one identified finger is subsequently touching the first control region in accordance with the data and the model after the at least one identified finger is positioned above but not touching the first control region; and

storing a record that the at least one identified finger is subsequently touching the first control region within a first period of time less than or equal to 10 seconds after the at least one identified finger is positioned above but not touching the first control region.

2. The method of claim 1 further comprising:

assigning the data to at least one of a plurality of identified fingers of the model;

computing a first graphical representation of the at least one identified finger of the user in accordance with the model; and

displaying the first graphical representation on a display screen of the computerized system.

3. The method of claim 2 , wherein analyzing the data and assigning the data includes determining if the data may be assigned to one or more finger or hand portions on the model according to a rotation transformation operation upon at least a portion of the data.

4. The method of claim 1 further comprising:

generating an audible signal when the at least one identified finger of the user is positioned above but not touching the first control region.

5. The method of claim 1 further comprising:

determining, using the model, that a plurality of identified fingers of the user are positioned above but not touching a first control region of the touchpad.

6. The method of claim 5 further comprising:

determining that the plurality of identified fingers are subsequently touching the first control region in accordance with the data and the model after the plurality of identified fingers of the user are positioned above but not touching the first control region.

7. The method of claim 6 further comprising:

determining a motion of a first identified finger in relation to a motion of a second identified finger different than the first identified finger; and

assigning a command to control the computerized system in accordance with the determined motion.

8. The method of claim 1 further comprising:

determining that the at least one identified finger is initially touching the first control region in accordance with the data and the model before the at least one identified finger is positioned above but not touching the first control region.

9. The method of claim 8 further comprising:

generating a first graphical representation on a display screen of the computerized system, the first graphical representation being associated with the first control region;

displaying the first graphical representation with a first appearance when the at least one identified finger is initially touching the first control region; and

displaying the first graphical representation with a second appearance different than the first appearance when the at least one identified finger is positioned above but not touching the first control region.

10. The method of claim 9 , wherein the second appearance includes a difference from the first appearance, the difference being associated with at least one of a size, a color, a position, a shape, or a display type.

11. The method of claim 1 further comprising: determining that the at least one identified finger is subsequently touching the first control region in accordance with the data and the model after the at least one identified finger is positioned above but not touching the first control region.

12. The method of claim 11 further comprising:

generating a first graphical representation on a display screen of the computerized system, the first graphical representation being associated with the first control region;

displaying the first graphical representation with a first appearance when the at least one identified finger is positioned above but not touching the first control region; and

displaying the first graphical representation with a second appearance different than the first appearance when the at least one identified finger is subsequently touching the first control region.

13. The method of claim 12 , wherein the second appearance includes a difference from the first appearance, the difference associated with at least one of a size, a color, a position, a shape, or a display type.

14. The method of claim 12 , wherein the touchpad is located in a location that is different from the location of the display screen.

15. The method of claim 12 , wherein the touchpad is located in a location that is substantially the same as the location of the display screen.

16. The method of claim 11 further comprising:

storing a record that the at least one identified finger is subsequently touching the first control region.

17. The method of claim 11 further comprising:

determining that the at least one identified finger is moving or sliding on the first control region after subsequently touching the first control region within a first period of time less than or equal to 10 seconds after the at least one identified finger is positioned above but not touching the first control region; and storing a record of the moving or sliding of the at least one identified finger.

18. The method of claim 11 further comprising:

determining that the at least one identified finger is moving or sliding on the first control region after subsequently touching the first control region; and

storing a record of the moving or sliding of the at least one identified finger.

19. The method of claim 18 further comprising:

generating a first graphical representation on a display screen of the computerized system, the first graphical representation being associated with the first control region, wherein the first control region includes a length substantially greater than the longitudinal length of a surface region of the at least one identified finger when contacting the touchpad.

20. The method of claim 1 , wherein the computerized system is a handheld computerized device, a computerized system in a vehicle, or a wearable computerized device.

21. The method of claim 1 , wherein the computerized system is a handheld computerized device, and the touchpad is located on a side of the handheld computerized device that is different from the side of the handheld computerized device that displays the display screen, the display screen being non-transparent.

22. The method of claim 21 further comprising:

designating a portion of the touchpad temporarily as a non-control region for holding the handheld computerized device without controlling an input when the user touches the non-control region.

23. The method of claim 1 further comprising:

storing the data over a plurality of time intervals to form a history of recent identified finger positions; determining an approximate identified fingertip location or fingertip identity of an identified fingertip that is not touching the touchpad at a present time interval according to the history and data from the touchpad obtained at the present time interval.

24. The method of claim 1 further comprising:

distinguishing a distance between at least one finger of the user and a surface of the touchpad; and detecting the location and movement of a finger and/or hand of the user to include in the data when the distance is greater than zero.

25. A method for controlling an input from a user to a computerized system including a touchpad, the method comprising:

obtaining data from the touchpad, the data being associated with the location and movement of arbitrarily positioned fingers and/or a hand of the user and not associated with an image of said fingers from an image sensor, when the user operates the computerized system using the touchpad;

communicating the data from the touchpad to the computerized system;

analyzing the data in accordance with a model of a human hand;

determining, using the model, that at least one identified finger of the user is positioned above but not touching a first control region of the touchpad;

determining that the at least one identified finger is initially touching the first control region in accordance with the data and the model before the at least one identified finger is positioned above but not touching the first control region;

generating a first graphical representation on a display screen of the computerized system, the first graphical representation being associated with the first control region;

displaying the first graphical representation with a first appearance when the at least one identified finger is initially touching the first control region; and

displaying the first graphical representation with a second appearance different than the first appearance when the at least one identified finger is positioned above but not touching the first control region;

wherein the displaying the first graphical representation with a second appearance occurs for a first period of time less than or equal to 10 seconds.

26. A method for controlling an input from a user to a computerized system including a touchpad, the method comprising:

obtaining data from the touchpad, the data being associated with the location and movement of arbitrarily positioned fingers and/or a hand of the user and not associated with an image of said fingers from an image sensor, when the user operates the computerized system using the touchpad;

communicating the data from the touchpad to the computerized system;

analyzing the data in accordance with a model of a human hand;

determining, using the model, that at least one identified finger of the user is positioned above but not touching a first control region of the touchpad;

determining that the at least one identified finger is subsequently touching the first control region in accordance with the data and the model after the at least one identified finger is positioned above but not touching the first control region;

determining that the at least one identified finger is moving or sliding on the first control region after subsequently touching the first control region;

storing a record of the moving or sliding of the at least one identified finger; and

generating a first graphical representation on a display screen of the computerized system, the first graphical representation being associated with the first control region, wherein the first control region includes a length substantially greater than the longitudinal length of a surface region of the at least one identified finger when contacting the touchpad.

Assignments (1)

Continuity (9)