System and method for detecting hand gesture

1. A system for detecting hand and finger gesture, comprising:

a hand-held controller comprising a plurality of finger detectors, wherein the finger detectors are configured to obtain a plurality finger positions; and

a computing application, executed by a processor, configured to retrieve a spatial vector of the hand-held controller, and to retrieve the finger positions from the hand-held controller, wherein the spatial vector of the hand-held controller and the finger positions are provided to illustrate a simulated hand and finger gesture,

wherein the finger detectors are positioned on a plurality of detecting areas corresponding to fingers respectively, and

wherein the finger detectors comprise a first finger detector positioned on a first detecting area for detection of a first finger of a user;

the first finger detector comprises a proximity detector;

the first finger detector detects a first distance of the first finger from the first detecting area and a first angle of the first finger departing from an axis extended from the first detecting area;

a combination of the first distance and the first angle forms a first finger position; and

when the first finger of the user is pointing straight and away from the palm of the user, the processor receives the first finger position from the hand-held controller, and by executing the computing application generates the stimulated hand and finger gesture using the first finger position, wherein a first finger of the stimulated hand and finger gesture points straight and away from a palm of the stimulated hand and finger gesture.

2. The system of claim 1 , wherein the spatial vector of the hand-held controller comprises a position of the hand-held controller and an orientation of the hand-held controller, the hand-held controller further comprises an inertial measurement unit configured for sensing the position and the orientation of the hand-held controller.

3. The system of claim 1 , wherein the spatial vector of the hand-held controller is determined by an optical detector configured to track the hand-held controller.

4. The system of claim 1 , wherein the finger detectors comprise a touch detector, and wherein one of the finger positions is determined by detecting whether a finger contact is applied on the touch detector.

5. The system of claim 1 , wherein the finger detectors comprise a pressure detector, and wherein one of the finger positions is determined by detecting a touch pressure on the pressure detector.

6. The system of claim 1 , wherein the finger detectors comprise a proximity detector, wherein one of the finger positions is determined by detecting a distance between one finger and the proximity detector.

7. The system of claim wherein the detecting areas at least comprises a first detecting area positioned on a first lateral of the hand-held controller for detecting thumb, and a second detecting area positioned on a second lateral of the hand-held controller for detecting other fingers.

8. The system of claim 1 , wherein the simulated hand and finger gesture is being illustrated along with an avatar in a simulated environment, and wherein the simulated hand and finger gesture comprises grasping and unclasping.

9. The system of claim 1 , wherein the simulated hand and finger gesture is illustrated as grasping when the finger positions are being detected as close to the finger detectors.

10. The system of claim 1 , wherein the simulated hand and finger gesture is illustrated as unclasping when the finger positions are being detected as away from the finger detectors.

11. The system of claim 1 , wherein the hand-held controller comprises a secure unit for fixing the hand-held controller on a hand of a user.

12. The system of claim 1 , further comprising to illustrate a simulated finger gesture of at least three fingers of an avatar on the display.

13. A method for detecting hand and finger gesture, comprising:

obtaining, by a plurality of finger detectors of a hand-held controller, a plurality finger positions;

retrieving, by a computing application executed by a processor, a spatial vector of the hand-held controller;

retrieving, by the computing application, the finger positions from the hand-held controller; and

providing, by the computing application, to illustrate a simulated hand and finger gesture according to the spatial vector of the hand-held controller and the finger positions,

wherein the finger detectors are positioned on a plurality of detecting areas corresponding to fingers respectively, and

wherein the finger detectors comprise a first finger detector positioned on a first detecting area for detection of a first finger of a user;

the first finger detector comprises a proximity detector;

the first finger detector detects a first distance of the first finger from the first detecting area and a first angle of the first finger departing from an axis extended from the first detecting area;

a combination of the first distance and the first angle forms a first finger position; and

when the first finger of the user is pointing straight and away from the palm of the user, the processor receives the first finger position from the hand-held controller, and by executing the computing application generates the simulated hand and finger gesture using the first finger position, wherein a first finger of the simulated hand and finger gesture points straight and away from a palm of the simulated hand and finger gesture.

14. The method of claim 13 , wherein the spatial vector of the hand-held controller comprises a position of the hand-held controller and an orientation of the hand-held controller, the hand-held controller further comprises an inertial measurement unit configured for sensing the position and the orientation of the hand-held controller.

15. The method of claim 13 , wherein the spatial vector of the hand-held controller is determined by an optical detector configured to track the hand-held controller.

16. The method of claim 13 , wherein the finger detectors comprise a touch detector, and wherein one of the finger positions is determined by detecting whether a finger contact being applied on the touch detector.

17. The method of claim 13 , wherein the finger detectors comprise a pressure detector, and wherein one of the finger positions is determined by detecting a touch pressure on the pressure detector.

18. The method of claim 13 , wherein the finger detectors comprise a proximity detector, wherein one of the finger positions is determined by detecting a distance between one finger and the proximity detector.

19. The method of claim 13 , wherein the simulated hand and finger gesture is being illustrated along with an avatar in a simulated environment, and wherein the simulated hand and finger gesture comprises grasping and unclasping.

20. A system for detecting hand and finger gesture and providing a simulated scenario, comprising:

a head-mounted display, configured for displaying the simulated scenario;

a hand-held controller comprising a plurality of finger detectors, wherein the finger detectors are configured to obtain a plurality of finger positions; and

a computing application, executed by a processor, configured to retrieve a spatial vector of the hand-held controller, and to retrieve the finger positions from the hand-held controller, wherein the spatial vector of the hand-held controller and the finger positions are provided to illustrate a simulated hand and finger gesture of an avatar in the simulated scenario,

wherein the finger detectors are positioned on a plurality of detecting areas corresponding to fingers respectively, and

wherein the finger detectors comprise a first finger detector positioned on a first detecting area for detection of a first finger of a user;

the first finger detector comprises a proximity detector;

the first finger detector detects a first distance of the first finger from the first detecting area and a first angle of the first finger departing from an axis extended from the first detecting area;

a combination of the first distance and the first angle forms a first finger position; and

when the first finger of the user is pointing straight and away from the palm of the user, the processor receives the first finger position from the hand-held controller, and by executing the computing application generates the simulated hand and finger gesture using the first finger position, wherein a first finger of the simulated hand and finger gesture points straight and away from a palm of the simulated hand and finger gesture.