System and method for using a side camera for a free space gesture inputs
View Patent ↗An information handling system including a camera mounted in the side edge surface for detecting gestures by a user in a gesture detecting zone next to the system and including a gesture detection system for interpreting free space gestures and initializing cursor control commands.
1. An information handling system having a free space gesture detection system comprising:
a housing with a front facing surface, a back facing surface, and at least one side edge connecting the front facing surface and back facing surface;
a camera mounted in the side edge surface of the housing oriented to detect gestures by a user in a gesture detection zone next to the information handling system;
a free space gesture detection system executing instructions on a processor determining available gesture commands for a software application operating on the information handling system;
the free space gesture detection system maintaining a virtual gesture detection plane in the gesture detection zone, the virtual gesture detection plane calibrated to a location and tilt angle of a user's hand; and
the processor interpreting detected gestures in the virtual gesture detection zone to correspond to cursor control commands in the software application operating on the information handling system.
2. The system of claim 1 , further comprising:
an orientation sensor for detecting orientation of the information handling system relative to calibrating the virtual gesture detection plane to the location and angle and tilt angle of the user's hand.
3. The system of claim 1 , further comprising:
a second camera for detecting depth for calibration of the virtual gesture detection plane.
4. The system of claim 1 , wherein the free space gesture detection system maintains the virtual gesture detection plane by sensing and adjusting depth and angle of tilt calibration to changes in the location and angle of the user's hand.
5. The system of claim 1 , wherein the free space gesture detection system detects palm and finger elements of a user's hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks.
6. The system of claim 1 , wherein the free space gesture detection system detects a fingertip element of a user's hand in the virtual gesture detection plane to sense virtual track pad input movements including virtual finger touches and drags.
7. The system of claim 1 , wherein if the camera detects a working surface in the gesture detection zone, the free space gesture detection system maintains the virtual gesture detection plane to correspond to the working surface.
8. The system of claim 1 , further comprising:
the camera includes a first two dimensional camera and a second three dimensional camera,
wherein the free space gesture detection system has a 2D mode using the first two dimensional camera when a working surface is detected in the gesture detection zone and a 3D mode when no working surface is detected.
9. The system of claim 1 , further comprising:
a light projection system to project to a location corresponding with boundaries of the virtual gesture detection plane.
10. A computer-implemented a free space gesture detection method comprising:
detecting, via a side mounted camera on an information handling system, gestures by a user in a gesture detection zone next to the information handling system;
determining, via a processor executing instructions, available gesture commands for a software application operating on the information handling system;
maintaining a virtual gesture detection plane in the gesture detection zone;
calibrating the virtual gesture detection plane to a location and tilt angle of a user's hand; and
interpreting detected gestures in the virtual gesture detection zone, via the processor, to correspond to cursor control commands in the software application operating on the information handling system.
11. The method of claim 10 , wherein maintaining the virtual gesture detection plane includes sensing and adjusting depth and angle of tilt calibration to changes in the location and angle of the user's hand via a second camera.
12. The method of claim 10 , further comprising:
detecting orientation of the information handling system, via orientation sensors, to calibrate the virtual gesture detection plane to the location and angle and tilt angle of the user's hand relative to the information handling system.
13. The method of claim 10 , further comprising:
detecting palm and finger elements of a user's hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks and finger scroll movement.
14. The method of claim 10 , further comprising:
detecting a finger element of a user's hand in the virtual gesture detection plane to sense virtual track pad input movements including virtual finger touches and drags.
15. The method of claim 10 , further comprising:
detecting a working surface in the gesture detection zone; and
maintaining the virtual gesture detection plane to correspond to the working surface.
16. The method of claim 10 , further comprising:
projecting a laser light boundary corresponding with boundaries of the virtual gesture detection plane.
17. An information handling system having a free space gesture detection system comprising:
a side mounted camera to detect gestures by a user in a gesture detection zone next to the information handling system;
a free space gesture detection system executing instructions on a processor determining a virtual gesture detection plane in the gesture detection zone;
the free space gesture detection system calibrating the virtual gesture detection plane calibrated to a location and tilt angle of a user's hand;
an orientation sensor for detecting orientation of the information handling system and camera relative to calibrating the virtual gesture detection plane to the location and tilt angle of the user's hand; and
the processor interpreting detected gestures in the virtual gesture detection zone to correspond to control commands for a software application operating on the information handling system.
18. The system of claim 17 , wherein the free space gesture detection system detects the software application running on the information handling system and determines available gesture commands for use with the software application.
19. The system of claim 17 , further comprising:
the free space gesture detection system interpreting detected gestures via a gesture classifier comparing the detected gesture with a gesture database via the processor.
20. The system of claim 17 , wherein the free space gesture detection system operates in a plurality of modes representing a plurality of gesture driven virtual I/O input devices.