IP Library Granted Patent US 9,658,699
Granted Patent B2
US 9,658,699 · App. 15/071,073 · Granted May 23, 2017

System and method for using a side camera for free space gesture inputs

Inventors: Kenneth C. Musgrave (Austin, TX); Deeder M. Aurongzeb (Austin, TX)
Assignee: Dell Products, LP
G06F3/017G06F1/169G06F1/1686G06F3/005G06F3/0425G06F3/04883H04N5/225H04N5/23241H04N5/23245
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,658,699
App. No.
15/071,073
Granted
May 23, 2017
Kind
B2
Abstract

An information handling system including a camera mounted in the side edge surface for detecting gestures by a user on a detected working surface in a gesture detecting zone next to the system and including a gesture detection system for interpreting free space gestures and initializing cursor control commands.

Claims (46)

1. An information handling system having a free space gesture detection system comprising:

a housing;

a camera mounted in a side edge surface of the housing oriented to detect gestures by a user in a gesture detection zone next to the information handling system;

a free space gesture detection system executing instructions on a processor determining available gesture commands for a software application operating on the information handling system;

the free space gesture detection system maintaining a virtual gesture detection plane in the gesture detection zone, the virtual gesture detection plane calibrated to a location of a user's hand on a location and tilt angle of a detected working surface in the gesture detection zone; and

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to cursor control commands.

2. The system of claim 1 , further comprising:

the detected gestures by the free space gesture detection system in the virtual gesture detection plane including the location of the user's hand operate as a virtual mouse on the detected working surface.

3. The system of claim 1 , further comprising:

an orientation sensor for detecting orientation of the information handling system relative to calibrating the virtual gesture detection plane to the location of the user's hand on a detected working surface.

4. The system of claim 1 , further comprising:

a second camera for detecting depth for calibration of the virtual gesture detection plane.

5. The system of claim 1 , wherein the free space gesture detection system maintains the virtual gesture detection plane by sensing and adjusting depth calibration to changes in the location of the user's hand on the detected working surface.

6. The system of claim 1 , wherein the free space gesture detection system detects palm and finger elements of a user's hand in the virtual gesture detection plane to sense virtual mouse movements.

7. The system of claim 1 , wherein the free space gesture detection system detects a fingertip element of a user's hand in the virtual gesture detection plane to sense virtual track pad input movements including virtual finger touches and drags.

8. The system of claim 1 , further comprising:

a light projection system to project to a location on a detected working surface corresponding with boundaries of the virtual gesture detection plane.

9. The system of claim 1 wherein the information handling system is a laptop computer.

10. A computer-implemented a free space gesture detection method comprising:

detecting, via a side mounted camera on an information handling system, gestures by a user in a gesture detection zone next to the information handling system;

determining, via a processor executing instructions, available gesture commands for a software application operating on the information handling system;

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to cursor control commands;

maintaining a virtual gesture detection plane in the gesture detection zone, the virtual gesture detection plane calibrated to a detected working surface in the gesture detection zone;

calibrating the virtual gesture detection plane to a tilt angle of the detected working surface next to the information handling system; and

interpreting detected gestures in the virtual gesture detection zone, via the processor, to correspond to cursor control commands in the software application operating on the information handling system.

11. The method of claim 10 , further comprising:

calibrating the virtual gesture detection plane to a location of a user's hand on the detected working surface in the gesture detection zone.

12. The method of claim 10 , wherein maintaining the virtual gesture detection plane includes sensing and adjusting depth calibration to changes in the location of a user's hand on the detected working surface via a second camera.

13. The method of claim 11 , further comprising:

detecting orientation of the information handling system, via orientation sensors, to calibrate the virtual gesture detection plane to the location of the user's hand relative to a tilt angle the information handling system.

14. The method of claim 10 , further comprising:

detecting palm and finger elements of a user's hand in the virtual gesture detection plane to sense virtual mouse movements including virtual finger clicks and finger scroll movement.

15. The method of claim 10 , further comprising:

detecting a finger element of a user's hand in the virtual gesture detection plane to sense virtual track pad input movements.

16. The method of claim 10 , further comprising:

projecting a laser light boundary corresponding with boundaries of the virtual gesture detection plane.

17. An information handling system having a free space gesture detection system comprising:

a side mounted camera to detect gestures by a user in a gesture detection zone next to the information handling system;

a free space gesture detection system executing instructions on a processor determining a virtual gesture detection plane in the gesture detection zone;

an orientation sensor for detecting orientation of the information handling system and camera relative to a location and tilt angle of a detected work surface next to the information handling system; and

the free space gesture detection system calibrating the virtual gesture detection plane calibrated to the location of the user's hand over the detected work surface;

the processor interpreting detected gestures in the virtual gesture detection zone to correspond to control commands for a software application operating on the information handling system.

18. The system of claim 17 , wherein the free space gesture detection system detects the software application running on the information handling system and determines available gesture commands for use with the software application.

19. The system of claim 17 , further comprising:

the free space gesture detection system interpreting detected gestures via a gesture classifier comparing the detected gesture with a gesture database via the processor.

20. The system of claim 17 wherein the information handling system is a tablet computer.

Assignments (15)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (045455/0001) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061753/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (040136/0001) Recorded Apr 26, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO ASAP SOFTWARE EXPRESS, INC.); DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC CORPORATION (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MAGINATICS LLC); EMC IP HOLDING COMPANY LLC (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO MOZY, INC.); SCALEIO LLC
Reel/Frame 061324/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 3, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL, L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058216/0001 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 040134/0001 →
SECURITY AGREEMENT Recorded Sep 21, 2016
From: ASAP SOFTWARE EXPRESS, INC.; AVENTAIL LLC; CREDANT TECHNOLOGIES, INC.; DELL USA L.P.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL SOFTWARE INC.; DELL SYSTEMS CORPORATION; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; FORCE10 NETWORKS, INC.; MAGINATICS LLC; MOZY, INC.; SCALEIO LLC; SPANNING CLOUD APPS LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 040136/0001 →
RELEASE OF REEL 038664 FRAME 0908 (NOTE) Recorded Sep 14, 2016
From: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; SECUREWORKS, CORP.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040027/0390 →
RELEASE OF REEL 038665 FRAME 0041 (TL) Recorded Sep 14, 2016
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; SECUREWORKS, CORP.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040028/0375 →
RELEASE OF REEL 038665 FRAME 0001 (ABL) Recorded Sep 13, 2016
From: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
To: DELL SOFTWARE INC.; DELL PRODUCTS L.P.; SECUREWORKS, CORP.; WYSE TECHNOLOGY L.L.C.
Reel/Frame 040021/0348 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (NOTES) Recorded May 11, 2016
From: DELL SOFTWARE INC.; WYSE TECHNOLOGY, L.L.C.; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS FIRST LIEN COLLATERAL AGENT
Reel/Frame 038664/0908 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (TERM LOAN) Recorded May 11, 2016
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; WYSE TECHNOLOGY, L.L.C.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 038665/0041 →
SUPPLEMENT TO PATENT SECURITY AGREEMENT (ABL) Recorded May 11, 2016
From: DELL PRODUCTS L.P.; DELL SOFTWARE INC.; WYSE TECHNOLOGY, L.L.C.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 038665/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2016
From: MUSGRAVE, KENNETH C.; AURONGZEB, DEEDER M.
To: DELL PRODUCTS, LP
Reel/Frame 037990/0844 →
Continuity (2)
Continuation 14224260 · Mar 25, 2014
Related Publication 20160195934A1 · Jul 7, 2016