IP Library Granted Patent US 11,221,683
Granted Patent B2
US 11,221,683 · App. 16/408,274 · Granted Jan 11, 2022

Graphical user interface (GUI) manipulation using hand gestures over a hovering keyboard

Inventors: Srinivas Kamepalli (Austin, TX); Deeder M. Aurongzeb (Austin, TX)
Assignee: Dell Products, L.P.
G06F3/0219G06F3/011G06F3/017G06F3/0489G06F3/04845H01H13/83H03K17/945H01H2219/036
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,221,683
App. No.
16/408,274
Granted
Jan 11, 2022
Kind
B2
Abstract

Systems and methods for enabling a Graphical User Interface (GUI) manipulation using hand gestures over a hovering keyboard are described. In some embodiments, an Information Handling System (IHS) may include a processor and a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to: detect a hand gesture using proximity sensors disposed on a hovering keyboard coupled to the IHS, and manipulate a task map rendered on a display coupled to the IHS in response to the detection.

Claims (30)

1. An Information Handling System (IHS), comprising:

a processor; and

a memory coupled to the processor, the memory having program instructions stored thereon that, upon execution by the processor, cause the IHS to:

render a task map on a display coupled to the IHS, the task map comprising a plurality of items each representing a specific task to be performed by the IHS when its respective item is selected, wherein each of the plurality of items are simultaneously displayed on the display, wherein the specific tasks corresponding to the plurality of items are different from one another, and wherein each of a plurality of items are grouped in two or more layers;

detect a hand inclination gesture of a hand using proximity sensors disposed on a hovering keyboard coupled to the IHS; and

manipulate the task map by adjusting a separation between each layer to be proportional to a detected angle of inclination of the hand.

2. The IHS of claim 1 , wherein to detect the hand gesture, the program instructions, upon execution, cause the IHS to fit proximity data obtained by the proximity sensors to a geometric model of a hand, and wherein the geometric model comprises one or more parameters selected from the group consisting of: a length, a width, a joint position, an angle of joint rotation, and a finger segment.

3. The IHS of claim 1 , wherein the program instructions, upon execution, further cause the IHS to light a portion of the hovering keyboard under the hand inclination with a color or intensity corresponding to the angle of inclination.

4. The IHS of claim 1 , wherein the hand gesture further comprises a finger splaying following the hand inclination.

5. The IHS of claim 4 , wherein to manipulate the task map, the program instructions, upon execution, further cause the IHS to separate the tasks rendered in each layer by a distance proportional to an amount of finger splaying.

6. The IHS of claim 5 , wherein the hand gesture further comprises a finger pointing following the finger splaying.

7. The IHS of claim 6 , wherein to manipulate the task map, the program instructions, upon execution, further cause the IHS to identify one of the plurality of tasks selected by the finger pointing, and to render an application associated with the selected task.

8. The IHS of claim 4 , wherein the program instructions, upon execution, further cause the IHS to light a portion of the hovering keyboard under the finger splaying with a color or intensity corresponding to the amount of finger splaying.

9. The IHS of claim 1 , wherein to manipulate the task map, the program instructions, upon execution, further cause the IHS to:

maintain a record of hand gestures performed by a given user;

calculate a drift based on the record of hand gestures; and

adjust one or more parameters used to detect the hand gesture based upon the drift.

10. The IHS of claim 9 , wherein to calculate the drift, the program instructions, upon execution, further cause the IHS to create a fuzzy set of hand gestures.

11. A method, comprising:

rendering a task map on a display coupled to the IHS, the task map comprising a plurality of items each representing a specific task to be performed by the IHS when its respective item is selected, wherein each of the plurality of items are simultaneously displayed on the display, wherein the specific tasks corresponding to the plurality of items are different from one another, and wherein each of a plurality of items are grouped in two or more layers;

detecting a hand inclination gesture of a hand using proximity sensors disposed on a hovering keyboard coupled to an Information Handling System (IHS); and

manipulating the task map by adjusting a separation between each layer to be proportional to a detected angle of inclination of the hand.

12. The method of claim 11 , wherein the hand gesture further comprises a finger splaying following the hand inclination, and wherein the method further comprises separating the tasks rendered in each layer by a distance proportional to an amount of finger splaying.

13. The method of claim 12 , wherein the hand gesture further comprises a finger pointing following the finger splaying, and wherein the method further comprises identifying one of the plurality of tasks selected by the finger pointing, and rendering an application associated with the selected task.

14. A hardware memory device having program instructions stored thereon that, upon execution by a processor of an Information Handling System (IHS), cause the IHS to:

render a task map on a display coupled to the IHS, the task map comprising a plurality of items each representing a specific task to be performed by the IHS when its respective item is selected, wherein each of the plurality of items are simultaneously displayed on the display, wherein the specific tasks corresponding to the plurality of items are different from one another, and wherein each of a plurality of items are grouped in two or more layers;

detect a hand inclination gesture of a hand using proximity sensors disposed on a hovering keyboard coupled to the IHS; and

manipulate the task map by adjusting a separation between each layer to be proportional to a detected angle of inclination of the hand.

15. The hardware memory device of claim 14 , wherein the hand gesture further comprises a finger splaying following the hand inclination, and wherein the program instructions, upon execution, further cause the IHS to separate the tasks rendered in each layer by a distance proportional to an amount of finger splaying.

16. The hardware memory device of claim 15 , wherein the hand gesture further comprises a finger pointing following the finger splaying, and wherein the program instructions, upon execution, further cause the IHS to identify one of the plurality of tasks selected by the finger pointing, and to render an application associated with the selected task.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0088 →
RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058213/0825 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 15, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 050724/0571 →
SECURITY AGREEMENT Recorded Sep 17, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 050406/0421 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 9, 2019
From: KAMEPALLI, SRINIVAS; AURONGZEB, DEEDER M.
To: DELL PRODUCTS, L.P.
Reel/Frame 049133/0871 →