IP Library Granted Patent US 9,823,752
Granted Patent B2
US 9,823,752 · App. 15/361,638 · Granted Nov 21, 2017

Gesture based user interface for augmented reality

Inventor: Nicholas S. Bromer (Marietta, PA)
Assignee: EMPIRE TECHNOLOGY DEVELOPMENT LLC
G06F3/017G06F3/044G06F3/04886G06F2203/04108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,823,752
App. No.
15/361,638
Granted
Nov 21, 2017
Kind
B2
Abstract

Technologies are generally described for systems and methods effective to provide a gesture keyboard that can be utilized with a virtual display. In an example, the method includes receiving sensory information associated with an object in proximity to, or in contact with, an input device including receiving at least one level of interaction differentiation detected from at least three levels of interaction differentiation, interpreting a command from the sensory information as a function of the at least one level of interaction differentiation, and outputting an action indication based on the command.

Claims (30)

1. A method, comprising:

receiving, by a system comprising a processor, sensory information indicative of a proximity level of interaction differentiation with respect to an object in proximity to, or in contact with, an input device;

determining, by the system, a gesture command from the sensory information based on a trigonometric function of a first beat frequency in a first resonant circuit associated with a first character input component of the input device and a second beat frequency in a second resonant circuit associated with a second character input component of the input device; and

outputting, by the system, an action indication based on the gesture command.

2. The method of claim 1 , wherein the determining comprises determining the gesture command based on a capacitance between the object and the input device.

3. The method of claim 1 , wherein the determining comprises determining, based on the trigonometric function, a lateral position of the object with respect to the input device and a height of the object above a plane of the input device.

4. The method of claim 1 , wherein the sensory information is first sensory information, and wherein the receiving comprises receiving second sensory information indicative of an electrical continuity level of interaction differentiation with respect to the object.

5. The method of claim 4 , wherein the gesture command is a first gesture command, and wherein the determining comprises determining a second gesture command from the second sensory information based on detection of an electrical contact between the object and a surface associated with the input device.

6. The method of claim 5 , wherein the outputting comprises outputting the action indication based on the first gesture command and the second gesture command.

7. The method of claim 1 , wherein the sensory information is first sensory information, and wherein the receiving comprises receiving second sensory information indicative of an actuation level of interaction differentiation with respect to the object.

8. The method of claim 7 , wherein the gesture command is a first gesture command, and wherein the determining comprises determining a second gesture command from the second sensory information based on movement of at least a portion of the input device by the object.

9. The method of claim 8 , wherein the outputting comprises outputting the action indication based on the first gesture command and the second gesture command.

10. The method of claim 1 , wherein the outputting comprises presenting, via a virtual display, a virtual representation of the input device and information associated with the action indication.

11. The method of claim 1 , wherein the outputting comprises transmitting, to a display device, a signal that comprises the action indication and an interpretation of the gesture command for output by the display device.

12. A system, comprising:

a processor, coupled to a memory, configured to execute or facilitate execution of computer-executable instructions to perform or control performance of operations to:

receive a gesture within a space relative to an input device;

determine a command based on the gesture and a trigonometric function of a first beat frequency associated with a first resonant circuit of the input device and a second beat frequency associated with a second resonant circuit of the input device; and

output, based on the command, an action associated with a virtual display.

13. The system of claim 12 , wherein to determine the command, the processor is configured to identify, based on the trigonometric function, a lateral location of an object with respect to the input device and a height of the object above a plane of the input device.

14. The system of claim 12 , wherein the processor is configured to determine the command based on the gesture, the trigonometric function, and electrical continuity data indicative of an electrical continuity level associated with a grounding of a surface of the input device by an object.

15. The system of claim 12 , wherein the processor is configured to determine the command based on the gesture, the trigonometric function, and actuation data indicative of an actuation detected from movement of a portion of the input device by an object.

16. The system of claim 12 , wherein to output the action, the processor is configured to render, on the virtual display, information of the gesture and the command.

17. A computer-readable storage device storing executable instructions that, in response to execution, cause a system comprising a processor to perform operations, comprising:

receiving sensor data indicative of a proximity level of an object with respect to a sensor of an input device;

determining a gesture command based on the sensor data and a trigonometric function of a first beat frequency in a first resonant circuit associated with the input device and a second beat frequency in a second resonant circuit associated with the input device; and

modifying information presented on a display based on the gesture command.

18. The computer-readable storage device of claim 17 , wherein the determining comprises determining the gesture command based on the sensor data, the trigonometric function, and a detection of an electrical contact between an external element and a surface of the input device.

19. The computer-readable storage device of claim 17 , wherein the determining comprises determining the gesture command based on the sensor data, the trigonometric function, and actuation of a conductive element of the input device.

20. The computer-readable storage device of claim 17 , wherein the modifying comprises initiating a result of the gesture command as an event with respect to the display.

Assignments (4)
RELEASE OF SECURITY INTEREST IN PATENTS, RECORDED ON JANUARY 29, 2019, AT REEL/FRAME 048373/0217 Recorded Jun 22, 2026
From: CRESTLINE DIRECT FINANCE, L.P., AS COLLATERAL AGENT
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 075799/0053 →
RELEASE OF SECURITY INTEREST IN PATENTS, RECORDED ON JANUARY 29, 2019 AT REEL 048373 FRAME 0217 Recorded Sep 22, 2025
From: CRESTLINE DIRECT FINANCE, L.P., AS COLLATERAL AGENT
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 072936/0464 →
SECURITY INTEREST Recorded Jan 29, 2019
From: EMPIRE TECHNOLOGY DEVELOPMENT LLC
To: CRESTLINE DIRECT FINANCE, L.P.
Reel/Frame 048373/0217 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2016
From: BROMER, NICHOLAS S.
To: EMPIRE TECHNOLOGY DEVELOPMENT LLC
Reel/Frame 040425/0121 →
Continuity (2)
Continuation 13320904
Related Publication 20170075429A1 · Mar 16, 2017