IP Library Granted Patent US 11,269,421
Granted Patent B2
US 11,269,421 · App. 17/175,671 · Granted Mar 8, 2022

Method and apparatus for applying free space input for surface constrained control

Inventors: Shashwat Kandadai (Cupertino, CA); Nathan Abercrombie (Oakland, CA); Yu-Hsiang Chen (Cupertino, CA); Sleiman Itani (East Palo Alto, CA)
Assignee: Atheer, Inc.
G06F3/017G02B27/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,269,421
App. No.
17/175,671
Granted
Mar 8, 2022
Kind
B2
Abstract

A free space input standard is instantiated on a processor. Free space input is sensed and communicated to the processor. If the free space input satisfies the free space input standard, a touch screen input response is invoked in an operating system. The free space input may be sensed using continuous implicit, discrete implicit, active explicit, or passive explicit approaches. The touch screen input response may be invoked through communicating virtual touch screen input, a virtual input event, or a virtual command to or within the operating system. In this manner free space gestures may control existing touch screen interfaces and devices, without modifying those interfaces and devices directly to accept free space gestures.

Claims (52)

1. A method, comprising:

establishing a surface constrained input standard for a surface constrained input;

determining a free space input standard for a free space input,

wherein the free space input is received within an augmented reality construct defined by a virtual boundary in free space,

wherein the free space input standard comprises a touchdown state sub-standard associated with an end effector in the free space, and

wherein the touchdown state sub-standard:

determines a left to right displacement range of the end effector in a first position by the free space input standard, wherein the left to right displacement range comprises a minimum size and a maximum size of a right to left motion of the end effector;

determines a downward and an upward motion of the end effector within a range; and

limits bounce acceleration to a predetermined number of taps, wherein a tap comprises one or more of a bounce, rapid stop, or reversal of a downward motion to an upward motion of the end effector; and

associating the free space input with a surface constrained input response.

2. The method of claim 1 , further comprising sensing the free space input with a head-mounted device, wherein the free space input comprises:

a first stroke of a first digit within the virtual boundary, wherein the first stroke comprises the first digit moving from a first plane in the virtual boundary to a second plane in the virtual boundary;

a second stroke of the first digit comprises the first digit moving horizontally along the second plane in the virtual boundary;

a third stroke of the first digit within the virtual boundary, comprising:

the third stroke comprises the first digit moving away from the second plane; and

the first stroke, the second stroke, and the third stroke within the virtual boundary mimic the surface constrained input.

3. The method of claim 1 , further comprising sensing a fourth stroke of a second digit of a hand of an individual within the virtual boundary, wherein the fourth stroke comprises: the second digit moving from being in the first position to a second position; or the second digit moving from being in the second position to being in the first position.

4. The method of claim 1 , wherein a standard of the free space input standard comprises excluding the bounce by excluding sudden stops in vertical motion, rapid reversals in vertical velocity, or excessive vertical acceleration.

5. The method of claim 1 , wherein a tap comprises an acceleration profile that includes the bounce.

6. The method of claim 1 , wherein the left to right displacement range defines a right swipe from other inputs.

7. The method of claim 6 , wherein the left to right displacement range comprises minimum threshold of an overall right to left motion or a maximum threshold of the overall right to left motion.

8. The method of claim 1 , further comprising a sensor that is integrated into a head-mounted device to sense the free space input; and wherein the surface constrained input is sensed by the sensor relative to a head of an individual.

9. The method of claim 1 , wherein the bounce comprises a downward motion that is reversed to an upward motion.

10. A method, comprising:

establishing a surface constrained input standard for a surface constrained input, wherein the surface constrained input is a first input;

determining a free space input standard for a free space input, the free space input being a second input generated within an augmented reality construct defined by a virtual boundary, wherein the virtual boundary is in a free space;

determining that the free space input standard includes one or more of a standard for:

determining a first movement of a first digit of a hand of an individual while the first digit is in a first position and a second digit of the hand of the individual is also in the first position;

determining a left to right displacement range of the first digit in a first position by the free space input standard;

excluding a bounce by excluding a sudden stop in a vertical motion, a rapid reversal in vertical velocity, or an excessive vertical acceleration; and

determining a pre-defined range of motion of a knuckle of the first digit; determining that the free space input standard excludes the first movement of the first digit while the first digit is in the first position and the second digit is in a second position; and

sensing the free space input within the virtual boundary.

11. The method of claim 10 , wherein the first position of the first digit or second digit comprises an extended digit position; and wherein the second position of the second digit comprises a non-extended digit position.

12. The method of claim 10 , wherein the free space input comprises a swipe.

13. The method of claim 10 , wherein the left to right displacement range comprises a minimum size and a maximum size of a right to left motion of the first digit.

14. An apparatus, comprising:

a processor to:

determine a surface constrained input standard for a surface constrained input;

determine a free space input standard for a free space input, the free space input being received within an augmented reality construct defined by a virtual boundary, wherein the free space input standard comprises a standard that:

determines a left to right displacement range of a first digit in a first position, wherein the left to right displacement range comprises a minimum size and a maximum size of a right to left motion of an end effector; and

limits bounce acceleration to a predetermined number of taps;

determine that the free space input standard includes a second movement of the first digit while the first digit is in a first position and a second digit is in the first position, and excludes a first movement of the first digit while the first digit is in the first position and the second digit is in a second position, wherein the second movement mimics a surface constrained input;

generate the free space input that includes the second movement of the first digit and excludes the first movement of the first digit; and

execute a surface constrained input associated with the free space input.

15. The apparatus of claim 14 , wherein the predetermined number of taps comprise degenerate taps that comprise left to right motions indicative of right swipes.

16. The apparatus of claim 14 , wherein the bounce acceleration is indicative of imperfect hand motion comprising at least one of a tremor motion, a hand motion influenced by wind, a variation in motion due to a clothing restriction, or an injury motion.

17. The apparatus of claim 14 , wherein left to right displacement range comprises a movement of an index finger from left to right within a specified range.

18. The method of claim 14 , further comprising determining that the free space input standard comprises the first movement of the first digit of a hand of an individual while the first digit is in the first position and the second digit of the hand of the individual is also in the first position.

19. The method of claim 14 , further comprising determining that the free space input standard excludes the first movement of the first digit while the first digit is in the first position and the second digit is in the second position different than the first position.

20. The method of claim 14 , wherein:

the first position comprises an extended digit position; and

the second position of the second digit comprises a non-extended digit position.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2021
From: KANDADAI, SHASHWAT; ABERCROMBIE, NATHAN; CHEN, YU-HSIANG; ITANI, SLEIMAN
To: ATHEER, INC.
Reel/Frame 056532/0103 →
Continuity (3)
Continuation 16458470 · Jul 1, 2019
Continuation 14713954 · May 15, 2015
Related Publication 20210311557A1 · Oct 7, 2021