IP Library Granted Patent US 11,029,784
Granted Patent B2
US 11,029,784 · App. 16/811,326 · Granted Jun 8, 2021

Methods and apparatuses for applying free space inputs for surface constrained controls

Inventors: Shashwat Kandadai (Cupertino, CA); Nathan Abercrombie (Oakland, CA); Yu-Hsiang Chen (Cupertino, CA); Sleiman Itani (East Palo Alto, CA)
Assignee: Atheer, Inc.
G06F3/0425G06F3/017G06F3/0346G06F3/0416G06F3/0488G06F3/04883G06F3/04815G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,029,784
App. No.
16/811,326
Granted
Jun 8, 2021
Kind
B2
Abstract

A method, system, apparatus, and/or device for sensing an input in an augmented reality construct. The method, system, apparatus, and/or device may include a processing device and a sensor. The processing device may be configured to determine a virtual boundary within an augmented reality construct, define a first portion of the virtual boundary within the augmented reality construct, and define a second portion of the virtual boundary within the augmented reality construct. The sensor may be sense a first input from an end-effector within the first portion of the virtual boundary and sense a second input from the end-effector within the second portion of the virtual boundary, where the processing device may further generate a device input that corresponds to the first input and the second input and send the device input to another device.

Claims (64)

1. A method, comprising:

determining, by a processing device, a surface-constrained input standard for a surface-constrained input generated approximate to a physical surface;

determining, by the processing device, is a virtual boundary within an augmented reality construct;

defining, by the processing device, a first portion of the virtual boundary to receive a first input;

defining, by the processing device, a second portion of the virtual boundary to receive a second input;

sensing, by a sensor, a first input within the first portion of the virtual boundary;

sensing, by the sensor, a second input within the second portion of the virtual boundary;

generating, by the processing device, a device input that corresponds to the first input or the second input; and

sending the device input to a device.

2. The method of claim 1 , further comprising:

determining, by the processing device, a first input standard for the first input; or

determining, by the processing device, a second input standard for the second input.

3. The method of claim 2 , wherein:

the first input standard defines a touch down motion where an end-effector extends downwardly from a first plane to a second plane; and

the second input standard defines:

a swipe motion where the end-effector extends along the second plane from a first point to a second point; or

a liftoff motion where the end-effector extends upwardly from the second plane to the first plane or a third plane.

4. The method of claim 3 , wherein the end-effector comprises one or more fingers of an individual.

5. The method of claim 3 , wherein:

the touch down motion extends downwardly at a first angle.

6. The method of claim 3 , further comprising:

determining that the first input meets the first input standard; or

determining that the second input meets the second input standard.

7. The method of claim 6 , further comprising generating the device input when the first input meets the first input standard or the second input meets the second input standard.

8. The method of claim 1 , wherein a width of the second portion of the virtual boundary is substantially similar to a width of the physical surface.

9. The method of claim 1 , wherein the device is configured to receive the surface-constrained input.

10. The method of claim 1 , wherein the device is configured to receive an analog touch input that conforms to an analog touch input standard.

11. The method of claim 1 , further comprising identifying the surface-constrained input that is associated with the first input or the second input, wherein the device input corresponds to the surface-constrained input.

12. The method of claim 1 , wherein the surface-constrained input is an input received on the surface of a touchscreen device.

13. A device, comprising:

a processing device configured to:

determine a virtual boundary within an augmented reality construct; and

define a portion of the virtual boundary within the augmented reality construct configured to receive and end-effector input within the augmented reality construct; and

a sensor coupled to the processing device, wherein the sensor is configured to:

sense the end-effector input from an end-effector within the portion of the virtual boundary

wherein the processing device is further configured to:

generate a device input that corresponds to the end-effector input; and

send the device input to another device.

14. The device of claim 13 , wherein the processing device is further configured to associate a surface-constrained input with the device input, wherein the surface-constrained input is an input generated approximate to a physical surface.

15. The device of claim 13 , wherein the processing device is further configured to limit a bounce acceleration of the end-effector input, wherein the bounce acceleration is a motion indicative of a downward motion that is rapidly reversed to an upward motion.

16. The device of claim 13 , wherein the end-effector input comprises at least one of:

a touch down motion where the end-effector extends downwardly from a first plane to a second plane;

a liftoff motion where the end-effector extends upwardly from the second plane to the first plane or a third plane; or

a swipe motion where the end-effector extends along the second plane from a first point to a second point.

17. The device of claim 16 , wherein the processing device is further configured to:

determine a threshold distance range for the end-effector to extend along the second plane; and

generate the device input when the end-effector extends along the second plane within the threshold distance range.

18. The device of claim 16 , wherein:

the end-effector is a hand of a user; and

the processing device is further configured to:

determine a threshold distance range for a knuckle of the hand to extend along the second plane; and

generate the device input when the knuckle extends along the second plane within the threshold distance range.

19. An apparatus, comprising:

a processing device configured to:

determine a virtual boundary within an augmented reality construct;

define a portion of the virtual boundary within the augmented reality construct configured to receive an end-effector input; and

a sensor coupled to the processing device, wherein the sensor is configured to:

sense an end-effector input from an end-effector within the portion of the virtual boundary, the end-effector input being a motion where an end-effector moves from a first plane to a second plane,

wherein the processing device is further configured to:

generate a device input that corresponds to the end-effector input; and

send the device input to a device.

20. The apparatus of claim 19 , wherein the processing device is further configured to:

determine a threshold distance range for the end-effector to move from the first plane to the second plane; and

generate the device input when the end-effector moves from the first plane to the second plane within the threshold distance range.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 22, 2020
From: KANDADAI, SHASHWAT; ABERCROMBIE, NATHAN; CHEN, YU-HSIANG; ITANI, SLEIMAN
To: ATHEER, INC.
Reel/Frame 054725/0188 →
Continuity (5)
Continuation 16155678 · Oct 9, 2018
Continuation 15495864 · Apr 24, 2017
Continuation 15184935 · Jun 16, 2016
Continuation 14713971 · May 15, 2015
Related Publication 20200278770A1 · Sep 3, 2020