IP Library Granted Patent US 11,055,926
Granted Patent B2
US 11,055,926 · App. 16/920,581 · Granted Jul 6, 2021

Method and apparatus for multiple mode interface

Inventors: Nathan Abercrombie (Mountain View, CA); Iryna Issayeva (Foster City, CA); Greg James (Redwood City, CA); Sleiman Itani (East Palo Alto, CA)
Assignee: Atheer, Inc.
G06T19/006G06F3/011G06F3/013G06F3/017G06F3/04815
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,055,926
App. No.
16/920,581
Granted
Jul 6, 2021
Kind
B2
Abstract

A method, system, apparatus, and/or device for executing a translation instruction for a constructive movement. The method, system, apparatus, and/or device may include an input device configured to sense a first constructive movement input representative of a non-translational movement of a body of a user that does not move from a first point to a second point in the physical world environment. The method, system, apparatus, and/or device may include a processing device coupled to the input device, where the processing device is configured to execute a translational instruction associated with the first constructive movement input, execute a first resizing instruction to reduce a size of a portion of the physical world environment as displayed by a head-mounted display by an amount indicated by the first resizing stimulus, receive a second constructive movement input, and execute a second translational instruction associated with the second constructive translational movement input.

Claims (94)

1. A method, comprising:

receiving, from an input device, a first constructive movement input representative of a non-translational movement of a body of a user, wherein

the non-translational movement mimics a movement of the body translationally moving from a first point in a physical world environment to a second point in the physical world environment;

executing, by a processing device, a translational instruction associated with the first constructive movement input, wherein

the translational instruction comprises moving the body in a world space of an augmented reality environment from the first point to the second point;

receiving, from the input device, a first rotation stimulus;

in response to receiving the first rotation stimulus, rotating:

a portion of the world space as displayed by a head-mounted display by a first amount indicated by the first rotation stimulus;

a portion of a sphere space as displayed by the head-mounted display by the first amount, wherein, as the sphere space rotates, the world space is fixed; or

a portion of a display space as displayed by the head-mounted display by the first amount, wherein

as the display space rotates, the world space or the sphere space is fixed;

receiving, from the input device, a second constructive movement input; and

in response to receiving the second constructive movement input, moving the body a second distance in the world space, the sphere space, or the display space that corresponds with a first actual movement of the body in the physical world environment.

2. The method of claim 1 , wherein:

the augmented reality environment comprises one or more objects overlaid onto the physical world environment; or

the processing device is adapted to display the physical world environment as a virtual reality environment, wherein the portion of the world space that is rotated is a portion of the physical world environment displayed as the virtual reality environment.

3. The method of claim 1 , wherein:

the first rotation stimulus is a user input; and

the user input comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

4. The method of claim 1 , wherein the second constructive movement input comprises constructive rotational movement that corresponds to rotational movement by the head-mounted display where the head-mounted display remains at the first point and rotates about an axis.

5. The method of claim 1 , wherein the first rotation stimulus is indicative of the body interacting with an augmented reality object displayed in the physical world environment.

6. The method of claim 1 , further comprising:

receiving, from the input device:

a resizing stimulus; or

a third constructive movement input;

in response to receiving the resizing stimulus, resizing a portion of the world space, the sphere space, or the display space as displayed by the head-mounted display; and

in response to receiving the third constructive movement input, moving the body a third distance in the world space, the sphere space, or the display space that corresponds with a second actual movement of the body in the physical world environment.

7. A method, comprising:

receiving a first constructive movement input representative of a first gesture of a body of a user, wherein

the first gesture mimics a movement of the body translationally moving from a first point in a physical world environment to a second point in the physical world environment;

in response to receiving the first constructive movement input,

moving the body in a world space of an augmented reality environment from the first point to the second point;

in response to receiving a first resizing stimulus, executing a first resizing instruction to change:

a size of a portion of the world space;

a size of a portion of a sphere space; or

a size of a portion of a display space, wherein:

as the size of the portion of the world space changes, the size of the portion of the sphere space is constant or the size of the portion of the display space is constant;

as the size of the portion of the sphere space changes, the size of the portion of the world space is constant or the size of the portion of the display space is constant; and

as the size of the portion of the display space changes, the size of the portion of the world space is constant or the size of the portion of the sphere space is constant;

receiving, from an input device, a second constructive movement input; and

in response to receiving the second constructive movement input, moving the body a second distance in the world space that corresponds with a first actual movement of the body in the physical world environment.

8. The method of claim 7 , further comprising:

receiving, from the input device:

a rotation stimulus; or

a third constructive movement input;

in response to receiving the rotation stimulus, rotating the world space, the sphere space, or the display space as displayed by a head-mounted display; and

in response to receiving the third constructive movement input, moving the body a third distance in the world space that corresponds with a second actual movement of the body in the physical world environment.

9. The method of claim 7 , wherein:

as the world space rotates, the sphere space remains fixed relative to the user or the display space remains fixed relative to the user;

as the sphere space rotates, the world space remains fixed relative to the user or the display space remains fixed relative to the user; or

as the display space rotates, the world space remains fixed relative to the user or the sphere space remains fixed relative to the user.

10. The method of claim 7 , further comprising:

receiving, from the input device:

a space translation stimulus; or

a third constructive movement input;

in response to receiving the space translation stimulus, moving the world space, the sphere space, or the display space as displayed by the head-mounted display from a third point relative to the physical world environment to a fourth point relative to the physical world environment; and

in response to receiving the third constructive movement input, moving the body a third distance in the world space that corresponds with a second actual movement of the body in the physical world environment.

11. The method of claim 10 , wherein the space translation stimulus is at least one of a second gesture, a verbal command, or a signal or data from another device or input device.

12. The method of claim 10 , wherein:

as the world space translates, the sphere space remains fixed relative to the user or the display space remains fixed relative to the user;

as the sphere space translates, the world space remains fixed relative to the user or the display space remains fixed relative to the user; and

as the display space translates, the world space remains fixed relative to the user or the sphere space remains fixed relative to the user.

13. The method of claim 7 , wherein:

executing the first resizing instruction comprises changing a size of a portion of a virtual object;

the virtual object is displayed on the head-mounted display in the physical world environment;

the virtual object is disposed in:

the world space such that the virtual object moves with the world space relative to the body of the user;

the sphere space such that the virtual object moves with the sphere space relative to the body of the user; or

the display space such that the virtual object moves with the display space relative to the body of the user; and

the size of the portion of the world space, the size of the portion of the sphere space, or the size of the portion of the display space remain constant as the size of the portion of the virtual object is changed.

14. A method, comprising:

receiving a first constructive movement input representative of a first gesture of a body of a user, wherein

the first gesture mimics a movement of the body translationally moving from a first point in a physical world environment to a second point in the physical world environment;

executing a translational instruction associated with the first constructive movement input, wherein:

the translational instruction comprises moving the body in an augmented reality environment from the first point to the second point;

the augmented reality environment comprises a world space, a sphere space, and a display space in the physical world environment;

in response to receiving a space exception stimulus, moving the world space, the sphere space, or the display space relative to the physical world environment, wherein the movement of the world space, the sphere space, or the display space comprises an exception to a set of default behaviors for the world space, the sphere space, or the display space;

receiving a second constructive movement input; and

in response to receiving the second constructive movement input, moving the body a first distance in the augmented reality environment that corresponds with a first actual movement of the body in the physical world environment.

15. The method of claim 14 , further comprising adapting the physical world environment to be displayed as a virtual reality environment, wherein the world space, the sphere space, or the display space is a portion of the physical world environment displayed as the virtual reality environment.

16. The method of claim 14 , further comprising:

receiving, from an input device:

a resizing stimulus; or

a third constructive movement input;

in response to receiving the resizing stimulus, changing a size of a portion of the world space, the sphere space, or the display space as displayed by a head-mounted display by an amount indicated by the resizing stimulus; and

in response to receiving the third constructive movement input, moving the body a second distance that corresponds with a second actual movement of the body in the physical world environment.

17. The method of claim 14 , wherein the first movement instruction comprises:

a translation of the world space, the sphere space, or the display space relative to the physical world environment; or

rotation of the world space, the sphere space, or the display space relative to the physical world environment.

18. The method of claim 14 , wherein the exception is a positive exception that induces movement of the world space, the sphere space, or display space relative to the physical world environment.

19. The method of claim 14 , wherein the exception is a negative exception that removes movement of the world space, the sphere space, or the display space relative to the physical world environment as the body actually translates in the physical world environment.

20. The method of claim 14 , wherein the exception is:

a positive exception that causes the body to appear stationary in the world space, the sphere space, or the display space as the body actually translates in the physical world environment; or

a negative exception that causes the world space, the sphere space, or the display space to appear to move relative to the body as the body actually translates in the physical world environment.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2020
From: ABERCROMBIE, NATHAN; ISSAYEVA, IRYNA; JAMES, GREG; ITANI, SLEIMAN
To: ATHEER, INC.
Reel/Frame 054708/0664 →
Continuity (5)
Continuation 16514205 · Jul 17, 2019
Continuation 16169916 · Oct 24, 2018
Continuation 14505295 · Oct 2, 2014
Provisional Application 61885896 · Oct 2, 2013
Related Publication 20200334915A1 · Oct 22, 2020