IP Library Granted Patent US 10,996,473
Granted Patent B2
US 10,996,473 · App. 14/667,550 · Granted May 4, 2021

Method and apparatus for adjusting motion-based data space manipulation

Inventors: Allen Yang Yang (Richmond, CA); Sleiman Itani (East Palo Alto, CA)
Assignee: Atheer, Inc.
G02B27/017G02B27/0093G06F3/011G06T19/006G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,996,473
App. No.
14/667,550
Filed
Mar 24, 2015
Granted
May 4, 2021
Kind
B2
Art Unit
2613
USPC
345/633
Abstract

A data space such as a virtual/augmented reality environment is generated, through which a viewer/point of view may move. The physical world motion of a display outputting the data space is sensed, received, or computed. The motion of a physical world environment in which the display also is sensed, received, or computed. An output adjustment is determined from the display and environment motions, typically being equal to the environment motion(s). Motion of a point of view within the data space to be outputted by the display is determined. The viewpoint motion corresponds with the display motion within physical space adjusted by the output adjustment. At least part of the data space is outputted to the display from the point of view. The point of view is navigated through the data space according to the viewpoint motion.

Claims (66)

1. A method, comprising:

generating, by a processor of a head-mounted display, an augmented reality space comprising a portion of a physical world space and a virtual reality object within the physical world space, wherein:

the physical world space is a portion of the physical world within view of a viewer; and

the viewer is located within a vehicle;

establishing, by the processor of the head-mounted display, a display motion of the head-mounted display within the physical world space, wherein the display motion comprises a set of motions of the head-mounted display in the physical world space;

establishing, by the processor, an environment motion of the head-mounted display in the physical world space, wherein the environment motion is a subset of the display motion designated to be excluded from affecting display of the virtual reality space;

sensing, by a first sensor, a movement of a head-mounted display within the physical world space;

generating, by the processor, a data set representative of the display motion of the head-mounted display within the physical world space;

in response to receiving from a presence sensor or a processing device of the vehicle a notification at the processor of the head-mounted display that indicates the head-mounted display is present in the vehicle:

determining, by the processor, a first subset of data of the display motion indicative of the viewer moving the head-mounted display within the vehicle from a first location within the vehicle to a second location within the vehicle, wherein the first subset of data is indicative of intentional movement of the view within the vehicle;

determining, by the processor, a second subset of data of the data set directly indicative of movement of the vehicle within the physical world;

determining, by the processor, that the second subset of data of the data set is the environment motion, wherein the second subset of data of the data set indicates that the vehicle moved from a first location in the physical world space to a second location within the physical world space;

in response the vehicle moving from the first location to the second location in the physical world space, removing, by the processor, the second subset of data from the data set to obtain an updated data set; and

adjusting at least a portion of the virtual reality object as displayed in the physical world space in view of the updated data set; and

in response to not receiving the notification that the head-mounted display is present in the vehicle, retaining the environment motion with the display motion.

2. The method of claim 1 , wherein the augmented reality space is a three dimensional augmented reality space.

3. The method of claim 1 , wherein the movement of the head-mounted display comprises at least one of a translation movement of the head-mounted display or a rotation movement of the head-mounted display.

4. The method of claim 1 , wherein the movement of the vehicle within the physical world space induces the movement of the head-mounted display within the vehicle.

5. The method of claim 1 , wherein the head-mounted display is a wearable head-mounted display.

6. The method of claim 1 , wherein:

the first sensor senses the movement of the head-mounted display within the vehicle; and

a second sensor senses the movement of the vehicle with the physical world space.

7. The method of claim 1 , wherein determining the second subset of data comprises computationally determining the movement of the vehicle within the physical world space based on at least one of a velocity of the movement, an acceleration of the movement, a direction of the movement, or an angle of the movement.

8. The method of claim 7 , further comprising determining a dampening of a perception by the viewer of the movement of the physical world space based on a negative motion of part of the vehicle.

9. The method of claim 8 , wherein the negative motion substantially corresponds with a damped harmonic motion of the movement of the physical world space by the vehicle.

10. The method of claim 1 , further comprising:

determining a negative motion of the vehicle that changes a viewer's perception of the physical world space; and

removing a third subset of data from the data set corresponding to the movement of the physical world space that is changed by the negative motion.

11. The method of claim 1 , further comprising displaying, by the head-mounted display, a stereo point of view to the viewer.

12. The method of claim 1 , wherein the second subset of data comprises a plurality of movements of the physical world space.

13. An apparatus, comprising:

a processor;

a display coupled to the processor;

a display motion sensor coupled to the processor;

an environment motion sensor coupled to the processor, wherein the processor is to:

generate an augmented reality space comprising a portion of a physical world space and a virtual reality object within the physical world space, wherein:

the physical world space is a portion of a physical world within view of a viewer; and

the viewer is located within a vehicle receive a first data set from the display motion sensor, the first data set representative of a movement of the display within the vehicle from a first location within the vehicle to a second location within the vehicle, wherein the first data set is indicative of intentional movement of the viewer within the vehicle;

receive a second data set from the environment motion sensor, the second data set directly representative of a movement of the vehicle within the physical world space;

in response to receiving from a presence sensor or a processing device of the vehicle a notification that indicates the display is present in the vehicle:

determine the second data set indicates that the vehicle moved from a first location in the physical world space to a second location within the physical world space;

in response to the vehicle moving from the first location to the second location in the physical world space, remove the second data set to obtain an updated data set; and

adjust at least a portion of the virtual reality object as displayed in the physical world space in view of the updated data set: and

in response to not receiving the notification that the display is present in the vehicle, retain the second data set with the first data set.

14. The apparatus according to claim 13 , wherein the processor is further to receive a third data set representative of a negative motion of the vehicle that changes a viewer's perception of the physical world space.

15. The method of claim 14 , wherein the negative motion counteracts a portion of the movement of the physical world space.

16. The apparatus of claim 14 , wherein the negative motion counteracts a portion of the movement of the physical world space.

17. The apparatus of claim 13 , wherein the display is a stereo display.

18. The apparatus of claim 13 , wherein the display is a head mounted display.

19. The apparatus of claim 13 , wherein the processor, the display, the display motion sensor, and the environment motion sensor are physically integrated as a wearable device.

20. The apparatus of claim 13 , wherein the display motion sensor is physically distal from the display.

21. The apparatus of claim 13 , wherein the environment motion sensor is physically distal from the display.

22. The apparatus of claim 13 , wherein the display motion sensor comprises at least one of an accelerometer, a gyroscope, a GPS sensor, a magnetometer, an imager, a depth sensor, a structured light sensor, a time-of-flight sensor, an ultrasonic sensor, or a wireless signal triangulation sensor.

23. The apparatus of claim 13 , wherein the environment motion sensor comprises at least one of an accelerometer, a gyroscope, a GPS sensor, a magnetometer, an imager, a depth sensor, a structured light sensor, a time-of-flight sensor, an ultrasonic sensor, or a wireless signal triangulation sensor.

24. An apparatus, comprising:

a display configured to display an augmented reality space;

a first sensor and a second sensor;

a processor coupled to the display, the first sensor, and the second sensor, wherein the processor is to:

generate the augmented reality space comprising a portion of a physical world space and a virtual reality object within the physical world space, wherein:

the physical world space is a portion of a physical world within view of a viewer; and

the viewer is located within a vehicle;

receive a first data set from the first sensor, the first data set representative of a movement of the display within the vehicle from a first location within the vehicle to a second location within the vehicle, wherein the first data set is indicative of intentional movement of the viewer within the vehicle;

receive a second data set from the second sensor, the second data set directly representative of a movement of the vehicle within the physical world space;

in response to receiving from a presence sensor or a processing device of the vehicle a notification that indicates the display is present in the vehicle, determine the second data set indicates that the vehicle moved from a first location in the physical world space to a second location within the physical world space;

in response to the vehicle moving from the first location to the second location in the physical world space, display at least a portion of the virtual reality object as displayed in the physical world space based only on the first data set; and

in response to not receiving the notification that the display is present in the vehicle, display at least a portion of the virtual reality object as displayed in the physical world space based on the first data set and the second data set.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
SECURITY INTEREST Recorded Nov 20, 2018
From: ATHEER, INC.
To: COTA CAPITAL MASTER FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 048154/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2015
From: YANG, ALLEN YANG; ITANI, SLEIMAN
To: ATHEER, INC.
Reel/Frame 035246/0645 →
Continuity (2)
Provisional Application 61970811 · Mar 26, 2014
Related Publication 20150279050A1 · Oct 1, 2015
Cited By (10)
US 12,196,963 US 12,266,276 US 12,366,746 US 12,431,035 US 12,437,665 US 12,437,666 US 12,437,667 US 12,694,798 US 12,706,000 US 12,706,001