IP Library Granted Patent US 11,828,939
Granted Patent B2
US 11,828,939 · App. 17/221,749 · Granted Nov 28, 2023

Method and apparatus for adjusting motion-based data space manipulation

Inventors: Allen Yang Yang (Richmond, CA); Sleiman Itani (East Palo Alto, CA)
G02B27/017G02B27/0093G06F3/011G06T19/006G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,828,939
App. No.
17/221,749
Granted
Nov 28, 2023
Kind
B2
Abstract

A data space such as a virtual/augmented reality environment is generated, through which a viewer/point of view may move. The physical world motion of a display outputting the data space is sensed, received, or computed. The motion of a physical world environment in which the display also is sensed, received, or computed. An output adjustment is determined from the display and environment motions, typically being equal to the environment motion(s). Motion of a point of view within the data space to be outputted by the display is determined. The viewpoint motion corresponds with the display motion within physical space adjusted by the output adjustment. At least part of the data space is outputted to the display from the point of view. The point of view is navigated through the data space according to the viewpoint motion.

Claims (62)

1. A method, comprising:

generating, by a processor of a moveable display, an augmented reality space comprising a portion of a physical world space and a virtual reality object within the physical world space, wherein:

the physical world space is a portion of the physical world within view of a viewer; and

the viewer is located within a vehicle;

establishing, by the processor of the moveable display, a display motion of the moveable display within the physical world space, wherein the display motion comprises a set of motions of the moveable display in the physical world space;

establishing, by the processor, an environment motion of the moveable display in the physical world space, wherein the environment motion is a subset of the display motion designated to be excluded from affecting display of the virtual reality space;

sensing, by a first sensor, a movement of a moveable display within the physical world space;

generating, by the processor, a data set representative of the display motion of the moveable display within the physical world space;

in response to receiving from a presence sensor or a processing device of the vehicle a notification at the processor of the moveable display that indicates the moveable display is present in the vehicle:

determining, by the processor, a first subset of data of the display motion indicative of the viewer moving the display within the vehicle from a first location within the vehicle to a second location within the vehicle, wherein the first subset of data is indicative of intentional movement of the view within the vehicle;

determining, by the processor, a second subset of data of the data set directly indicative of movement of the vehicle within the physical world;

determining, by the processor, that the second subset of data of the data set is the environment motion, wherein the second subset of data of the data set indicates that the vehicle moved from a first location in the physical world space to a second location within the physical world space;

in response to the vehicle moving from the first location to the second location in the physical world space, removing, by the processor, the second subset of data from the data set to obtain an updated data set; and

adjusting at least a portion of the virtual reality object as displayed in the physical world space in view of the updated data set; and

in response to not receiving the notification that the moveable display is present in the vehicle, retaining the environment motion with the display motion.

2. The method of claim 1 , wherein the augmented reality space is a three dimensional augmented reality space.

3. The method of claim 1 , wherein the movement of the moveable display comprises at least one of a translation movement of the moveable display or a rotation movement of the moveable display.

4. The method of claim 1 , wherein the movement of the vehicle within the physical world space induces the movement of the moveable display within the vehicle.

5. The method of claim 1 , wherein:

the first sensor senses the movement of the moveable display within the vehicle; and

a second sensor senses the movement of the vehicle with the physical world space.

6. The method of claim 1 , wherein determining the second subset of data comprises computationally determining the movement of the vehicle within the physical world space based on at least one of a velocity of the movement, an acceleration of the movement, a direction of the movement, or an angle of the movement.

7. The method of claim 6 , further comprising determining a dampening of a perception by the viewer of the movement of the physical world space based on a negative motion of part of the vehicle.

8. The method of claim 7 , wherein the negative motion substantially corresponds with a damped harmonic motion of the movement of the physical world space by the vehicle.

9. The method of claim 1 , further comprising:

determining a negative motion of the vehicle that changes a viewer's perception of the physical world space; and

removing a third subset of data from the data set corresponding to the movement of the physical world space that is changed by the negative motion.

10. The method of claim 1 , wherein the second subset of data comprises a plurality of movements of the physical world space.

11. An apparatus, comprising:

a processor;

a display;

a display motion sensor; and

an environment motion sensor, wherein the processor is configured to:

generate an augmented reality space comprising a portion of a physical world space and a virtual reality object within the physical world space, wherein:

the physical world space is a portion of a physical world within view of a viewer; and

the viewer is located within a vehicle;

receive a first data set from the display motion sensor, the first data set representative of a movement of the display within the vehicle from a first location within the vehicle to a second location within the vehicle, wherein the first data set is indicative of intentional movement of the viewer within the vehicle;

receive a second data set from the environment motion sensor, the second data set directly representative of a movement of the vehicle within the physical world space;

in response to receiving from a presence sensor or a processing device of the vehicle a notification that indicates the display is present in the vehicle:

determine the second data set indicates that the vehicle moved from a first location in the physical world space to a second location within the physical world space;

in response to the vehicle moving from the first location to the second location in the physical world space, remove the second data set to obtain an updated data set; and

adjust at least a portion of the virtual reality object as displayed in the physical world space in view of the updated data set; and

in response to not receiving the notification that the display is present in the vehicle, retain the second data set with the first data set.

12. The apparatus according to claim 11 , wherein the processor is further to receive a third data set representative of a negative motion of the vehicle that changes a viewer's perception of the physical world space.

13. The apparatus of claim 12 , wherein the negative motion counteracts a portion of the movement of the physical world space.

14. The apparatus of claim 11 , wherein the processor, the display, the display motion sensor, and the environment motion sensor are physically integrated as a wearable device.

15. The apparatus of claim 11 , wherein the display motion sensor is physically distal from the display.

16. The apparatus of claim 11 , wherein the environment motion sensor is physically distal from the display.

17. The apparatus of claim 11 , wherein the display motion sensor comprises at least one of an accelerometer, a gyroscope, a GPS sensor, a magnetometer, an imager, a depth sensor, a structured light sensor, a time-of-flight sensor, an ultrasonic sensor, or a wireless signal triangulation sensor.

18. The apparatus of claim 11 , wherein the environment motion sensor comprises at least one of an accelerometer, a gyroscope, a GPS sensor, a magnetometer, an imager, a depth sensor, a structured light sensor, a time-of-flight sensor, an ultrasonic sensor, or a wireless signal triangulation sensor.

19. An apparatus, comprising:

a display;

a first sensor and a second sensor;

a processor coupled to the display, the first sensor, and the second sensor, wherein the processor is configured to:

generate the augmented reality space comprising a portion of a physical world space and a virtual reality object within the physical world space, wherein:

the physical world space is a portion of a physical world within view of a viewer; and

the viewer is located within a vehicle;

receive a first data set from the first sensor, wherein the first data set is representative of a movement of the display within the vehicle from a first location within the vehicle to a second location within the vehicle, wherein the first data set is indicative of intentional movement of the viewer within the vehicle;

receive a second data set from the second sensor, the second data set directly representative of a movement of the vehicle within the physical world space;

in response to receiving from a presence sensor or a processing device of the vehicle a notification that indicates the display is present in the vehicle, determine the second data set indicates that the vehicle moved from a first location in the physical world space to a second location within the physical world space;

in response to the vehicle moving from the first location to the second location in the physical world space, display at least a portion of the virtual reality object as displayed in the physical world space based only on the first data set; and

in response to not receiving the notification that the display is present in the vehicle, display at least a portion of the virtual reality object as displayed in the physical world space based on the first data set and the second data set.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2022
From: YANG, ALLEN YANG; ITANI, SLEIMAN
To: ATHEER, INC.
Reel/Frame 058591/0091 →
Continuity (3)
Continuation 14667550 · Mar 24, 2015
Provisional Application 61970811 · Mar 26, 2014
Related Publication 20210223547A1 · Jul 22, 2021