IP Library Granted Patent US 10,573,288
Granted Patent B2
US 10,573,288 · App. 15/834,540 · Granted Feb 25, 2020

Methods and apparatus to use predicted actions in virtual reality environments

Inventors: Manuel Christian Clement (Felton, CA); Stefan Welker (Mountain View, CA)
Assignee: GOOGLE LLC
G10H3/00G10H1/0008G10H1/14G10H7/008G10H2220/201G10H2220/401G10H2220/455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,573,288
App. No.
15/834,540
Granted
Feb 25, 2020
Kind
B2
Abstract

Methods and apparatus to use predicted actions in VR environments are disclosed. An example method includes predicting a predicted time of a predicted virtual contact of a virtual reality controller with a virtual object, determining, based on at least one parameter of the predicted virtual contact, a characteristic of a virtual output the object would make in response to the virtual contact, and initiating producing the virtual output before the predicted time of the virtual contact of the controller with the virtual object.

Claims (34)

1. A method comprising:

predicting a predicted time of a predicted virtual contact of a virtual reality controller with a virtual object within a virtual environment displayed by head-mounted device;

determining, based on at least one parameter of the predicted virtual contact and a predicted latency, a characteristic of a virtual output to be produced by the virtual object in response to the virtual contact; and

initiating producing the virtual output in response to the predicted latency of the virtual contact of the virtual reality controller with the virtual object being determined.

2. The method of claim 1 , wherein the virtual object is at least one of a musical instrument, a document, a household item, a door knob, or a table.

3. The method of claim 1 , wherein the virtual output is at least one of sound, light, color of light, color saturation, or acoustic shape of a sound.

4. The method of claim 1 , wherein the predicting the virtual contact is predicted using a determined location and a determined velocity to extrapolate to a predicted future location.

5. The method of claim 1 , further comprising predicting the at least one parameter of the predicted virtual contact, wherein the at least one parameter comprises at least one of a velocity of impact, a location of impact, a failure to impact, a momentum, a force, a direction of impact, an area of impact, or a missed contact.

6. The method of claim 1 , further comprising, when the contact does not occur, automatically adjusting a position of the virtual object so the virtual reality controller contacts the virtual object at another time.

7. The method of claim 1 , further comprising:

determining a characteristic of the virtual contact of the virtual reality controller with the virtual object, the virtual contact being a first virtual contact; and

predicting a second virtual contact of the virtual reality controller with the virtual object based on the determining the characteristic of the first virtual contact of the virtual reality controller with the virtual object.

8. The method of claim 7 , further comprising:

determining a gesture of the virtual reality controller; and

adjusting a position parameter associated with the virtual object in response to the determining the characteristic of the virtual contact of the virtual reality controller on the virtual object.

9. The method of claim 8 , wherein the position parameter comprises at least one of a location, an angle, or a height.

10. The method of claim 8 , wherein the gesture includes at least one of a throw, a toss, a flip, a push, a kick, or a swipe.

11. The method of claim 1 , further comprising: determining a gesture of the virtual reality controller; and repositioning the virtual object in response to the gesture.

12. The method of claim 11 , further comprising applying a position parameter of the repositioned virtual object to automatically position another virtual object.

13. An apparatus comprising:

a processor; and a non-transitory machine-readable storage media storing instruments that, when executed, causes the processor to:

determine a current location, a current direction and a current velocity of a virtual reality controller with respect to a virtual object within a virtual environment displayed by a head-mounted device;

predict a predicted time of a predicted virtual contact of the virtual reality controller with the virtual object; initiate producing a virtual output based on the predicted time of the virtual contact of the virtual reality controller with the virtual object; and

determine a predicted future location based on at least the current location, the current direction and the current velocity.

14. The apparatus of claim 13 , wherein the virtual object is at least one of a musical instrument, a document, a household item, a door knob, or a table.

15. The apparatus of claim 13 , wherein the virtual output is at least one of sound, light, color of light, color saturation, or acoustic shape of a sound.

16. The apparatus of claim 13 , further comprising tracking a predicted latency from when the virtual output is initiated and when the object output is started to be rendered.

17. The apparatus of claim 16 , wherein the predicted latency is determined from at least one of an average, a windowed average, a moving average, or an exponential average.

18. A non-transitory machine-readable media storing machine-readable instructions that, when executed, cause a machine to at least:

predict a predicted time of a predicted virtual contact of a virtual reality controller with a virtual object within a virtual environment displayed by a head-mounted device;

determine, based on at least one parameter of the predicted virtual contact and a predicted latency, a characteristic of a virtual output to be produced by the virtual object in response to the virtual contact; and

initiate producing the virtual output in response to the predicted latency of the virtual contact of the virtual reality controller with the virtual object being determined.

19. The non-transitory media of claim 18 , wherein the predicted virtual contact is predicted using the at least one parameter to determine a predicted future location.

20. The non-transitory media of claim 19 , wherein the at least one parameter comprises at least one of a velocity of impact or a location of impact.

Assignments (2)
CHANGE OF NAME Recorded Aug 16, 2018
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 046840/0630 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2017
From: CLEMENT, MANUEL CHRISTIAN; WELKER, STEFAN
To: GOOGLE INC.
Reel/Frame 044375/0916 →
Continuity (2)
Continuation 15151169 · May 10, 2016
Related Publication 20180108334A1 · Apr 19, 2018