IP Library Granted Patent US 10,134,186
Granted Patent B2
US 10,134,186 · App. 14/702,739 · Granted Nov 20, 2018

Predicting head movement for rendering virtual objects in augmented or virtual reality systems

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,134,186
App. No.
14/702,739
Granted
Nov 20, 2018
Kind
B2
Abstract

One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.

Claims (17)

1. A user display device, comprising:

a housing frame mountable on a head of a user;

a lens mountable on the housing frame;

a projection subsystem coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on a prediction of a predicted head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object, wherein the location of appearance of the display object is moved in response to the predicted head movement exceeding a nominal head movement value and the projection subsystem partially compensating for a perceived pixel spreading in response to the predicted head movement by decreasing both a size and an intensity of a first set of pixels in an image frame associated with the display object based at least on respective size and intensity of another set of pixels in the image, wherein the nominal head movement value corresponds to a nominal speed or a nominal acceleration; and

a first pair of cameras mountable on the housing frame to capture a field of view image as seen by eyes of the user, wherein the field of view image contains at least one physical object, wherein the captured field of view image is used to gather information regarding movements of the head of the user, wherein the information regarding movements of the head of the user only consists of a center of attention of the user, an orientation of the head of the user, a direction of the head of the user, a speed of movement of the head of the user, an acceleration of the head of the user and a distance of the head of the user in relation to a local environment of the user.

2. The user display device of claim 1 , wherein the prediction of the predicted head movement of the user is based on a prediction of a user's shift in focus.

3. The user display device of claim 1 , wherein the prediction of the predicted head movement of the user is based on a set historical attributes of the user.

4. The user display device of claim 1 , further comprising a second pair of cameras mountable on the housing frame to track a movement of eyes of the user and estimate a depth of focus of the eyes of the user based on the tracked movement of the eyes.

5. The user display device of claim 4 , wherein the projection subsystem projects the display object based on the estimated depth of focus.

6. The user display device of claim 1 , wherein the projection subsystem projects the display object in a manner such that the display object and the physical object captured through the first pair of cameras are inter-mixed and appear together in a same frame.

7. The user display device of claim 6 , wherein the location of appearance is based at least in part on the physical object.

8. The user display device of claim 7 , wherein the display object and the physical object comprise spatial relationship, wherein the spatial relationship comprises a placement of the display object based at least in part the physical object.

9. The user display device of claim 1 , wherein the lens comprises at least one transparent surface to selectively allow a transmission light such that the user is able to view a local environment.

10. The user display device of claim 9 , wherein the projection subsystem projects the display object in a manner such that the user views both the display object and the local environment as viewed through the transparent surface of the lens.

11. The user display device of claim 1 , further comprising at least one inertial transducer to capture a set of inertial measurements indicative of movement of the head of the user, wherein the set of inertial measurements comprises a speed of movement of the head of the user, an acceleration of movement of the head of the user, a direction of movement of the head of the user, a position of the head of the user and an orientation of the head of the user.

12. The user display device of claim 1 , further comprising at least one light source to illuminate at least one of the head of the user and a local environment of the user.

13. The user display device of claim 1 , wherein the display object is one of a virtual object and an augmented virtual object.

Assignments (3)
ASSIGNMENT OF SECURITY INTEREST IN PATENTS Recorded Nov 7, 2019
From: JPMORGAN CHASE BANK, N.A.
To: CITIBANK, N.A.
Reel/Frame 050967/0138 →
PATENT SECURITY AGREEMENT Recorded Aug 22, 2019
From: MAGIC LEAP, INC.; MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC
To: JP MORGAN CHASE BANK, N.A.
Reel/Frame 050138/0287 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2016
From: SCHOWENGERDT, BRIAN T.; MILLER, SAMUEL A.
To: MAGIC LEAP, INC.
Reel/Frame 040774/0390 →