IP Library Granted Patent US 11,315,214
Granted Patent B2
US 11,315,214 · App. 16/937,510 · Granted Apr 26, 2022

Mixed reality system with color virtual content warping and method of generating virtual con tent using same

Inventors: Michael Harold Liebenow (Loxahatchee, FL); Reza Nourai (Danville, CA); Robert Blake Taylor (Porter Ranch, CA); Fahri Yaras (Cedar Park, TX)
Assignee: Magic Leap, Inc.
G06T3/0093G06F3/012G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,315,214
App. No.
16/937,510
Granted
Apr 26, 2022
Kind
B2
Abstract

A computer implemented method for warping multi-field color virtual content for sequential projection includes obtaining first and second color fields having different first and second colors. The method also includes determining a first time for projection of a warped first color field. The method further includes determining a second time for projection of a warped second color field. Moreover, the method includes predicting a first pose at the first time and predicting a second pose at the second time. In addition, the method includes generating the warped first color field by warping the first color field based on the first pose. The method also includes generating the warped second color field by warping the second color field based on the second pose.

Claims (44)

1. A computer implemented method for warping multi-field color virtual content for sequential projection, the method comprising:

obtaining first and second color fields having different first and second colors;

generating an intermediate warped first color field by warping the first color field based on a first intermediate head pose;

generating an intermediate warped second color field by warping the second color field based on a second intermediate head pose;

generating a warped first color field by warping the intermediate warped first color field based on a first head pose; and

generating a warped second color field by warping the intermediate warped second color field based on a second head pose,

wherein generating the warped first color field is less calculation intensive than generating the intermediate warped first color field, and

wherein generating the warped second color field is less calculation intensive than generating the intermediate warped second color field.

2. The method of claim 1 , wherein the first color field comprises first color field information at an X, Y location.

3. The method of claim 2 , wherein the first color field information comprises a first brightness in the first color.

4. The method of claim 3 , wherein the second color field comprises second color field information at the X, Y location.

5. The method of claim 4 , wherein the second color field information comprises a second brightness in the second color.

6. The method of claim 1 , wherein the warped first color field comprises warped first color field information at a first warped X, Y location.

7. The method of claim 6 , wherein the warped second color field comprises warped second color field information at a second warped X, Y location.

8. The method of claim 1 , wherein warping the first color field based on the first head pose comprises applying a first transformation to the first color field to generate the warped first color field.

9. The method of claim 1 , wherein warping the second color field based on the second head pose comprises applying a second transformation to the second color field to generate the warped second color field.

10. The method of claim 1 , further comprising:

sending the warped first and second color fields to a sequential projector; and

the sequential projector sequentially projecting the warped first color field and the warped second color field.

11. The method of claim 10 , wherein the warped first color field is projected at a first time corresponding to a first pose, and wherein the warped second color field is projected at a second time corresponding to a second pose.

12. The method of claim 11 , further comprising determining the first time by analyzing a frame rate and another characteristic of the sequential projector.

13. The method of claim 11 , further comprising determining the second time by analyzing a frame rate and another characteristic of the sequential projector.

14. A system for warping multi-field color virtual content for sequential projection, comprising:

a warping unit to receive first and second color fields having different first and second colors for sequential projection, the warping unit comprising:

a transform unit to:

generate intermediate warped first and second color fields by warping the respective first and second color fields based on the respective first and second intermediate head poses; and

generate warped first and second color fields by warping the respective intermediate warped first and second color fields based on the respective first and second head poses,

wherein generating the warped first and second color fields is less calculation intensive than generating the intermediate warped first and second color fields.

15. The system of claim 14 , wherein the warping unit is also configured to determine first and second times corresponding to first and second poses for projecting the respective warped first and second color fields by analyzing a frame rate and another characteristic of a related projection system.

16. The system of claim 14 , wherein the first color field comprises first color field information at an X, Y location, and

wherein the first color field information comprises a first brightness in the first color.

17. The system of claim 16 , wherein the second color field comprises second color field information at the X, Y location, and

wherein the second color field information comprises a second brightness in the second color.

18. The system of claim 17 , wherein the warped first color field comprises warped first color field information at a first warped X, Y location, and

wherein the warped second color field comprises warped second color field information at a second warped X, Y location.

19. A computer program product embodied in a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for warping multi-field color virtual content for sequential projection, the method comprising:

obtaining first and second color fields having different first and second colors;

generating an intermediate warped first color field by warping the first color field based on a first intermediate head pose;

generating an intermediate warped second color field by warping the second color field based on a second intermediate head pose;

generating a warped first color field by warping the intermediate warped first color field based on a first head pose; and

generating a warped second color field by warping the intermediate warped second color field based on a second head pose,

wherein generating the warped first color field is less calculation intensive than generating the intermediate warped first color field, and

wherein generating the warped second color field is less calculation intensive than generating the intermediate warped second color field.

20. The computer program product of claim 19 , the method further comprising determining first and second times corresponding to first and second poses for projecting the respective warped first and second color fields by analyzing a frame rate and another characteristic of a related projection system.

Assignments (2)
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 23, 2020
From: NOURAI, REZA; LIEBENOW, MICHAEL HAROLD; TAYLOR, ROBERT BLAKE; YARAS, FAHRI
To: MAGIC LEAP, INC.
Reel/Frame 053298/0733 →
Cited By (3)
US 12,190,468 US 12,386,417 US 12,669,710