IP Library Granted Patent US 11,386,529
Granted Patent B2
US 11,386,529 · App. 17/110,638 · Granted Jul 12, 2022

Virtual, augmented, and mixed reality systems and methods

Inventor: Robert Blake Taylor (Porter Ranch, CA)
Assignee: Magic Leap, Inc.
G06T5/002G06T7/50G06T19/006G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,386,529
App. No.
17/110,638
Granted
Jul 12, 2022
Kind
B2
Abstract

A method for displaying a three dimensional (“3D”) image includes rendering a frame of 3D image data. The method also includes analyzing the frame of 3D image data to generate best known depth data. The method further includes using the best known depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively. Moreover, the method includes displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.

Claims (38)

1. A method for displaying a three dimensional (“3D”) image in discrete mode to a user, comprising:

rendering a frame of 3D image data;

analyzing the frame of 3D image data to generate depth data;

identifying a first set of virtual objects/pixels having respective depths in a first depth range between a near clip and a far clip;

identifying a second set of virtual objects/pixels having respective depths in a second range that includes one of the near clip and the far clip;

blurring the second set of virtual objects/pixels when the user is focused on the second set of virtual objects/pixels, thereby generating a blurred second set of virtual objects/pixels; and

displaying the first set of virtual objects/pixels and the blurred second set of virtual objects/pixels to the user.

2. The method of claim 1 , further comprising projecting the frame of 3D image data to generate a two dimensional (“2D”) image frame,

wherein blurring the second set of virtual objects/pixels comprises blurring portions of the 2D image frame corresponding to the second set of virtual objects/pixels to generate a partially blurred 2D image frame, and

wherein displaying the first set of virtual objects/pixels and the blurred second set of virtual objects/pixels to the user comprises displaying the partially blurred 2D image frame to the user.

3. The method of claim 1 , further comprising combining the first set of virtual objects/pixels and the blurred second set of virtual objects/pixels to generate a partially blurred two dimensional (“2D”) image frame, wherein displaying the first set of virtual objects/pixels and the blurred second set of virtual objects/pixels to the user comprises displaying the partially blurred 2D image frame to the user.

4. The method of claim 1 , wherein blurring the second set of virtual objects/pixels based on respective depths to generate the blurred second set of virtual objects/pixels comprises blurring each of the second set of virtual objects/pixels to the same degree.

5. The method of claim 1 ,

wherein blurring the second set of virtual objects/pixels based on depths to generate the blurred second set of virtual objects/pixels comprises variably blurring each of the second set of virtual objects/pixels, and

wherein respective degrees of blurring of each of the second set of virtual objects/pixels are proportional to the respective depths.

6. The method of claim 5 , wherein the degrees of blurring are directly proportional to the respective depths.

7. The method of claim 1 , wherein the second depth range includes the far clip.

8. The method of claim 7 , wherein the far clip corresponds to about 1.15 diopters.

9. The method of claim 1 , wherein the second depth range includes the near clip.

10. The method of claim 9 , wherein the near corresponds to about 2.7 diopters.

11. The method of claim 1 , further comprising tracking a point of vergence of the user to the second set of virtual objects/pixels.

12. The method of claim 1 , wherein the first depth range is between a near clip and a far clip, and the depths of the identified second set of virtual objects/pixels includes one of the near clip and the far clip.

13. The method of claim 1 , wherein the degrees of blurring are one of linearly proportional, logarithmically proportional, and asymmetrically proportional to the respective depths.

14. A method for displaying a three dimensional (“3D”) image in blended mode, comprising:

rendering a frame of 3D image data;

analyzing the frame of 3D image data to generate depth data;

identifying a virtual object/pixel having a depth within the 3D image data;

determining a difference/distance between the depth of the virtual object/pixel and a depth of one or both of each a near clip and a far clip;

blurring the virtual object/pixel based on the determined difference/distance between the depth of the virtual object/pixel and the depth of the one or both of each of the near clip and the far clip to generate a blurred virtual object/pixel; and

displaying the blurred virtual object/pixel to the user.

15. The method of claim 14 , further comprising:

using the depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively,

wherein at least one of the near and far frames of 2D image data including the blurred virtual object/pixel; and

displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.

16. The method of claim 14 , wherein the one or both of the near clip and the far clip comprises the near clip.

17. The method of claim 14 , wherein the one or both of the near clip and the far clip comprises the far clip.

18. The method of claim 14 , wherein the one or both of the near clip and the far clip comprises the near clip and the far clip.

19. The method of claim 14 , wherein the virtual object/pixel is blurred as a linear, logarithmic, or asymmetric function of the determined difference/distance between the depth of the virtual object/pixel and the depth of the one or both of each of the near clip and the far clip.

Assignments (2)
SECURITY INTEREST Recorded May 24, 2022
From: MOLECULAR IMPRINTS, INC.; MENTOR ACQUISITION ONE, LLC; MAGIC LEAP, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060338/0665 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2021
From: TAYLOR, ROBERT BLAKE
To: MAGIC LEAP, INC.
Reel/Frame 054965/0263 →
Continuity (2)
Provisional Application 62945024 · Dec 6, 2019
Related Publication 20210174472A1 · Jun 10, 2021
Cited By (2)
US 12,315,118 US 12,598,286