IP Library Granted Patent US 11,922,602
Granted Patent B2
US 11,922,602 · App. 17/805,615 · Granted Mar 5, 2024

Virtual, augmented, and mixed reality systems and methods

Inventor: Robert Blake Taylor (Porter Ranch, CA)
Assignee: Magic Leap, Inc.
G06T5/002G06T7/50G06T19/006G06T2207/10028
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,602
App. No.
17/805,615
Granted
Mar 5, 2024
Kind
B2
Abstract

A method for displaying a three dimensional (“3D”) image includes rendering a frame of 3D image data. The method also includes analyzing the frame of 3D image data to generate best known depth data. The method further includes using the best known depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively. Moreover, the method includes displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.

Claims (35)

1. A method for displaying a three dimensional (“3D”) image to a user, comprising:

rendering a frame of 3D image data;

analyzing the frame of 3D image data to generate depth data;

identifying a set of virtual objects/pixels having respective depths in a range that includes one of a near clip and a far clip;

blurring the set of virtual objects/pixels when the user is focused on the set of virtual objects/pixels, thereby generating a blurred set of virtual objects/pixels; and

displaying the blurred set of virtual objects/pixels to the user.

2. The method of claim 1 , further comprising projecting the frame of 3D image data to generate a two dimensional (“2D”) image frame,

wherein blurring the set of virtual objects/pixels comprises blurring portions of the 2D image frame corresponding to the set of virtual objects/pixels to generate a partially blurred 2D image frame, and

wherein displaying the blurred set of virtual objects/pixels to the user comprises displaying the partially blurred 2D image frame to the user.

3. The method of claim 1 , further comprising combining a second set of virtual objects/pixels and the blurred set of virtual objects/pixels to generate a partially blurred two dimensional (“2D”) image frame, wherein displaying the blurred set of virtual objects/pixels to the user comprises displaying the partially blurred 2D image frame to the user.

4. The method of claim 1 , further comprising blurring the set of virtual objects/pixels based on respective depths to generate the blurred set of virtual objects/pixels.

5. The method of claim 4 , further comprising blurring each of the set of virtual objects/pixels to the same degree.

6. The method of claim 4 , further comprising variably blurring each of the set of virtual objects/pixels,

wherein respective degrees of blurring of the each of the set of virtual objects/pixels are proportional to the respective depths.

7. The method of claim 4 , wherein the degrees of blurring are directly proportional to the respective depths.

8. The method of claim 4 , wherein the degrees of blurring are one of linearly proportional, logarithmically proportional, and asymmetrically proportional to the respective depths.

9. The method of claim 1 , wherein the depth range includes the far clip.

10. The method of claim 9 , wherein the far clip corresponds to about 1.15 diopters.

11. The method of claim 1 , wherein the depth range includes the near clip.

12. The method of claim 11 , wherein the near clip corresponds to about 2.7 diopters.

13. The method of claim 1 , further comprising tracking a point of vergence of the user to the set of virtual objects/pixels.

14. A method for displaying a three dimensional (“3D”) image, comprising:

analyzing a frame of 3D image data to generate depth data;

identifying a virtual object/pixel having a depth within the 3D image data;

determining a difference/distance between the depth of the virtual object/pixel and a depth of one or both of each a near clip and a far clip;

blurring the virtual object/pixel based on the determined difference/distance between the depth of the virtual object/pixel and the depth of the one or both of each of the near clip and the far clip to generate a blurred virtual object/pixel; and

displaying the blurred virtual object/pixel to the user.

15. The method of claim 14 , further comprising:

using the depth data to segment the 3D image data into near and far frames of two dimensional (“2D”) image data corresponding to near and far depths respectively,

wherein at least one of the near and far frames of 2D image data including the blurred virtual object/pixel; and

displaying near and far 2D image frames corresponding to the near and far frames of 2D image data at near and far depths to a user respectively.

16. The method of claim 14 , wherein the one or both of the near clip and the far clip comprises the near clip.

17. The method of claim 14 , wherein the one or both of the near clip and the far clip comprises the far clip.

18. The method of claim 14 , wherein the one or both of the near clip and the far clip comprises the near clip and the far clip.

19. The method of claim 14 , wherein the virtual object/pixel is blurred as a linear, logarithmic, or asymmetric function of the determined difference/distance between the depth of the virtual object/pixel and the depth of the one or both of each of the near clip and the far clip.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded Jul 1, 2022
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 060560/0438 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2022
From: TAYLOR, ROBERT BLAKE
To: MAGIC LEAP, INC.
Reel/Frame 060113/0369 →
Continuity (3)
Continuation 17110638 · Dec 3, 2020
Provisional Application 62945024 · Dec 6, 2019
Related Publication 20220309621A1 · Sep 29, 2022
Cited By (3)
US 12,315,118 US 12,551,793 US 12,667,783