IP Library Granted Patent US 12,158,986
Granted Patent B2
US 12,158,986 · App. 18/304,311 · Granted Dec 3, 2024

Virtual, augmented, and mixed reality systems and methods

Inventor: Robert Blake Taylor (Porter Ranch, CA)
Assignee: Magic Leap, Inc.
G06F3/013G06T7/50G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,158,986
App. No.
18/304,311
Granted
Dec 3, 2024
Kind
B2
Abstract

A method for determining a focal point depth of a user of a three-dimensional (“3D”) display device includes tracking a first gaze path of the user. The method also includes analyzing 3D data to identify one or more virtual objects along the first gaze path of the user. The method further includes when only one virtual object intersects the first gaze path of the user identifying a depth of the only one virtual object as the focal point depth of the user.

Claims (35)

1. A system for determining a focal point depth of a user of a three-dimensional (“3D”) display device, comprising:

an eye tracking subsystem configured to track a first gaze path of the user, the first gaze path corresponding to a first eye of the user, and not corresponding to a second eye of the user; and

a processor configured to:

analyze, based on the first gaze path, 3D data to identify one or more virtual objects along the first gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first gaze path, that only one virtual object intersects the first gaze path of the user:

analyze the 3D data to determine a depth of the only one virtual object; and

determine that the focal point depth of the user is the determined depth of the only one virtual object using only the first gaze path of the user and the 3D data for the only one virtual object.

2. The system of claim 1 , further comprising a display subsystem configured to display each of the one or more virtual objects at a respective depth from the user.

3. The system of claim 1 , wherein the processor is configured to analyze the plurality of 3D data comprises analyzing depth segmentation data corresponding to 3D data.

4. The system of claim 1 , wherein the eye tracking subsystem is configured to, when more than one virtual object intersects the first gaze path of the user, track a second gaze path of the user, the second gaze path corresponding to the second eye of the user, and not corresponding to the first eye of the user;

wherein the processor is configured to, when more than one virtual object intersects the first gaze path of the user:

analyze, based on the second gaze path, the 3D data to identify one or more virtual objects along the second gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first and second gaze paths, that only one virtual object intersects both the first gaze path and the second gaze path of the user:

analyze the 3D data to determine a depth of the only one virtual object; and

determine that the focal point depth of the user is the determined depth of the only one virtual object.

5. The system of claim 4 , wherein determining a depth of the only one virtual object comprises analyzing the 3D data.

6. The system of claim 1 , wherein determining a depth of the only one virtual object comprises analyzing the 3D data.

7. The system of claim 1 , wherein the only one virtual object is located in a first side of a field of view of the user, the first side of the field of view being closer to the first eye of the user compared to the second eye of the user.

8. A system for determining a focal point depth of a user of a three-dimensional (“3D”) display device, comprising:

an eye tracking subsystem configured to track a first gaze path of the user, the first gaze path corresponding to a first eye of the user, and not corresponding to a second eye of the user; and

a processor configured to:

analyze, based on the first gaze path, a plurality of two-dimensional (“2D”) image frames displayed by the display device to identify one or more virtual objects along the first gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first gaze path, that only one 2D image frame of the plurality includes a virtual object along the first gaze path of the user:

analyze the plurality of 2D image frames to determine a depth of the only one 2D image frame; and

determine that the focal point depth of the user is the determined depth of the only one 2D image frame using only the first gaze path of the user and 3D data for the virtual object.

9. The system of claim 8 , further comprising a display subsystem configured to display each of the plurality of 2D image frames at respective depths from the user.

10. The system of claim 8 , wherein analyzing the plurality of 2D image frames comprises analyzing depth segmentation data corresponding to the plurality of 2D image frames.

11. The system of claim 8 , wherein the eye tracking subsystem is configured to, when more than one 2D image frame of the plurality includes a virtual object along the first gaze path of the user, track a second gaze path of the user, the second gaze path corresponding to the second eye of the user, and not corresponding to the first eye of the user;

wherein the processor is configured to, when more than one virtual object intersects the first gaze path of the user:

analyze, based on the second gaze path, the plurality of 2D image frames displayed by the display device to identify one or more virtual objects along the second gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first and second gaze paths, that only one 2D image frame of the plurality includes a virtual object along both the first gaze path and the second gaze path of the user:

analyze the 3D data to determine a depth of the only one 2D image frame; and

determine that the focal point depth of the user to the determined depth of the only one 2D image frame.

12. The system of claim 11 , wherein determining a depth of the only one 2D image frame comprises analyzing the 2D image frame.

13. The system of claim 8 , wherein determining a depth of the only one 2D image frame comprises analyzing the 2D image frame.

Assignments (3)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073438/0463 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2023
From: TAYLOR, ROBERT BLAKE
To: MAGIC LEAP, INC.
Reel/Frame 063394/0515 →
Continuity (3)
Continuation 17110670 · Dec 3, 2020
Provisional Application 62945027 · Dec 6, 2019
Related Publication 20230251710A1 · Aug 10, 2023