IP Library Patent Application 18923373
Patent Application
App. No. 18/923,373

VIRTUAL, AUGMENTED, AND MIXED REALITY SYSTEMS AND METHODS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/923,373
Abstract

A method for determining a focal point depth of a user of a three-dimensional (“3D”) display device includes tracking a first gaze path of the user. The method also includes analyzing 3D data to identify one or more virtual objects along the first gaze path of the user. The method further includes when only one virtual object intersects the first gaze path of the user identifying a depth of the only one virtual object as the focal point depth of the user.

Claims (51)

1 . A method for determining a focal point depth of a user of a three dimensional (“3D”) display device, comprising:

analyzing, based on a first gaze path of the user, 3D data to identify one or more virtual objects along the first gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first gaze path, that only one virtual object intersects the first gaze path of the user:

analyzing the 3D data to determine a depth of the only one virtual object; and

determining that the focal point depth of the user is the determined depth of the only one virtual object using only the first gaze path of the user and the 3D data for the only one virtual object,

wherein the first gaze path corresponds to a first eye of the user, and does not correspond to a second eye of the user.

2 . The method of claim 1 , wherein each of the one or more virtual objects is displayed at a respective depth from the user.

3 . The method of claim 1 , wherein analyzing the plurality of 3D data comprises analyzing depth segmentation data corresponding to 3D data.

4 . The method of claim 1 , further comprising, when more than one virtual object intersects the first gaze path of the user:

analyzing, based on a second gaze path of the user, the 3D data to identify one or more virtual objects along the second gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first and second gaze paths, that only one virtual object intersects both the first gaze path and the second gaze path of the user:

analyzing the 3D data to determine a depth of the only one virtual object; and

determining that the focal point depth of the user is the determined depth of the only one virtual object,

wherein the second gaze path corresponds to the second eye of the user, and does not correspond to the first eye of the user.

5 . The method of claim 1 , wherein determining a depth of the only one virtual object comprises analyzing the 3D data.

6 . The method of claim 4 , wherein determining a depth of the only one virtual object comprises analyzing the 3D data.

7 . The method of claim 1 , wherein the only one virtual object is located in a first side of a field of view of the user, the first side of the field of view being closer to the first eye of the user compared to the second eye of the user.

8 . A method for determining a focal point depth of a user of a three dimensional (“3D”) display device, comprising:

analyzing, based on a first gaze path of the user, a plurality of two dimensional (“2D”) image frames displayed by the display device to identify one or more virtual objects along the first gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first gaze path, that only one 2D image frame of the plurality includes a virtual object along the first gaze path of the user:

analyzing the plurality of 2D image frames to determine determining a depth of the only one 2D image frame; and

determining that the focal point depth of the user is the determined depth of the only one 2D image frame using only the first gaze path of the user and 3D data for the virtual object,

wherein the first gaze path corresponds to a first eye of the user, and does not correspond to a second eye of the user.

9 . The method of claim 8 , wherein each of the plurality of 2D image frames are displayed at respective depths from the user.

10 . The method of claim 8 , wherein analyzing the plurality of 2D image frames comprises analyzing depth segmentation data corresponding to the plurality of 2D image frames.

11 . The method of claim 8 , further comprising, when more than one 2D image frame of the plurality includes a virtual object along the first gaze path of the user:

analyzing, based on a second gaze path of the user, the plurality of 2D image frames displayed by the display device to identify one or more virtual objects along the second gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first and second gaze paths, that only one 2D image frame of the plurality includes a virtual object along both the first gaze path and the second gaze path of the user:

analyzing the 3D data to determine a depth of the only one 2D image frame; and

determining that the focal point depth of the user to the determined depth of the only one 2D image frame,

wherein the second gaze path corresponds to the second eye of the user, and does not correspond to the first eye of the user.

12 . The method of claim 8 , wherein determining a depth of the only one 2D image frame comprises analyzing the 2D image frame.

13 . The method of claim 11 , wherein determining a depth of the only one 2D image frame comprises analyzing the 2D image frame.

14 . A system for determining a focal point depth of a user of a three-dimensional (“3D”) display device, comprising:

a processor configured to:

analyze, based on a first gaze path of the user, 3D data to identify one or more virtual objects along the first gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first gaze path, that only one virtual object intersects the first gaze path of the user:

analyze the 3D data to determine a depth of the only one virtual object; and

determine that the focal point depth of the user is the determined depth of the only one virtual object using only the first gaze path of the user and the 3D data for the only one virtual object,

wherein the first gaze path corresponds to a first eye of the user, and does not correspond to a second eye of the user.

15 . The system of claim 14 , further comprising a display subsystem configured to display each of the one or more virtual objects at a respective depth from the user.

16 . The system of claim 14 , wherein the processor is configured to analyze the plurality of 3D data comprises analyzing depth segmentation data corresponding to 3D data.

17 . The system of claim 14 , wherein the processor is configured to, when more than one virtual object intersects the first gaze path of the user:

analyze, based on a second gaze path of the user, the 3D data to identify one or more virtual objects along the second gaze path of the user; and

when it is determined, based on the identified one or more virtual objects and the first and second gaze paths, that only one virtual object intersects both the first gaze path and the second gaze path of the user:

analyze the 3D data to determine a depth of the only one virtual object; and

determine that the focal point depth of the user is the determined depth of the only one virtual object,

wherein the second gaze path corresponds to the second eye of the user, and does not correspond to the first eye of the user.

18 . The system of claim 17 , wherein determining a depth of the only one virtual object comprises analyzing the 3D data.

19 . The system of claim 14 , wherein determining a depth of the only one virtual object comprises analyzing the 3D data.

20 . The system of claim 14 , wherein the only one virtual object is located in a first side of a field of view of the user, the first side of the field of view being closer to the first eye of the user compared to the second eye of the user.

Assignments (2)
SECURITY INTEREST Recorded Oct 29, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073430/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2024
From: TAYLOR, ROBERT BLAKE
To: MAGIC LEAP, INC.
Reel/Frame 068977/0593 →