IP Library Granted Patent US 12,572,200
Granted Patent B2
US 12,572,200 · App. 18/524,254 · Granted Mar 10, 2026

Augmented and virtual reality display systems for oculometric assessments

Inventors: Daniel Farmer (Verdi, NV); Dorion Bryce Liston (Boulder Creek, CA)
Assignee: Magic Leap, Inc.
G06F3/013G02B27/0179A61B5/163G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,572,200
App. No.
18/524,254
Granted
Mar 10, 2026
Kind
B2
Abstract

Example techniques are disclosed for increasing the sensitivity of an augmented or virtual reality display system to collecting eye-tracking data for detecting physiological conditions, such as neural processes. An example method includes accessing eye-tracking information associated with a control population and an experimental population, the eye-tracking information reflecting, for each user of the control population and the experimental population, eye-tracking metrics associated with the user; scaling the eye-tracking information based on the eye-tracking information associated with the control population; and determining a sensitivity measure reflecting a distance measure between the control population and experimental population. The sensitivity measure may be utilized to modify physical or operational parameters for the display system and/or the protocol for performing a test.

Claims (36)

1 . A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations, comprising:

obtaining a first sensitivity measure and a second sensitivity measure, wherein the first sensitivity measure and the second sensitivity measure are generated for a same experimental population and a similar control population;

accessing information identifying display device configurations or oculometric protocols for the first sensitivity measure and the second sensitivity measure;

performing a ratio comparison of the first sensitivity measure and the second sensitivity measure; and

determining which of the first sensitivity measure and the second sensitivity measure is more sensitive to the same experimental population.

2 . The computer-implemented system of claim 1 , wherein the same experimental population or the same control population falls within a same cohort or includes users with a same physiological condition.

3 . The computer-implemented system of claim 1 , wherein the first sensitivity measure is generated based on: 1) eye-tracking information from display devices with a different configuration compared to the second sensitivity measure or 2) eye-tracking information from display devices implementing a different oculometric protocol.

4 . The computer-implemented system of claim 3 , wherein the different configuration includes a different frequency at which eye movements are tracked.

5 . The computer-implemented system of claim 3 , wherein the different oculometric protocol includes different visual stimuli at different perceived depths or depth planes.

6 . The computer-implemented system of claim 1 , wherein performing the ratio comparison of the first sensitivity measure and the second sensitivity measure compares a multitude of sensitivity measures for the same experimental population.

7 . A computer-implemented method, comprising:

obtaining a first sensitivity measure and a second sensitivity measure, wherein the first sensitivity measure and the second sensitivity measure are generated for a same experimental population and a same control population;

accessing information identifying display device configurations or oculometric protocols for the first sensitivity measure and the second sensitivity measure;

performing a ratio comparison of the first sensitivity measure and the second sensitivity measure; and

determining which of the first sensitivity measure and the second sensitivity measure is more sensitive to the same experimental population.

8 . The computer-implemented method of claim 7 , wherein the same experimental population or the same control population falls within a same cohort or includes users with a same physiological condition.

9 . The computer-implemented method of claim 7 , wherein the first sensitivity measure is generated based on: 1) eye-tracking information from display devices with a different configuration compared to the second sensitivity measure or 2) eye-tracking information from display devices implementing a different oculometric protocol.

10 . The computer-implemented method of claim 9 , wherein the different configuration includes a different frequency at which eye movements are tracked.

11 . The computer-implemented method of claim 9 , wherein the different oculometric protocol includes different visual stimuli at different perceived depths or depth planes.

12 . The computer-implemented method of claim 7 , wherein performing the ratio comparison of the first sensitivity measure and the second sensitivity measure compares a multitude of sensitivity measures for the same experimental population.

13 . The computer-implemented method of claim 7 , comprising:

determining, based on the first sensitivity measure and the second sensitivity measure, a particular configuration or oculometric protocol which is most sensitive to the same experimental population.

14 . A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform one or more operations, comprising:

obtaining a first sensitivity measure and a second sensitivity measure, wherein the first sensitivity measure and the second sensitivity measure are generated for a same experimental population and a same control population;

accessing information identifying display device configurations or oculometric protocols for the first sensitivity measure and the second sensitivity measure;

performing a ratio comparison of the first sensitivity measure and the second sensitivity measure; and

determining which of the first sensitivity measure and the second sensitivity measure is more sensitive to the same experimental population.

15 . The non-transitory, computer-readable medium of claim 14 , wherein the same experimental population or the same control population falls within a same cohort or includes users with a same physiological condition.

16 . The non-transitory, computer-readable medium of claim 14 , wherein the first sensitivity measure is generated based on: 1) eye-tracking information from display devices with a different configuration compared to the second sensitivity measure or 2) eye-tracking information from display devices implementing a different oculometric protocol.

17 . The non-transitory, computer-readable medium of claim 16 , wherein the different configuration includes a different frequency at which eye movements are tracked.

18 . The non-transitory, computer-readable medium of claim 16 , wherein the different oculometric protocol includes different visual stimuli at different perceived depths or depth planes.

19 . The non-transitory, computer-readable medium of claim 14 , wherein performing the ratio comparison of the first sensitivity measure and the second sensitivity measure compares a multitude of sensitivity measures for the same experimental population.

20 . The non-transitory, computer-readable medium of claim 14 , comprising:

determining, based on the first sensitivity measure and the second sensitivity measure, a particular configuration or oculometric protocol which is most sensitive to the same experimental population.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2024
From: FARMER, DANIEL; LISTON, DORION BRYCE
To: MAGIC LEAP, INC.
Reel/Frame 068377/0364 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2023
From: FARMER, DANIEL; LISTON, DORION BRYCE
To: MAGIC LEAP, INC.
Reel/Frame 065714/0891 →
Continuity (4)
Continuation 17977410 · Oct 31, 2022
Continuation 17161511 · Jan 28, 2021
Provisional Application 62968887 · Jan 31, 2020
Related Publication 20240103619A1 · Mar 28, 2024
References Cited (56)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 10420465B1 · Stone et al. · 2019 [cited by applicant]
US 11487356B2 · Farmer · 2022 [cited by applicant]
US 11853476B2 · Farmer · 2023 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160262613A1 · Klin et al. · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20160360970A1 · Tzvieli et al. · 2016 [cited by applicant]
US 20170131765A1 · Perek et al. · 2017 [cited by applicant]
US 20170237974A1 · Samec et al. · 2017 [cited by applicant]
US 20170290504A1 · Khaderi et al. · 2017 [cited by applicant]
US 20170365101A1 · Samec et al. · 2017 [cited by applicant]
US 20180121608A1 · Gross et al. · 2018 [cited by applicant]
US 20190110753A1 · Zhang et al. · 2019 [cited by applicant]
US 20190150727A1 · Blaha et al. · 2019 [cited by applicant]
US 20190243448A1 · Miller et al. · 2019 [cited by applicant]
US 20190391638A1 · Khaderi et al. · 2019 [cited by applicant]
US 20200249753A1 · Stent et al. · 2020 [cited by applicant]
US 20210041704A1 · Bhargava et al. · 2021 [cited by applicant]
US 20210199676A1 · Nouso · 2021 [cited by examiner]
US 20210240261A1 · Farmer · 2021 [cited by applicant]
US 20230067703A1 · Farmer · 2023 [cited by applicant]
WO 2018237347A1 · 2018 [cited by applicant]
WO 2020069037A1 · 2020 [cited by applicant]
International Preliminary Report on Patentability received for PCT Patent Application No. PCT/US21/15558, mailed on Aug. 11, 2022, 9 pages. [cited by applicant]
Office Action for Japanese Patent Application No. 2022-545997, mailed on Mar. 12, 2024, 6 pages (3 pages of English Translation and 3 pages of Original Document). [cited by applicant]
Supplementary European Search Report and Search Opinion received for European Application No. 21747281.0, mailed on Jan. 22, 2024, 8 pages. [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005, 3 pages. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385, https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/˜azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995, 262 pages. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005, 393 pages, https://web.media.mit.edu/˜raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US 21 /15558, mailed Apr. 8, 2021 (MLEAP.304WO), 20 pages. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Liston et al., “Oculometric Assessment of Sensorimotor Impairment Associated with TBI,” Optom Vis Sci., Jan. 2017, 94(1):51-59. [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. ACM CHI 2000 Human Factors in Computin… [cited by applicant]