IP Library Granted Patent US 12,498,575
Granted Patent B2
US 12,498,575 · App. 18/395,195 · Granted Dec 16, 2025

Systems and methods for operating a display system based on user perceptibility

Inventors: Lionel Ernest Edwin (Hollywood, FL); Ivan Li Chuen Yeoh (Wesley Chapel, FL); Samuel A. Miller (Hollywood, FL); Edwin Joseph Selker (Palo Alto, CA); Adam Charles Carlson (Miami, FL); Bjorn Nicolaas Servatius Vlaskamp (Plantation, FL); Paul M. Greco (Parkland, FL)
Assignee: MAGIC LEAP, INC.
G02B27/0172G02B27/0179G06T19/006G06V40/19G09G5/003G02B2027/011G02B2027/0138G02B2027/014G02B2027/0178G02B2027/0187G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,498,575
App. No.
18/395,195
Granted
Dec 16, 2025
Kind
B2
Abstract

Systems and methods are disclosed for operating a head-mounted display system based on user perceptibility. The display system may be an augmented reality display system configured to provide virtual content on a plurality of depth planes by presenting the content with different amounts of wavefront divergence. Some embodiments include obtaining an image captured by an imaging device of the display system. Whether a threshold measure or more of motion blur is determined to be exhibited in one or more regions of the image. Based on a determination that the threshold measure or more of motion blur is exhibited in one or more regions of the image, one or more operating parameters of the wearable display are adjusted. Example operating parameter adjustments comprise adjusting the depth plane on which content is presented (e.g., by switching from a first depth plane to a second depth plane), adjusting a rendering quality, and adjusting power characteristics of the system.

Claims (19)

1 . An augmented reality system comprising:

a head-mounted display configured to present virtual content to a user;

an imaging device facing away from the head-mounted display, the imaging device configured to capture images;

at least one processor communicatively coupled to the head-mounted display and the imaging device, the at least one processor configured to:

obtain a first image captured by the imaging device;

in response to obtaining the first image:

detect a first quantity of identifiable features in the first image;

obtain a second image captured after the first image by the imaging device;

in response to obtaining the second image:

detect a second quantity of identifiable features in the second image, the second quantity being different from the first quantity;

identify image blur caused by rapid movement of an eye of the user based on changes in the quantity of identifiable features by determining whether the second quantity of identifiable features is less than the first quantity of identifiable features by at least a predetermined threshold quantity of identifiable features; and

in response to an identification of image blur caused by rapid movement of the eye of the user by determining that the second quantity of identifiable features is less than the first quantity of identifiable features by at least the predetermined threshold quantity of identifiable features, adjust one or more operating parameters of the head-mounted display associated with a reduction in visual perceptibility.

2 . The augmented reality system of claim 1 , wherein the imaging device faces the user, the imaging device configured to capture images of the eye of the user.

3 . The augmented reality system of claim 2 , wherein the identifiable features comprise identifiable eye features.

4 . The augmented reality system of claim 3 , wherein the eye features include one or more iris features.

5 . The augmented reality system of claim 4 , wherein the one or more iris features include a texture, a pattern, a key point in the iris, or a combination thereof.

6 . The augmented reality system of claim 3 , wherein the eye features include one or more scleral features.

7 . The augmented reality system of claim 6 , wherein the one or more scleral features include a blood vessel.

8 . The augmented reality system of claim 1 , wherein the first and second images comprise first and second consecutively-captured images.

Assignments (2)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2024
From: EDWIN, LIONEL ERNEST; YEOH, IVAN LI CHUEN; MILLER, SAMUEL A.; SELKER, EDWIN JOSEPH; CARLSON, ADAM C.; VLASKAMP, BJORN NICOLAAS SERVATIUS; GRECO, PAUL M.
To: MAGIC LEAP, INC.
Reel/Frame 067312/0068 →
Continuity (5)
Division 17376514 · Jul 15, 2021
Continuation 16389529 · Apr 19, 2019
Provisional Application 62702153 · Jul 23, 2018
Provisional Application 62660180 · Apr 19, 2018
Related Publication 20240126086A1 · Apr 18, 2024
References Cited (99)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 8483450B1 · Derakhshani et al. · 2013 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski et al. · 2018 [cited by applicant]
US 9900510B1 · Karafin et al. · 2018 [cited by applicant]
US 10242501B1 · Pusch et al. · 2019 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20060147094A1 · Yoo · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20090327777A1 · Vasquez et al. · 2009 [cited by applicant]
US 20100245093A1 · Kobetski et al. · 2010 [cited by applicant]
US 20110150334A1 · Du et al. · 2011 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162448A1 · Au et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130002813A1 · Vaught et al. · 2013 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20130278631A1 · Border et al. · 2013 [cited by applicant]
US 20140003734A1 · Umansky et al. · 2014 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140192147A1 · Mack et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150123820A1 · Merle et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150215517A1 · Kusaka · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150234254A1 · Schowengerdt · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150294148A1 · Mohanakrishnan · 2015 [cited by examiner]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · Tekolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160070105A1 · Tannoudiji et al. · 2016 [cited by applicant]
US 20160077337A1 · Raffle et al. · 2016 [cited by applicant]
US 20160134863A1 · Horesh · 2016 [cited by applicant]
US 20160139402A1 · Lapstun · 2016 [cited by applicant]
US 20160274660A1 · Publicover et al. · 2016 [cited by applicant]
US 20170004648A1 · Li · 2017 [cited by applicant]
US 20170068119A1 · Antaki et al. · 2017 [cited by applicant]
US 20170108697A1 · El-Ghoroury · 2017 [cited by examiner]
US 20170109580A1 · Kaehler · 2017 [cited by examiner]
US 20170148215A1 · Aksoy et al. · 2017 [cited by applicant]
US 20170154464A1 · Lanier et al. · 2017 [cited by applicant]
US 20170180705A1 · Erickson · 2017 [cited by applicant]
US 20170206412A1 · Kaehler · 2017 [cited by applicant]
US 20170214907A1 · Lapstun · 2017 [cited by applicant]
US 20170285344A1 · Benko et al. · 2017 [cited by applicant]
US 20180008141A1 · Krueger · 2018 [cited by applicant]
US 20180220060A1 · Kusaka · 2018 [cited by applicant]
US 20190005679A1 · Nie · 2019 [cited by applicant]
US 20190200862A1 · Krueger · 2019 [cited by applicant]
JP 2015167712 · 2015 [cited by examiner]
WO WO2009101696A1 · 2009 [cited by applicant]
WO WO2016149416A1 · 2016 [cited by applicant]
WO WO2019204765A1 · 2019 [cited by applicant]
ARToolKit: htpps://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” [cited by applicant]
Azuma, “Predictive Tracking for Augmented Reality,” Dissertation, TR95-007, Doctor of Philosophy, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. (262 pages). [cited by applicant]
Bimber et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005. (393 pages). [cited by applicant]
International Preliminary Report on Patentability, dated Oct. 20, 2020, for International Application No. PCT/US2019/028376. (10 pages). [cited by applicant]
International Search Report and Written Opinion, dated Aug. 19, 2019, for International Application No. PCT/US2019/028376. (22 pages). [cited by applicant]
Invitation to Pay Additional Fees, dated Jun. 7, 2019, for International Application No. PCT/US2019/028376. (4 pages). [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” [cited by applicant]
Juusola et al., “Microsaccadic Sampling of Moving Image Information Provides [cited by applicant]
Leube et al., “Sampling Rate Influences Saccade Detection in Mobile Eye Tracking of a Reading Task,” Journal of Eye Movement Research 10(3):3, Jun. 2017. (11 pages). [cited by applicant]
Lokhande et al., “Identification of Parameters and Restoration of Motion Blurred Images,” Proceedings of the 2006 ACM Symposium on Applied Computing (SAC), Dijon, France, Apr. 23-27, 2006. (6 pages). [cited by applicant]
Ramakrishnan, “Detection and Estimation of Image Blur,” Masters Thesis, Master of Science in Electrical Engineering, Missouri University of Science and Technology, Graduate School, Missouri, USA, Missouri S&T Library an… [cited by applicant]
Rosebrock, “Blur Detection with OpenCV,” Navigation, pyimagesearch, https://pyimagesearch.com/2015/09/07/blur-detection-with-opencv/, Sep. 7, 2015. [cited by applicant]
Shi et al., “Discriminative Blur Detection Features,” 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA, Jun. 23-28, 2014, pp. 2965-2972. [cited by applicant]
Su et al., “Blurred Image Region Detection and Classification,” Proceedings of the 19th International Conference on Multimedea (MM'11), Scottsdale, Arizona, USA, Nov. 28-Dec. 1, 2011. (4 pages). [cited by applicant]
Tanriverdi et al., “Interacting with Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA, [cited by applicant]
Translation of patent KR20160092670A, Kim et al., “Apparatus and Method for Measuring Motion Blur and Removing Motion Blur Based Gaze Tracking System,” Aug. 5, 2016. (6 pages). [cited by applicant]
Yitzhaky et al., “Direct Method for Restoration of Motion-blurred Images,” Journal of the Optical Society of America A 15(6): 1512-1519, Jun. 1996. [cited by applicant]
Yousaf et al., “Approach to Metric and Discrimination of Blur Based on its Invariant Features,” 2013 IEEE International Conference on Imaging Systems and Techniques (IST), Beijing, China, Oct. 22-23, 2013, pp. pp. 274-2… [cited by applicant]