IP Library Granted Patent US 12,474,586
Granted Patent B2
US 12,474,586 · App. 18/622,116 · Granted Nov 18, 2025

Systems and methods for manipulating light from ambient light sources

Inventors: Eric Baerenrodt (Milford, NH); Nastasja U. Robaina (Coconut Grove, FL); Nicole Elizabeth Samec (Ft. Lauderdale, FL); Christopher M. Harrises (Nashua, NH); Mark Baerenrodt (Milbrae, CA)
Assignee: Magic Leap, Inc.
G02B27/0172G02B3/14G02B27/0081G02F1/0018G02F1/0128G02F1/29G06F3/013G02B6/0076G02B2027/014G02B27/0179G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,474,586
App. No.
18/622,116
Granted
Nov 18, 2025
Kind
B2
Abstract

An optical device includes variable optical material that alters at least one of: incident ambient light, spectral content of incident ambient light or direction of incident ambient light through the optical device in response to a stimulus provided by the device. The device can sense intensity and/or spectral characteristics of ambient light and provide appropriate stimulus to various portions of the optical device to activate the variable optical material and alter at least one of: incident ambient light, spectral content of incident ambient light or direction of incident ambient light.

Claims (30)

1 . A display device comprising:

a frame configured to mount on a user;

an augmented reality (AR) display attached to the frame and configured to direct images to an eye of the user while transmitting, to the eye of the user, at least some light from an environment proximal to the AR display, wherein the AR display includes a variable optical material that is embedded in a surface of the AR display, wherein the variable optical material undergoes a physical and/or a chemical change in response to a stimulus, and wherein the variable optical material is distributed unevenly across the AR display such that at least one portion of the AR display includes a higher density of the variable optical material than at least one other portion of the AR display;

at least one sensor configured to obtain information including ambient light conditions in the environment, wherein the obtained information indicates a location, in the environment, of at least one object that is one or more of an ambient light source or a glare producing object, and wherein the obtained information includes one or more wavelengths of the light that is transmitted through the AR display from the at least one object;

a source configured to provide the stimulus; and

processing electronics configured to trigger the source to provide the stimulus to the variable optical material to effect a physical and/or a chemical change in the variable optical material included in the AR display such that at least one of an intensity of ambient light, a spectral content of the ambient light, or a direction of the ambient light is selectively changed at one or more first portions of the AR display differently than one or more second portions of the AR display that are different from the one or more first portions, wherein the one or more first portions of the AR display correspond to the location of the at least one object in the environment that is the one or more of the ambient light source or the glare producing object, and wherein the stimulus causes the change in the variable optical material in the one or more first portions to reduce the intensity of the ambient light selectively in the one or more wavelengths of the light from the at least one object.

2 . The display device of claim 1 , wherein the processing electronics are further configured to determine a position of the user, and wherein the stimulus to the variable optical material is provided to effect the physical and/or the chemical change in the material based on the position of the user.

3 . The display device of claim 1 , wherein the device is further configured to vary the stimulus based on the time of day.

4 . The display device of claim 1 , wherein the AR display comprises at least one waveguide configured to:

allow a view of the environment through the at least one waveguide; and

form images by directing light out of the at least one waveguide and into the eye of the user.

5 . The display device of claim 1 , wherein the at least one sensor comprises at least one of a light sensor, a global positioning sub-system, or an environmental sensor.

6 . The display device of claim 1 , wherein the source comprises one or more of an optical source, an electrical source, a thermal source, a sonic source, or an ultrasonic source.

7 . The display device of claim 1 , wherein the variable optical material comprises one or more of: organic or inorganic compounds, electroactive proteins, molecules that exhibit a change is size or shape in response to the stimulus, molecules that move, rotate, twist or shift in response to the stimulus, molecules that move together and/or adhere together in response to the stimulus, molecules that move away from each other in response to the stimulus, or molecules that form nanostructures in response to the stimulus.

8 . The display device of claim 1 , wherein the one or more first portions of the AR display comprise a first ocular region corresponding to a first eye of the user and the one or more second portions of the AR display comprise a second ocular region corresponding to a second eye of the user,

wherein the processing electronics are configured to trigger the source to provide the stimulus to effect the physical and/or the chemical change in the material such that at least one of the intensity of the ambient light, the spectral content of the ambient light or the direction of the ambient light through the first ocular region is changed differently as compared to the intensity of the ambient light, the spectral content of the ambient light or the direction of the ambient light through the second ocular region.

9 . The display device of claim 1 , wherein the processing electronics are configured to trigger the source to provide the stimulus to effect the physical and/or the chemical change in the material such that attenuation of intensity of ambient light transmitted through at least one first portion of the display is greater than attenuation of intensity of ambient light transmitted through at least one second portion of the display.

10 . The display device of claim 1 , further comprising a head pose sensor, wherein the processing electronics are further configured to trigger the source to provide the stimulus to the variable optical material based on at least one of a movement or a position of a head of the user as determined by the head pose sensor.

11 . The display device of claim 1 , wherein the processing electronics are further configured to adjust the one or more first portions of the AR display to which the stimulus is applied based on feedback from the user.

12 . The display device of claim 1 , wherein the processing electronics are further configured to adjust a size of a region of the AR display to which the stimulus is applied based on feedback from the user.

13 . The display device of claim 1 , wherein the processing electronics are further configured to adjust an amount by which at least one of an intensity of ambient light, a spectral content of ambient light, or a direction of ambient light is changed based on feedback from the user.

14 . The display device of claim 1 , wherein the at least one portion of the AR display corresponds to at least one ocular region that includes the higher density of the variable optical material than the at least one other portion of the AR display that corresponds to at least one non-ocular region.

15 . The display device of claim 14 , wherein the at least one other portion of the AR display that corresponds to the at least one non-ocular region is devoid of the variable optical material.

16 . A method of manipulating light transmitted through a user-wearable display device that includes an augmented reality (AR) display configured to direct images to an eye of a user while transmitting, to the eye of the user, at least some light from an environment proximal to the AR display, the method comprising:

using at least one sensor, obtaining information including ambient light conditions in the environment, wherein the obtained information indicates a location, in the environment, of at least one object that is one or more of an ambient light source or a glare producing object, and wherein the obtained information includes one or more wavelengths of the light that is transmitted through the AR display from the at least one object; and

controlling a source to provide a stimulus to a variable optical material that is embedded in a surface of the AR display, wherein the variable optical material is distributed unevenly across the AR display such that at least one portion of the AR display includes a higher density of the variable optical material than at least one other portion of the AR display, wherein the variable optical material undergoes a physical and/or a chemical change in response to the stimulus such that at least one of an intensity of ambient light, a spectral content of the ambient light, or a direction of the ambient light is selectively changed at one or more first portions of the AR display differently than one or more second portions of the AR display that are different from the one or more first portions, wherein the one or more first portions of the AR display correspond to the location of the at least one object in the environment that is the one or more of the ambient light source or the glare producing object, and wherein the stimulus causes the change in the variable optical material in the one or more first portions to reduce the intensity of the ambient light selectively in the one or more wavelengths of the light from the at least one object.

17 . The method of claim 16 , wherein the source is controlled to provide the stimulus to effect the physical and/or the chemical change in the material such that attenuation of intensity of ambient light transmitted through at least one first portion of the display is greater than attenuation of intensity of ambient light transmitted through at least one second portion of the display.

18 . The method of claim 16 , wherein the source is controlled to provide the stimulus to the variable optical material based on at least one of a movement or a position of a head of the user as determined by a head pose sensor of the user-wearable display device.

19 . The method of claim 16 , further comprising adjusting the one or more first portions of the AR display to which the stimulus is applied based on feedback from the user.

20 . The method of claim 16 , further comprising adjusting an amount by which at least one of an intensity of ambient light, a spectral content of ambient light, or a direction of ambient light is changed based on feedback from the user.

Assignments (3)
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2024
From: BAERENRODT, ERIC; BAERENRODT, MARK; ROBAINA, NASTASJA U.; SAMEC, NICOLE ELIZABETH
To: MAGIC LEAP, INC.
Reel/Frame 067579/0964 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2024
From: HARRISES, CHRISTOPHER M.
To: MAGIC LEAP, INC.
Reel/Frame 067580/0054 →
Continuity (5)
Continuation 17967331 · Oct 17, 2022
Continuation 17347201 · Jun 14, 2021
Continuation 15850465 · Dec 21, 2017
Provisional Application 62438325 · Dec 22, 2016
Related Publication 20240241383A1 · Jul 18, 2024
References Cited (113)
US 5781330A · Kolodner et al. · 1998 [cited by applicant]
US 6057878A · Ogiwara et al. · 2000 [cited by applicant]
US 6850221B1 · Tickle · 2005 [cited by applicant]
US D514570S · Ohta · 2006 [cited by applicant]
US 7970172B1 · Hendrickson · 2011 [cited by applicant]
US 8982471B1 · Starner et al. · 2015 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US D752529S · Loretan et al. · 2016 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US D759657S · Kujawski et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9576398B1 · Zehner et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US D794288S · Beers et al. · 2017 [cited by applicant]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt · 2017 [cited by applicant]
US D805734S · Fisher et al. · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski et al. · 2018 [cited by applicant]
US 11036049B2 · Baerenrodt et al. · 2021 [cited by applicant]
US 11520151B2 · Baerenrodt et al. · 2022 [cited by applicant]
US 11971551B2 · Baerenrodt et al. · 2024 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070058260A1 · Steenblik et al. · 2007 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20080218434A1 · Kelly et al. · 2008 [cited by applicant]
US 20100165450A1 · Okuyama et al. · 2010 [cited by applicant]
US 20120113140A1 · Hilliges et al. · 2012 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20120182206A1 · Cok et al. · 2012 [cited by applicant]
US 20120212696A1 · Trajkovska et al. · 2012 [cited by applicant]
US 20120218172A1 · Border et al. · 2012 [cited by applicant]
US 20120235900A1 · Border et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130113973A1 · Miao · 2013 [cited by applicant]
US 20130114043A1 · Balan et al. · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130201549A1 · Mori et al. · 2013 [cited by applicant]
US 20130208014A1 · Fleck et al. · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130240804A1 · Pagba et al. · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20130257691A1 · Saito · 2013 [cited by applicant]
US 20140055324A1 · Hotta et al. · 2014 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140139551A1 · McCulloch et al. · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140192092A1 · Aruga et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20140340286A1 · Machida et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150022542A1 · Baba · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150192777A1 · Bae et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150260991A1 · Bhardwaj et al. · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · TeKolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160055822A1 · Bell · 2016 [cited by applicant]
US 20160109709A1 · Osterhout · 2016 [cited by applicant]
US 20160202753A1 · Lee et al. · 2016 [cited by applicant]
US 20160216416A1 · TeKolste et al. · 2016 [cited by applicant]
US 20160320621A1 · Biteau et al. · 2016 [cited by applicant]
US 20170199383A1 · Machida · 2017 [cited by applicant]
US 20180003966A1 · Kilcher et al. · 2018 [cited by applicant]
US 20180031844A1 · Decreton · 2018 [cited by examiner]
US 20180088323A1 · Bao et al. · 2018 [cited by applicant]
US 20180088330A1 · Giannuzzi · 2018 [cited by examiner]
US 20180180890A1 · Baerenrodt et al. · 2018 [cited by applicant]
US 20210373343A1 · Baerenrodt et al. · 2021 [cited by applicant]
US 20230039911A1 · Baerenrodt et al. · 2023 [cited by applicant]
JP H07193841A · 1995 [cited by applicant]
JP H1031217A · 1998 [cited by applicant]
JP 2002090660A · 2002 [cited by applicant]
JP 2002244074A · 2002 [cited by applicant]
JP 2003156768A · 2003 [cited by applicant]
JP 2010113010A · 2010 [cited by applicant]
JP 2014228595A · 2014 [cited by applicant]
WO 2015109145A9 · 2015 [cited by applicant]
WO 2016107921A1 · 2016 [cited by applicant]
WO 2016141372A1 · 2016 [cited by applicant]
WO 2018119276A1 · 2018 [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/ azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality-Merging Real and Virtual Worlds,” 2005 https://web.media.mit.edu/raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US 17/67968, dated Jun. 25, 2019. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US 17/67968, dated Mar. 14, 2018. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
JP2022-146048 Office Action dated Jul. 28, 2023. [cited by applicant]
KR2023-7013034 Office Action dated Jun. 1, 2023. [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. AMC CHI 2000 Human Factors in Computin… [cited by applicant]
NZ795802 Examination Report dated Jul. 16, 2024. [cited by applicant]
EP25158698.8 Extended European Search Report dated Apr. 23, 2025. [cited by applicant]
JP2024-093659 Office Action mailed May 22, 2025. [cited by applicant]
KR2024-7001620 Office Action dated Sep. 8, 2025. [cited by applicant]