IP Library › Granted Patent US 12,298,517
Granted Patent B2
US 12,298,517 · App. 18/493,429 · Granted May 13, 2025

Augmented reality display with waveguide configured to capture images of eye and/or environment

Inventors: Asif Sinay (Tel-Aviv, IL); Barak Freedman (Binyamina, IL); Michael Anthony Klug (Austin, TX); Chulwoo Oh (Plantation, FL); Nizan Meitav (Kiryat Ata, IL)
Assignee: MAGIC LEAP, INC.
G02B27/0172G02B27/0081G02B27/0093G02B27/283G06F3/013G06T19/006G02B2027/0125G02B2027/0138G02B2027/014G02B2027/0178G02B2027/0185
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,298,517
App. No.
18/493,429
Granted
May 13, 2025
Kind
B2
Abstract

Head mounted display systems configured to project light to an eye of a user to display augmented reality image content in a vision field of the user are disclosed. In embodiments, the system includes a frame configured to be supported on a head of the user, an image projector configured to project images into the user's eye, a camera coupled to the frame, a waveguide optically coupled to the camera, an optical coupling optical element me, an out-coupling element configured to direct light emitted from the waveguide to the camera, and a first light source configured to direct light to the user's eye through the waveguide. Electronics control the camera to capture images periodically and farther control the first light source to pulse in time with the camera such that light emitted by the light source has a reduced intensity when the camera is not capturing images.

Claims (73)

1. A head mounted display system configured to project light to an eye of a user to display augmented reality image content in a vision field of the user, the head mounted display system comprising:

a frame configured to be supported on a head of the user;

an image projector coupled to the frame and configured to project images into the user's eye to display image content in the vision field of the user;

a camera coupled to the frame;

a waveguide coupled to the frame and optically coupled to the camera;

an optical coupling element coupled to the frame and configured such that light is coupled into the waveguide;

an out-coupling element coupled to the frame and configured to direct light emitted from the waveguide to the camera;

a plurality of infrared light sources, including a first light source coupled to the frame and configured to direct light to the user's eye; and

electronics coupled to the first light source and to the camera, the electronics configured to control the camera to capture images periodically, while pulsing the first light source in time with the camera image capture such that light emitted by the first light source has a reduced intensity when the camera is not capturing images,

wherein the camera is configured to: capture a first region of a retina of the user's eye when directed at a first angle relative to the waveguide; and capture a second region of the retina of the user's eye when directed at a second angle relative to the waveguide.

2. The head mounted display system of claim 1 , wherein electronics are configured to cause the plurality of infrared light sources to alternately pulse at different wavelengths.

3. The head mounted display system of claim 1 , further comprising an in-coupling optical element configured to couple light from the image projector into the waveguide.

4. The head mounted display system of claim 3 , wherein the in-coupling optical element is in direct optical communication with the plurality of infrared light sources and the image projector such that light emitted by the plurality of infrared light sources is incident on the in-coupling optical element prior to optically interacting with the coupling optical element or the out-coupling element.

5. The head mounted display system of claim 4 , wherein the waveguide is configured to receive the light from the in-coupling optical element and propagate the light through the waveguide by total internal reflection along the coupling optical element to maintain at least 90% of the light at each reflection.

6. The head mounted display system of claim 1 , wherein the electronics are configured to form a composite image of the retina of the user's eye with the first and second regions.

7. The head mounted display system of claim 1 , wherein the coupling element comprises:

a first diffractive optical element configured to couple light from the user's eye into the waveguide;

a second diffractive optical element configured to couple light from the image projector out of the waveguide to the user's eye; and

a third diffractive optical element configured to couple light from the plurality of infrared light sources out of the waveguide to the user's eye.

8. The head mounted display system of claim 1 , wherein the image projector is configured to:

present a first virtual target for the user's eye at a first known point of gaze such that the camera captures a first retinal image at the first known point of gaze; and

after presenting the first virtual target, present a second virtual target for the user's eye at a second known point of gaze, the camera capturing a second retinal image at the second known point of gaze;

wherein the electronics are configured to generate a mapping matrix of a retina of the user's eyes utilizing the first retinal image and the second retinal image.

9. The head mounted display system of claim 1 , wherein the optical coupling element is configured such that:

light from the environment in front of the user wearing the head mounted display system is coupled into the waveguide and guided therein such that images of the environment may be captured by the camera; and

light reflected from the eye of the user wearing the head mounted display system is coupled into the waveguide and guided therein such that images of the eye may be captured by the camera.

10. The head mounted display system of claim 1 , further comprising an eyepiece disposed on the frame, the eyepiece configured to direct light into the user's eye to display augmented reality image content to the user's vision field; and

wherein at least a portion of the eyepiece is transparent and disposed at a location in front of the user's eye when the user wears the head mounted display such that the transparent portion transmits light from an environment in front of the user to the user's eye to provide a view of the environment in front of the user.

11. The head mounted display system of claim 10 , wherein the image projector is configured to direct light into an edge of the eyepiece, which directs the light into the user's eye to display augmented reality image content to the user's vision field.

12. A method carried out by a head mounted display including a frame configured to be supported on a head of a user, an image projector, a camera coupled to the frame, a waveguide coupled to the frame and optically coupled to the camera, an optical coupling element coupled to the frame, an out-coupling element configured to direct light emitted from the waveguide to the camera, and a first light source configured to direct light to the eye of the user through the waveguide, the method comprising:

projecting images into the eye of the user, via the image projector, to display image content in the vision field of the user;

while projecting images into the eye of the user, periodically capturing images utilizing the camera; and

controlling the first light source to pulse in time with the camera such that light emitted by the first light source has a reduced intensity when the camera is not capturing images,

wherein the head mounted display comprises a plurality of infrared light sources in which the first light source is included; and

wherein the method further comprises controlling the plurality of infrared light sources to alternately pulse at different wavelengths.

13. A head mounted display system, comprising:

a frame configured to be supported on a head of a user;

a camera coupled to the frame;

an image projector configured to project an image into an eye of the user to display image content in a field of vision of the user; and

an eyepiece disposed on the frame, at least a portion of the eyepiece being transparent and disposed at a location in front of the user's eye when the user wears the head mounted display such that the transparent portion transmits light from the environment in front of the user to the user's eye to provide a view of the environment in front of the user, the eyepiece comprising:

a waveguide;

an in-coupling optical element configured to in-couple light from the image projector into the waveguide to guide light from the image projector therein;

a coupling optical element configured to couple light from the image projector guided within the waveguide out of the waveguide and direct the light to the user's eye; and

an out-coupling element configured to couple light within the waveguide out of the waveguide and direct the light to the camera;

wherein the waveguide is configured to guide (a) light coupled from the environment into the waveguide to be received by the camera so as to capture an image of at least a portion of the environment in front of the user, and (b) light coupled from the image projector such that light from the projector can be directed to the user's eye so that the image from the image projector is in the vision field of the user;

a reflective surface having optical power disposed to receive light reflected from the user's eye that passes through said eyepiece and to direct said light back to the eyepiece; and

electronics configured to cause the camera to capture a first image when light reflected from the reflective surface is blocked, wherein the electronics are configured to cause the camera to capture a second image when light reflected from the reflective surface is not blocked and to modify the second image by subtracting the first image therefrom.

14. The head mounted display system of claim 13 , further comprising:

a first light source coupled to the frame and configured to direct light to the user's eye through the waveguide,

wherein the electronics are coupled to the first light source and to the camera, the electronics configured to control the camera to capture images periodically and to control the first light source to pulse in time with the camera such that light emitted by the first light source has a reduced intensity when the camera is not capturing images.

15. A head mounted display system configured to project light to an eye of a user to display augmented reality image content in a vision field of the user, the head mounted display system comprising:

a frame configured to be supported on a head of the user;

an image projector coupled to the frame and configured to project images into the user's eye to display image content in the vision field of the user;

a camera coupled to the frame;

a waveguide coupled to the frame and optically coupled to the camera;

an optical coupling element coupled to the frame and configured such that light is coupled into the waveguide;

an out-coupling element coupled to the frame and configured to direct light emitted from the waveguide to the camera;

a first light source coupled to the frame and configured to direct light to the user's eye; and

electronics coupled to the first light source and to the camera, the electronics configured to control the camera to capture images periodically, while pulsing the first light source in time with the camera image capture such that light emitted by the first light source has a reduced intensity when the camera is not capturing images,

wherein the image projector is configured to:

present a first virtual target for the user's eye at a first known point of gaze such that the camera captures a first retinal image at the first known point of gaze; and

after presenting the first virtual target, present a second virtual target for the user's eye at a second known point of gaze, the camera capturing a second retinal image at the second known point of gaze;

wherein the electronics are configured to generate a mapping matrix of a retina of the user's eyes utilizing the first retinal image and the second retinal image.

16. The head mounted display system of claim 15 , wherein the first light source is at least one of a plurality of infrared light sources.

17. The head mounted display system of claim 16 wherein electronics are configured to cause the plurality of infrared light sources to alternately pulse at different wavelengths.

18. The head mounted display system of claim 16 , further comprising an in-coupling optical element configured to couple light from the image projector into the waveguide.

19. The head mounted display system of claim 16 , wherein the coupling element comprises:

a first diffractive optical element configured to couple light from the user's eye into the waveguide;

a second diffractive optical element configured to couple light from the image projector out of the waveguide to the user's eye; and

a third diffractive optical element configured to couple light from the plurality of infrared light sources out of the waveguide to the user's eye.

20. The head mounted display system of claim 15 , wherein the coupling optical element is configured such that:

light from the environment in front of the user wearing the head mounted display system is coupled into the waveguide and guided therein such that images of the environment may be captured by the camera; and

light reflected from the eye of the user wearing the head mounted display system is coupled into the waveguide and guided therein such that images of the eye may be captured by the camera.

Assignments (5)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073439/0168 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073387/0487 →
SECURITY INTEREST Recorded Oct 28, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073388/0027 →
SECURITY INTEREST Recorded Oct 20, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073031/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2023
From: SINAY, ASIF; FREEDMAN, BARAK; KLUG, MICHAEL ANTHONY; OH, CHULWOO; MEITAV, NIZAN
To: MAGIC LEAP, INC.
Reel/Frame 065328/0536 →
Continuity (3)
Continuation 16138228 · Sep 21, 2018
Provisional Application 62561645 · Sep 21, 2017
Related Publication 20240126090A1 · Apr 18, 2024
References Cited (381)
US 4693544A · Yamasaki et al. · 1987 [cited by applicant]
US 4991924A · Shankar et al. · 1991 [cited by applicant]
US 5187372A · Clube · 1993 [cited by applicant]
US 5544268A · Bischel et al. · 1996 [cited by applicant]
US 5566982A · Lehureau et al. · 1996 [cited by applicant]
US 5808797A · Bloom et al. · 1998 [cited by applicant]
US 5825448A · Bos et al. · 1998 [cited by applicant]
US 5915051A · Damask et al. · 1999 [cited by applicant]
US 5933279A · Yamazaki · 1999 [cited by applicant]
US 6014197A · Hikmet · 2000 [cited by applicant]
US 6040885A · Koike et al. · 2000 [cited by applicant]
US 6181393B1 · Enomoto et al. · 2001 [cited by applicant]
US 6334960B1 · Willson et al. · 2002 [cited by applicant]
US 6542671B1 · Ma et al. · 2003 [cited by applicant]
US 6680767B2 · Coates et al. · 2004 [cited by applicant]
US 6690845B1 · Yoshimura et al. · 2004 [cited by applicant]
US 6735224B2 · Murry et al. · 2004 [cited by applicant]
US 6750941B2 · Satoh et al. · 2004 [cited by applicant]
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 6873087B1 · Choi et al. · 2005 [cited by applicant]
US 6900881B2 · Sreenivasan et al. · 2005 [cited by applicant]
US 6982818B2 · Riza et al. · 2006 [cited by applicant]
US D514570S · Ohta · 2006 [cited by applicant]
US 7023466B2 · Favalora et al. · 2006 [cited by applicant]
US 7070405B2 · Sreenivasan et al. · 2006 [cited by applicant]
US 7098572B2 · Choi et al. · 2006 [cited by applicant]
US 7122482B2 · Xu et al. · 2006 [cited by applicant]
US 7140861B2 · Watts et al. · 2006 [cited by applicant]
US 7206107B2 · Levola · 2007 [cited by applicant]
US 7341348B2 · Eagan · 2008 [cited by applicant]
US 7375784B2 · Smith et al. · 2008 [cited by applicant]
US 7471362B1 · Jones · 2008 [cited by applicant]
US 7519096B2 · Bouma et al. · 2009 [cited by applicant]
US 7573640B2 · Nivon et al. · 2009 [cited by applicant]
US 7692759B2 · Escuti et al. · 2010 [cited by applicant]
US 7705943B2 · Kume et al. · 2010 [cited by applicant]
US 8064035B2 · Escuti et al. · 2011 [cited by applicant]
US 8076386B2 · Xu et al. · 2011 [cited by applicant]
US 8160411B2 · Levola et al. · 2012 [cited by applicant]
US 8233204B1 · Robbins et al. · 2012 [cited by applicant]
US 8248458B2 · Schowengerdt et al. · 2012 [cited by applicant]
US 8264623B2 · Marrucci · 2012 [cited by applicant]
US 8339566B2 · Escuti et al. · 2012 [cited by applicant]
US 8508848B2 · Saarikko · 2013 [cited by applicant]
US 8757812B2 · Melville et al. · 2014 [cited by applicant]
US 8878749B1 · Wu et al. · 2014 [cited by applicant]
US 8885161B2 · Scheeline et al. · 2014 [cited by applicant]
US 8885997B2 · Nguyen et al. · 2014 [cited by applicant]
US 8950867B2 · Macnamara · 2015 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9215293B2 · Miller · 2015 [cited by applicant]
US D752529S · Loretan et al. · 2016 [cited by applicant]
US 9310559B2 · Macnamara · 2016 [cited by applicant]
US 9345402B2 · Gao · 2016 [cited by applicant]
US 9348143B2 · Gao et al. · 2016 [cited by applicant]
US D758367S · Natsume · 2016 [cited by applicant]
US D759657S · Kujawski et al. · 2016 [cited by applicant]
US 9417452B2 · Schowengerdt et al. · 2016 [cited by applicant]
US 9470906B2 · Kaji et al. · 2016 [cited by applicant]
US 9547174B2 · Gao et al. · 2017 [cited by applicant]
US 9575366B2 · Srivastava et al. · 2017 [cited by applicant]
US 9664905B2 · Bohn et al. · 2017 [cited by applicant]
US 9671566B2 · Abovitz et al. · 2017 [cited by applicant]
US D794288S · Beers et al. · 2017 [cited by applicant]
US 9740006B2 · Gao · 2017 [cited by applicant]
US 9791700B2 · Schowengerdt · 2017 [cited by applicant]
US D805734S · Fisher et al. · 2017 [cited by applicant]
US 9846967B2 · Schowengerdt · 2017 [cited by applicant]
US 9851563B2 · Gao et al. · 2017 [cited by applicant]
US 9857591B2 · Welch et al. · 2018 [cited by applicant]
US 9874749B2 · Bradski et al. · 2018 [cited by applicant]
US 9933684B2 · Brown et al. · 2018 [cited by applicant]
US 10025100B2 · Akutsu et al. · 2018 [cited by applicant]
US 10025160B2 · Park et al. · 2018 [cited by applicant]
US 10156725B2 · Tekolste et al. · 2018 [cited by applicant]
US 10191288B2 · Singer et al. · 2019 [cited by applicant]
US 10254454B2 · Klug et al. · 2019 [cited by applicant]
US 10260864B2 · Edwin et al. · 2019 [cited by applicant]
US 10261318B2 · Tekolste et al. · 2019 [cited by applicant]
US 10345592B2 · Samec et al. · 2019 [cited by applicant]
US 10466478B2 · Klug et al. · 2019 [cited by applicant]
US 10466561B2 · Oh · 2019 [cited by applicant]
US 10690826B2 · Klug et al. · 2020 [cited by applicant]
US 11073695B2 · Gao et al. · 2021 [cited by applicant]
US 20020097962A1 · Yoshimura et al. · 2002 [cited by applicant]
US 20020126249A1 · Liang et al. · 2002 [cited by applicant]
US 20020167638A1 · Byun et al. · 2002 [cited by applicant]
US 20020172237A1 · Murry et al. · 2002 [cited by applicant]
US 20030147112A1 · Mukawa · 2003 [cited by applicant]
US 20030161573A1 · Ishida et al. · 2003 [cited by applicant]
US 20040007465A1 · Goldberg et al. · 2004 [cited by applicant]
US 20040022888A1 · Sreenivasan et al. · 2004 [cited by applicant]
US 20040120647A1 · Sakata et al. · 2004 [cited by applicant]
US 20040150141A1 · Chao et al. · 2004 [cited by applicant]
US 20040184163A1 · Nishioka et al. · 2004 [cited by applicant]
US 20040191429A1 · Patrick · 2004 [cited by applicant]
US 20050042391A1 · Ryan et al. · 2005 [cited by applicant]
US 20050072959A1 · Moia et al. · 2005 [cited by applicant]
US 20050073577A1 · Sudo et al. · 2005 [cited by applicant]
US 20050232530A1 · Kekas · 2005 [cited by applicant]
US 20050253112A1 · Kelly et al. · 2005 [cited by applicant]
US 20050270312A1 · Lad et al. · 2005 [cited by applicant]
US 20050270461A1 · Kitson et al. · 2005 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20060120247A1 · Noda et al. · 2006 [cited by applicant]
US 20060121358A1 · Rich et al. · 2006 [cited by applicant]
US 20060126179A1 · Levola · 2006 [cited by applicant]
US 20060157443A1 · Mei · 2006 [cited by applicant]
US 20060221448A1 · Nivon et al. · 2006 [cited by applicant]
US 20060227283A1 · Ooi et al. · 2006 [cited by applicant]
US 20070031097A1 · Heikenfeld et al. · 2007 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20070229955A1 · Kawamura et al. · 2007 [cited by applicant]
US 20070273957A1 · Zalevsky et al. · 2007 [cited by applicant]
US 20080043166A1 · Liu et al. · 2008 [cited by applicant]
US 20080043334A1 · Itzkovitch et al. · 2008 [cited by applicant]
US 20080169479A1 · Xu et al. · 2008 [cited by applicant]
US 20080278675A1 · Escuti et al. · 2008 [cited by applicant]
US 20090002787A1 · Cable et al. · 2009 [cited by applicant]
US 20090141216A1 · Marrucci · 2009 [cited by applicant]
US 20100046750A1 · Asfour · 2010 [cited by applicant]
US 20100142570A1 · Konttinen et al. · 2010 [cited by applicant]
US 20100157400A1 · Dimov et al. · 2010 [cited by applicant]
US 20100207964A1 · Kimmel et al. · 2010 [cited by applicant]
US 20100225876A1 · Escuti et al. · 2010 [cited by applicant]
US 20100277803A1 · Pockett et al. · 2010 [cited by applicant]
US 20100284090A1 · Simmonds · 2010 [cited by applicant]
US 20100321781A1 · Levola et al. · 2010 [cited by applicant]
US 20110002143A1 · Saarikko et al. · 2011 [cited by applicant]
US 20110024950A1 · Kruglick · 2011 [cited by applicant]
US 20110049761A1 · Mataki · 2011 [cited by applicant]
US 20110157667A1 · Lacoste et al. · 2011 [cited by applicant]
US 20110194058A1 · Amos et al. · 2011 [cited by applicant]
US 20110213664A1 · Osterhout et al. · 2011 [cited by applicant]
US 20110242461A1 · Escuti et al. · 2011 [cited by applicant]
US 20120021140A1 · Dijksman et al. · 2012 [cited by applicant]
US 20120033306A1 · Valera et al. · 2012 [cited by applicant]
US 20120069232A1 · Chui et al. · 2012 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20120206485A1 · Osterhout et al. · 2012 [cited by applicant]
US 20120206812A1 · Saito et al. · 2012 [cited by applicant]
US 20120218301A1 · Miller · 2012 [cited by applicant]
US 20120224062A1 · Lacoste et al. · 2012 [cited by applicant]
US 20120327330A1 · Takahashi et al. · 2012 [cited by applicant]
US 20130051730A1 · Travers et al. · 2013 [cited by applicant]
US 20130077049A1 · Bohn · 2013 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130207887A1 · Raffle et al. · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130222384A1 · Futterer · 2013 [cited by applicant]
US 20130235191A1 · Miao et al. · 2013 [cited by applicant]
US 20130235440A1 · Takeda et al. · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20130242392A1 · Amirparviz et al. · 2013 [cited by applicant]
US 20130314765A1 · Padilla et al. · 2013 [cited by applicant]
US 20130314789A1 · Saarikko et al. · 2013 [cited by applicant]
US 20130321747A1 · Kondo et al. · 2013 [cited by applicant]
US 20130322810A1 · Robbins · 2013 [cited by applicant]
US 20140055740A1 · Spaulding et al. · 2014 [cited by applicant]
US 20140064655A1 · Nguyen et al. · 2014 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140104665A1 · Popovich et al. · 2014 [cited by applicant]
US 20140140653A1 · Brown et al. · 2014 [cited by applicant]
US 20140140654A1 · Brown et al. · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140211322A1 · Bohn et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140232993A1 · Kim · 2014 [cited by applicant]
US 20140233879A1 · Gibson et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20140285429A1 · Simmons · 2014 [cited by applicant]
US 20140300695A1 · Smalley et al. · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150015879A1 · Papadopoulos et al. · 2015 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150035745A1 · Ou-Yang et al. · 2015 [cited by applicant]
US 20150062500A1 · Park et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150146147A1 · Choi et al. · 2015 [cited by applicant]
US 20150168731A1 · Robbins · 2015 [cited by applicant]
US 20150173846A1 · Schneider et al. · 2015 [cited by applicant]
US 20150177591A1 · Sugiyama et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150182748A1 · Gefen et al. · 2015 [cited by applicant]
US 20150185475A1 · Saarikko et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150205182A1 · Leister · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150234205A1 · Schowengerdt · 2015 [cited by applicant]
US 20150235451A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150241705A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150277116A1 · Richards et al. · 2015 [cited by applicant]
US 20150289762A1 · Popovich et al. · 2015 [cited by applicant]
US 20150293409A1 · Usukura et al. · 2015 [cited by applicant]
US 20150301249A1 · Pau et al. · 2015 [cited by applicant]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · Tekolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160018639A1 · Spitzer et al. · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160033698A1 · Escuti et al. · 2016 [cited by applicant]
US 20160033771A1 · Tremblay et al. · 2016 [cited by applicant]
US 20160041385A1 · Gotoh et al. · 2016 [cited by applicant]
US 20160041390A1 · Poon et al. · 2016 [cited by applicant]
US 20160055801A1 · Kim et al. · 2016 [cited by applicant]
US 20160077338A1 · Robbins et al. · 2016 [cited by applicant]
US 20160085300A1 · Robbins et al. · 2016 [cited by applicant]
US 20160097930A1 · Robbins et al. · 2016 [cited by applicant]
US 20160116739A1 · Tekolste et al. · 2016 [cited by applicant]
US 20160116979A1 · Border · 2016 [cited by applicant]
US 20160167422A1 · Brehm et al. · 2016 [cited by applicant]
US 20160198091A1 · Edwards · 2016 [cited by applicant]
US 20160209560A1 · Tabirian et al. · 2016 [cited by applicant]
US 20160209648A1 · Haddick et al. · 2016 [cited by applicant]
US 20160209657A1 · Popovich et al. · 2016 [cited by applicant]
US 20160219208A1 · Horesh · 2016 [cited by applicant]
US 20160225190A1 · Yamazaki · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20160282808A1 · Smalley · 2016 [cited by applicant]
US 20160320536A1 · Simmonds et al. · 2016 [cited by applicant]
US 20160349517A1 · Miyasaka et al. · 2016 [cited by applicant]
US 20160370583A1 · Saarikko et al. · 2016 [cited by applicant]
US 20170010466A1 · Klug et al. · 2017 [cited by applicant]
US 20170082858A1 · Klug et al. · 2017 [cited by applicant]
US 20170094265A1 · Mullins et al. · 2017 [cited by applicant]
US 20170131595A1 · Mm et al. · 2017 [cited by applicant]
US 20170269453A1 · Galstian et al. · 2017 [cited by applicant]
US 20170322419A1 · Tekolste et al. · 2017 [cited by applicant]
US 20170373459A1 · Weng et al. · 2017 [cited by applicant]
US 20180004289A1 · Wilson et al. · 2018 [cited by applicant]
US 20180046859A1 · Jarvenpaa · 2018 [cited by applicant]
US 20180052325A1 · Bohn · 2018 [cited by applicant]
US 20180113309A1 · Robbins et al. · 2018 [cited by applicant]
US 20180113310A1 · Rolland et al. · 2018 [cited by applicant]
US 20180143438A1 · Oh · 2018 [cited by applicant]
US 20180143470A1 · Oh et al. · 2018 [cited by applicant]
US 20180143485A1 · Oh · 2018 [cited by applicant]
US 20180143509A1 · Oh · 2018 [cited by applicant]
US 20180164645A1 · Oh et al. · 2018 [cited by applicant]
US 20180188528A1 · Browy et al. · 2018 [cited by applicant]
US 20180188542A1 · Waldern et al. · 2018 [cited by applicant]
US 20180217395A1 · Lin et al. · 2018 [cited by applicant]
US 20180231779A1 · Bohn · 2018 [cited by applicant]
US 20180239177A1 · Oh · 2018 [cited by applicant]
US 20180275350A1 · Oh et al. · 2018 [cited by applicant]
US 20180275409A1 · Gao et al. · 2018 [cited by applicant]
US 20180321496A1 · Bohn · 2018 [cited by applicant]
US 20180330652A1 · Perreault et al. · 2018 [cited by applicant]
US 20190033684A1 · Favalora et al. · 2019 [cited by applicant]
US 20190121142A1 · Tekolste et al. · 2019 [cited by applicant]
US 20190227211A1 · Klug et al. · 2019 [cited by applicant]
US 20190243141A1 · Tekolste et al. · 2019 [cited by applicant]
US 20190243142A1 · Tekolste et al. · 2019 [cited by applicant]
US 20200174304A1 · Oh · 2020 [cited by applicant]
CN 101133348B · 2010 [cited by applicant]
CN 102683803A · 2012 [cited by applicant]
CN 103823267A · 2014 [cited by applicant]
CN 104126143A · 2014 [cited by applicant]
CN 104145208A · 2014 [cited by applicant]
CN 103297702A · 2016 [cited by applicant]
CN 105723697A · 2016 [cited by applicant]
CN 105765558A · 2016 [cited by applicant]
CN 105849621A · 2016 [cited by applicant]
CN 106133569A · 2016 [cited by applicant]
CN 106575007A · 2017 [cited by applicant]
DE 10160843A1 · 2003 [cited by applicant]
EP 2664430A1 · 2013 [cited by applicant]
JP S62269174A · 1987 [cited by applicant]
JP H0239628A · 1990 [cited by applicant]
JP 1991084516A · 1991 [cited by applicant]
JP H102215A · 1998 [cited by applicant]
JP H10239628A · 1998 [cited by applicant]
JP 2000075405A · 2000 [cited by applicant]
JP 2003337298A · 2003 [cited by applicant]
JP 2005250408A · 2005 [cited by applicant]
JP 2005316304A · 2005 [cited by applicant]
JP 2005316314A · 2005 [cited by applicant]
JP 2008209710A · 2008 [cited by applicant]
JP 2009300480A · 2009 [cited by applicant]
JP 2010102215A · 2010 [cited by applicant]
JP 2010271565A · 2010 [cited by applicant]
JP 2014132328A · 2014 [cited by applicant]
JP 2014224846A · 2014 [cited by applicant]
JP 2015089638A · 2015 [cited by applicant]
JP 2015194549A · 2015 [cited by applicant]
JP 2016142887A · 2016 [cited by applicant]
JP WO2014156167A1 · 2017 [cited by applicant]
JP 2017522601A · 2017 [cited by applicant]
JP 2018508144A · 2018 [cited by applicant]
KR 20170047195A · 2017 [cited by applicant]
WO WO1998057236A1 · 1998 [cited by applicant]
WO WO2005024469A2 · 2005 [cited by applicant]
WO WO2006064301A1 · 2006 [cited by applicant]
WO WO2006092758A2 · 2006 [cited by applicant]
WO WO2006106501A1 · 2006 [cited by applicant]
WO WO2008130555A1 · 2008 [cited by applicant]
WO WO2008130561A1 · 2008 [cited by applicant]
WO WO2010067114A1 · 2010 [cited by applicant]
WO WO2013054115A1 · 2013 [cited by applicant]
WO WO2014016403A1 · 2014 [cited by applicant]
WO WO2014036537A1 · 2014 [cited by applicant]
WO WO2014080155A1 · 2014 [cited by applicant]
WO WO2014091204A1 · 2014 [cited by applicant]
WO WO2014172252A1 · 2014 [cited by applicant]
WO WO2014188149A1 · 2014 [cited by applicant]
WO WO2015081313A2 · 2015 [cited by applicant]
WO WO2016019123A1 · 2016 [cited by applicant]
WO WO2016045784A1 · 2016 [cited by applicant]
WO WO2016054092A1 · 2016 [cited by applicant]
WO WO2016082031A1 · 2016 [cited by applicant]
WO WO2016113533A2 · 2016 [cited by applicant]
WO WO2016149416A1 · 2016 [cited by applicant]
WO WO2016205249A1 · 2016 [cited by applicant]
WO WO2016205256A1 · 2016 [cited by applicant]
WO WO2017134412A1 · 2017 [cited by applicant]
WO WO2018093730A1 · 2018 [cited by applicant]
WO WO2018094079A1 · 2018 [cited by applicant]
WO WO2018094093A1 · 2018 [cited by applicant]
WO WO2018112101A1 · 2018 [cited by applicant]
WO WO2018156779A1 · 2018 [cited by applicant]
WO WO2018156784A1 · 2018 [cited by applicant]
WO WO2018175343A1 · 2018 [cited by applicant]
WO WO2018175488A1 · 2018 [cited by applicant]
WO WO2019060741A1 · 2019 [cited by applicant]
WO WO2020069026A1 · 2020 [cited by applicant]
Partial European Search Report issued in Application No. 23208769.2 dated Feb. 20, 2024 (23 pages). [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/˜azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Reality,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mit.edu/˜raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. ACM CHI 2000 Human Factors in Computin… [cited by applicant]
Aieta, F. et al., “Multiwavelength achromatic metasurfaces by dispersive phase compensation,” Science, vol. 347, Issue 6228, Mar. 20, 2015, in 5 pages. URL: www.sciencemag.org. [cited by applicant]
Arbabi, A. et al., “Dielectric metasurfaces for complete control of phase and polarization with subwavelength spatial resolution and high transmission,” Nature Nanotechnology, published online Aug. 31, 2015, in 8 pages.… [cited by applicant]
Chigrinov, V.: Photoaligning and Photopatterning Technology: Applications in Displays and Photonics, Proceedings of SPIE, Emerging Liquid Crystal Technologies I, vol. 9769, Mar. 7, 2016, in 11 pages. [cited by applicant]
Chiu et al.: “P-33: Large Area Self-aligning of Liquid Crystal Molecules induced by Nanoimprinting Lithography and a Multiple Function Film Made Therein,” Eurodisplay, Sep. 20, 2005, Sep. 22, 2020, pp. 323-325. [cited by applicant]
Choi, Y. et al.: “Determination of Surface Nematic Liquid Crystal Anchoring Strength Using Nano-scale Surface Grooves,” Optical Society of America, May 2013, in 10 pages. [cited by applicant]
Crawford, et al.: “Liquid-crystal diffraction gratings using polarization holography alignment techniques,” Journal of Applied Physics 98, 123102, 2005. [cited by applicant]
Cunningham et al., “A plastic colorimetric resonant optical biosensor for multiparallel detection of label-free biochemical interactions,” Sensors and Actuators B, vol. 85, 2190226, Jul. 2002, in 8 pages. [cited by applicant]
Dierking, I.: “Chiral Liquid Crystals: Structures, Phases, Effects,” Symmetry, (Jun. 2014) 6(2): 444-472. [cited by applicant]
“Metamaterials”. Duke University. Center for Metamaterials and Integrated Plasmonics. May 11, 2015 (Retrieved from the internet Aug. 12, 2016). URL: http://web.archive.org/web/20150511045547/http://metamaterials.duke.ed… [cited by applicant]
Escuti J., “Polarization-Independent Modulation & Simplified Spectropolarimetry Using LC Polarization Gratings,” paper #39.4, posters P-209, P-167, SID Symposium Digest, 2006. [cited by applicant]
Gear, C. et al.: “Engineered Liquid Crystal Anchoring Energies with Nanopatterned Surfaces,” Optical Society of America, Jan. 2015, in 8 pages. [cited by applicant]
Komanduri, et al., “Multi-twist retarders: broadband retaration control using self-aligning reactive liquid crystal layers,” Optical Society of America, Optics Express 404. vol. 21. No. 1. Jan. 14, 2013. [cited by applicant]
Kurioz, Y. et al.: “P-128: Orientation of a Reactive Mesogen on Photosensitive Surface,” Society for Information Display (SID) Symposium Digest of Technical Papers, May 2007, in 3 pages. [cited by applicant]
Lee, et al., “Negative dispersion of birefringence in two-dimensionally self-organized smectic liquid crystal and monomer thin film,” Optics Letters, vol. 39, No. 17, Sep. 1, 2014. [cited by applicant]
Lin, D. et al., “Dielectric gradient metasurface optical elements”, Science, vol. 345, Issue 6194, Jul. 18, 2014, in 6 pages. [cited by applicant]
Lin, D. et al., “Supplementary Materials for Dielectric gradient metasurface optical elements”, Science, vol. 345, Issue 6194, Jul. 18, 2014, in 22 pages. [cited by applicant]
Lin, R. et al., Molecular-Scale soft imprint lithography for alignment layers in liquid crystal devices; Nano Letters, vol. 7, No. 6; Publication [online]. May 23, 2007 [retrieved Feb. 7, 2018]. Retrieved from the Inter… [cited by applicant]
Lub J. et al.: “Formation of Optical Films by Photo-Polymerisation of Liquid Crystalline Acrylates and Application of These Films in Liquid Crystal Display Technology,” Mol Cryst Liq Cryst., (May 2005) 429(1):77-99. [cited by applicant]
Oh C., Thesis: “Broadband Polarization Gratings for Efficient Liquid Crystal Display, Beam Steering, Spectropolarimetry, and Fresnel Zone Plate”, N. C. State University, Electrical Engineering (2009) in 190 pages. [cited by applicant]
Oh et al., “Polarization-Independent Modulation Using Standard Liquid Crystal Microdisplays and Polymer Polarization Gratings,” NC State University; International Display Research Conference, vol. 28, pp. 298-301, 2008.… [cited by applicant]
Scheeline, et al., “Stacked Mutually Rotated Diffraction Gratings as Enablers of Portable Visible Spectrometry,” Appl. Spectrosc. 70, 766-777, May 11, 2016. [cited by applicant]
Wikipedia Blind spot (vision), archived Jun. 9, 2016, in 2 pages. URL: https://web.archive.org/web/20160609224858/ https:en.wikipedia.org/wiki/Blind_spot(vision). [cited by applicant]
Yang et al., “Negative dispersion of birefringence of smectic liquid crystal-polymer composite: dependence on the constituent molecules and temperature,” Optical Society of America, Optics Express 2466, vol. 23, No. 3, … [cited by applicant]
Yu, N. et al., “Flat optics with designer metasurfaces”, Review Article; Nature Materials, (Feb. 2014) 13: 139-150. [cited by applicant]
Yu, N. et al., “Light Propagation with Phase Discontinuities: Generalized Laws of Reflection and Refraction,” Science, vol. 334, No. 333, Oct. 21, 2011, in 6 pages. URL: www.sciencemag.org. [cited by applicant]
International Preliminary Report for Patentability, re PCT Application No. PCT/US18/52241, issued Mar. 24, 2020. [cited by applicant]
International Search Report and Written Opinion, re PCT Application No. PCT/US18/52241, mailed Dec. 10, 2018. [cited by applicant]
Escuti, M. et al., “39.4: Polarization-independent switching with high contrast from a liquid crystal polarization grating”, SID Symposium Digest, vol. 37, pp. 1443-1446, Jun. 2006, in 5 pages. [cited by applicant]
Escuti, M. et al., “Polarization-Independent LC Microdisplays Using Liquid Crystal Polarization Gratings: A Viable Solution”, ILCC presentation, Jul. 1, 2008, in 15 pages. [cited by applicant]
Kim, J. et al., “Wide-angle, nonmechanical beam steering with high throughput utilizing polarization gratings”, Applied Optics, vol. 50, No. 17, Jun. 10, 2011, in 4 pages. [cited by applicant]
Komanduri, R. et al., “18:3: Late-News Paper: Polarization Independent Liquid Crystal Microdisplays”, SID Digest, vol. 39, No. 1, pp. 236-239, May 2008, in 4 pages. [cited by applicant]
Komanduri, R. et al., “34.4L: Late-News Paper: Polarization Independent Projection Systems using Thin Film Polymer Polarization Gratings and Standard Liquid Crystal Microdisplays”, SID Digest, vol. 40, No. 1, Jun. 2009,… [cited by applicant]
Komanduri, R. et al., “Elastic Continuum Analysis of the Liquid Crystal Polarization Grating”, Physical review. E, Statistical, nonlinear, and soft matter physics, May 25, 2007, in 8 pages. [cited by applicant]
Komanduri, R. et al., “Polarization Independent Projection Systems using Thin Film Polymer Polarization Gratings and Standard Liquid Crystal Microdisplays”, SID-Display week presentation, Jun. 3, 2009, in 12 pages. [cited by applicant]
Komanduri, R. et al., “Polarization-independent modulation for projection displays using small-period LC polarization gratings”, Journal of the Society for information display, vol. 15, No. 8, pp. 589-594, Aug. 2007, in… [cited by applicant]
Lim, Y. et al., “Anisotropic Nano-Imprinting Technique for Fabricating a Patterned Optical Film of a Liquid Crystalline Polymer”, Journal of Nanoscience and Nanotechnology, vol. 8, pp. 4775-4778, Oct. 2008, in 4 p. [cited by applicant]
Nikolova et al., “Diffraction Efficiency and Selectivity of Polarization Holographic Recording”, Optica Acta: Int'l J. Optics (1984) 31(5):579-588. [cited by applicant]
Oh, C. et al., “16.2: Polarization-Independent Modulation Using Standard Liquid Crystal Microdisplays and Polymer Polarization Gratings”, IDRC, 2008, in 4 pages. [cited by applicant]
Oh, C. et al.: “Achromatic Diffraction from Polarization Gratings with High Efficiency”, Opt Lett. (Oct. 2008) 33(20):2287-2289 & Erratum Opt Lett. (Dec. 2009) 34(23):3637. [cited by applicant]
Oh, C. et al., “Numerical analysis of polarization gratings using the finite-difference time-domain method”, Physical review A, vol. 76, Oct. 12, 2007, in 8 pages. [cited by applicant]
Oh C. et al., “Polarization-Independent Modulation using Standard LCDs and Polymer PGs”, 2008, in 6 pages. [cited by applicant]