IP Library Granted Patent US 12,306,409
Granted Patent B2
US 12,306,409 · App. 18/344,416 · Granted May 20, 2025

Diffractive optical elements with optical power

Inventors: Asif Sinay (Tel-Aviv, IL); Nizan Meitav (Kiryat Ata, IL); Chulwoo Oh (Sammamish, WA); Barak Freedman (Binyamina, IL); Michael Anthony Klug (Austin, TX); Adam C. Carlson (Plantation, FL)
Assignee: Magic Leap, Inc.
G02B27/0172G02B2027/0107G02B2027/0138G02B2027/0178G02B2027/0187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,306,409
App. No.
18/344,416
Granted
May 20, 2025
Kind
B2
Abstract

A head mounted display system can include a camera, at least one waveguide, at least one coupling optical element that is configured such that light is coupled into said waveguide and guided therein, and at least one out-coupling element. The at least one out-coupling element can be configured to couple light that is guided within said waveguide out of said waveguide and direct said light to said camera. The at least one coupling element may comprise a diffractive optical element having optical power.

Claims (29)

1. A head-mounted display system comprising:

an image projector;

a camera; and

an eyepiece configured, during operation of the system, to receive light from the image projector and direct the light along a first optical path to a user's eye, and to direct light reflected from the user's eye along a second optical path to the camera located on a world side of the eyepiece, the eyepiece comprising:

a waveguide having a first surface facing the user's eye;

a first in-coupling optical element on the first surface in the first optical path configured to in-couple light from the image projector into the waveguide;

a second in-coupling optical element on the first surface in the second optical path configured to in-couple light reflected from the user's eye into the waveguide such that the in-coupled light that reflected from the user's eye travels via total internal reflection within the waveguide;

an out-coupling optical element on the first surface in the second optical path configured to out-couple the light reflected from the user's eye and guided within the waveguide out of the waveguide and direct the out-coupled light to the camera;

a light source located on a user side of the eyepiece opposite the camera and arranged to illuminate the user's eye with infrared light, the user side being opposite the world side;

a first lens having optical power disposed on the user side of the eyepiece in the second optical path; and

a second lens having optical power disposed on the world side of the eyepiece.

2. The system of claim 1 , wherein the first lens has positive optical power.

3. The system of claim 1 , wherein the camera comprises a detector array and imaging optics.

4. The system of claim 3 , wherein the imaging optics is configured to image the user's eye onto the detector array.

5. The system of claim 1 , wherein the waveguide comprises a material that is transparent to visible light having a refractive index sufficient for the waveguide to guide light in the waveguide by total internal reflection.

6. The system of claim 1 , further comprising additional waveguides, wherein the waveguide and the additional waveguides form a stack of waveguides.

7. The system of claim 6 , wherein different waveguides of the stack of waveguides are configured to output light with different wavefront divergence corresponding to image points different distances from the user's eye.

8. The system of claim 6 , wherein different waveguides of the stack of waveguides are configured to output light with different colors.

9. The system of claim 6 , wherein different waveguides of the stack of waveguides comprise a first waveguide for red light, a second waveguide for green light, and a third waveguide for blue light.

10. The system of any of claim 1 , wherein the second in-coupling optical element comprises a diffractive optical element.

11. The system of any of claim 1 , wherein the out-coupling optical element comprises a diffractive optical element.

12. The system of claim 1 , wherein the first in-coupling optical element is configured to increase a dimension of an eyebox along at least one axis relative to a dimension of the in-coupled light.

13. The system of claim 12 , further comprising an orthogonal pupil expander comprising at least one light redirecting element in or on the waveguide that is configured to increase a dimension of the eyebox along an axis that is orthogonal to the at least one axis relative to the dimension of the in-coupled light.

14. The system of claim 13 , wherein the at least one light redirecting element comprises a diffractive optical element.

15. The system of claim 1 , wherein the first lens has a first optical power, the second lens has a second optical power, and the first and second optical powers are of a same magnitude and opposite sign.

16. The system of claim 1 , wherein the second lens has positive optical power.

17. The system of claim 1 , wherein at least one of the first and second lenses is a variable focus lens.

18. The system of claim 1 , wherein at least one of the first and second lenses comprises a liquid crystal material.

19. The system of claim 1 , wherein at least one of the first and second lenses comprise a Fresnel lens.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073439/0168 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: SINAY, ASIF; MEITAV, NIZAN; OH, CHULWOO; FREEDMAN, BARAK; KLUG, MICHAEL ANTHONY; CARLSON, ADAM C.
To: MAGIC LEAP, INC.
Reel/Frame 064157/0932 →
Continuity (3)
Continuation 17278629
Provisional Application 62737042 · Sep 26, 2018
Related Publication 20230341695A1 · Oct 26, 2023
References Cited (86)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20080043334A1 · Itzkovitch et al. · 2008 [cited by applicant]
US 20100284090A1 · Simmonds · 2010 [cited by applicant]
US 20110213664A1 · Osterhout et al. · 2011 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140153102A1 · Chang · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140240842A1 · Nguyen · 2014 [cited by examiner]
US 20140267420A1 · Schowengerdt · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150185475A1 · Saarikko et al. · 2015 [cited by applicant]
US 20150199009A1 · Raffle et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150289762A1 · Popovich et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160018639A1 · Spitzer · 2016 [cited by examiner]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160085300A1 · Robbins et al. · 2016 [cited by applicant]
US 20170045742A1 · Greenhalgh et al. · 2017 [cited by applicant]
US 20170124928A1 · Edwin et al. · 2017 [cited by applicant]
US 20170131545A1 · Wall et al. · 2017 [cited by applicant]
US 20170176745A1 · Poon et al. · 2017 [cited by applicant]
US 20170184848A1 · Vallius · 2017 [cited by applicant]
US 20170205875A1 · Kaehler · 2017 [cited by applicant]
US 20180004289A1 · Wilson et al. · 2018 [cited by applicant]
US 20180035101A1 · Osterhout · 2018 [cited by applicant]
US 20180136474A1 · Yeoh et al. · 2018 [cited by applicant]
US 20180143438A1 · Oh · 2018 [cited by applicant]
US 20180143485A1 · Oh · 2018 [cited by applicant]
US 20180143509A1 · Oh · 2018 [cited by applicant]
US 20180164627A1 · Oh · 2018 [cited by applicant]
US 20180172995A1 · Lee et al. · 2018 [cited by applicant]
US 20180188528A1 · Browy · 2018 [cited by applicant]
US 20180188542A1 · Waldern et al. · 2018 [cited by applicant]
US 20180232048A1 · Popovich · 2018 [cited by examiner]
US 20180239147A1 · Schowengerdt et al. · 2018 [cited by applicant]
US 20180239177A1 · Oh · 2018 [cited by applicant]
US 20180247464A1 · Haseltine et al. · 2018 [cited by applicant]
US 20180275409A1 · Gao · 2018 [cited by applicant]
US 20180321496A1 · Bohn · 2018 [cited by examiner]
US 20190072767A1 · Vallius et al. · 2019 [cited by applicant]
US 20190086674A1 · Sinay et al. · 2019 [cited by applicant]
US 20190293938A1 · Le Saux · 2019 [cited by examiner]
US 20200301239A1 · Akkaya · 2020 [cited by examiner]
US 20200409145A1 · Bablumyan · 2020 [cited by examiner]
JP 2000511306A · 2000 [cited by applicant]
JP 2010102215A · 2010 [cited by applicant]
JP 2018060011A · 2018 [cited by applicant]
JP 2018101051A · 2018 [cited by applicant]
JP 2018520373A · 2018 [cited by applicant]
JP 2018523147A · 2018 [cited by applicant]
WO 2015012280A1 · 2015 [cited by applicant]
WO 2015081313A2 · 2015 [cited by applicant]
WO 2017139667A1 · 2017 [cited by applicant]
WO 2017176898A1 · 2017 [cited by applicant]
WO 2018111895A1 · 2018 [cited by applicant]
WO WO2020069026 · 2020 [cited by applicant]
WO WO2020191224 · 2020 [cited by applicant]
ARToolKit https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005, 3 pages. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/˜azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995, 262 pages. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005, https://web.media.mit.edu/˜raskar/book/BimberRaskarAugmentedRealityBook.pdf, 393 pages. [cited by applicant]
Extended European Search Report in European Appln. No. 19867981.3, dated May 11, 2022, 15 pages. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US 19/53014, issued Mar. 23, 2021 (MLEAP.239WO2), 7 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US 19/53014, mailed Jan. 2, 2020 (MLEAP.239WO2), 14 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2020/23691, mailed Jun. 18, 2020, 2020 (MLEAP.239WO), 16 pages. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. /paper/in Virtual Environments and Advanced Interface Design, ed. by W Barfield and TA Furne… [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. ACM CHI 2000 Human Factors in Computin… [cited by applicant]
Office Action in Japanese Appln. No. 2021-516897, dated Sep. 8, 2023, 9 pages (with English translation). [cited by applicant]
Office Action in European Appln. No. 19867981.3, dated Mar. 13, 2024, 11 pages. [cited by applicant]
Office Action in Japanese Appln. No. 2024-025370, mailed on Jan. 9, 2025, 10 pages (with English translation). [cited by applicant]