IP Library Granted Patent US 12,216,288
Granted Patent B2
US 12,216,288 · App. 18/322,401 · Granted Feb 4, 2025

Display system with spatial light modulator illumination for divided pupils

Inventors: Hui-Chuan Cheng (Cooper City, FL); Chulwoo Oh (Sammamish, WA); Clinton Carlisle (Parkland, FL); Michael Anthony Klug (Austin, TX); William J. Molteni, Jr. (Nibley, UT)
Assignee: Magic Leap, Inc.
G02B27/0944G02B27/0172G02B27/1026G02B27/1046G02B2027/0174G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,216,288
App. No.
18/322,401
Granted
Feb 4, 2025
Kind
B2
Abstract

Illuminations systems that separate different colors into laterally displaced beams may be used to direct different color image content into an eyepiece for displaying images in the eye. Such an eyepiece may be used, for example, for an augmented reality head mounted display. Illumination systems may be provided that utilize one or more waveguides to direct light from a light source towards a spatial light modulator. Light from the spatial light modulator may be directed towards an eyepiece. Some aspects of the invention provide for light of different colors to be outcoupled at different angles from the one or more waveguides and directed along different beam paths.

Claims (31)

1. A display device comprising:

a light source;

a waveguide disposed with respect to said light source to receive light from said light source, said waveguide including an outcoupling optical element configured to eject light out of said waveguide; and

a spatial light modulator disposed with respect to said waveguide to receive said light ejected from said waveguide and modulate said light, wherein said outcoupling optical element comprises a plurality of volume phase gratings arranged in a stack, and wherein the stack is positioned on a first surface of the waveguide and is arranged to receive the light from the light source, wherein each volume phase grating of the plurality of volume phase gratings is configured to reflect the light received from the light source toward the first surface of the waveguide at a different respective angle of diffraction such that the light ejected from the waveguide is outcoupled to different locations corresponding to the different respective angles of diffraction.

2. The display device of claim 1 , wherein each volume phase grating in the plurality of volume phase gratings is configured to diffract light having a different respective wavelength.

3. The display device of claim 1 , wherein each volume phase grating in the plurality of volume phase gratings is configured to diffract light of a same color into a different respective angle of diffraction.

4. The display device of claim 1 , wherein a coupling efficiency of the outcoupling optical element exhibits a gradient with distance away from the light source.

5. The display device of claim 4 , wherein the coupling efficiency of the outcoupling optical element is lower closer to the light source and higher farther from the light source.

6. The display device of claim 1 , wherein the waveguide has a wedge-shape.

7. The display device of claim 1 , wherein the waveguide has a curved-shape.

8. A display device comprising:

a light source having a first spectral distribution;

a waveguide disposed with respect to said light source to receive light from said light source, said waveguide including an outcoupling optical element comprising a liquid crystal and configured to eject light out of said waveguide;

a spatial light modulator disposed with respect to said waveguide to receive said light ejected from said waveguide and modulate said light;

a first optical retarder arranged between the liquid crystal and the spatial light modulator, wherein the first optical retarder is disposed on a first side of the waveguide between the waveguide and the spatial light modulator, and wherein the first optical retarder converts circularly polarized light diffracted from the liquid crystal into linear polarized light; and

a second optical retarder, wherein the second optical retarder is disposed on a second side of the waveguide that is opposite to the first side of the waveguide, and wherein the second optical retarder converts circular polarized light into linear polarized light with a linear polarization different than that of the first optical retarder.

9. The display device of claim 8 , wherein the liquid crystal is configured to diffract circularly polarized light and the spatial light modulator is configured to modulate linear polarized light.

10. The display device of claim 8 , wherein the first optical retarder is a quarter-wave retarder.

11. The display device of claim 8 , wherein the liquid crystal has a gradient in coupling efficiency.

12. The display device of claim 11 , wherein the liquid crystal is configured to have a high diffractive efficiency further away from the light source and a lower diffractive efficiency closer to the light source.

13. The display device of claim 8 , wherein the liquid crystal comprises a stack of cholesteric liquid crystal diffractive elements, wherein each cholesteric liquid crystal diffractive element of the stack of cholesteric liquid crystal diffractive elements is configured to diffract a different respective color.

14. The display device of claim 8 , wherein the waveguide has a wedge-shape.

15. The display device of claim 8 , wherein the waveguide has a curved-shape.

16. A display device for a head mounted display comprising:

a waveguide based image source comprising:

one or more light emitters configured to emit light; and

one or more waveguides disposed with respect to said one or more light emitters to receive light from said one or more light emitters such that light is guided within said one or more waveguides via total internal reflection, said one or more waveguides configured to eject light out of said waveguides;

a spatial light modulator disposed with respect to one or more waveguides to receive said light ejected from said one or more waveguides and modulate said light, wherein said one or more light emitters are configured to emit light having a spectral distribution that includes spectral components corresponding to first and second colors, and wherein said waveguide based image source is configured such that said light of said first and second colors after being modulated by said spatial light modulator is directed along said respective first and second paths and is incident on respective first and second spatial locations a distance from said one or more waveguides and said spatial light modulator; and

an eyepiece element comprising a waveguide based light distribution system comprising:

a first waveguide having associated therewith an in-coupling optical element disposed with respect to one or more first waveguides and said first path to receive light from said one or more waveguides after being modulated by said spatial light modulator; and

a second waveguide having associated therewith an in-coupling optical element disposed with respect to said one or more waveguides and said second path to receive light from said one or more waveguides after being modulated by said spatial light modulator, wherein said in-coupling optical elements associated with said first and second waveguides, respectively, are located at said first and second spatial locations along said first and second paths respectively to receive said light of said first and second colors, respectively.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2023
From: CHENG, HUI-CHUAN; OH, CHULWOO; CARLISLE, CLINTON; KLUG, MICHAEL ANTHONY; MOLTENI, WILLIAM J., JR.
To: MAGIC LEAP, INC.
Reel/Frame 063752/0474 →
Continuity (5)
Continuation 17895868 · Aug 25, 2022
Continuation 17351110 · Jun 17, 2021
Division 15928015 · Mar 21, 2018
Provisional Application 62474568 · Mar 21, 2017
Related Publication 20230367132A1 · Nov 16, 2023
References Cited (91)
US 6750995B2 · Dickson · 2004 [cited by applicant]
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 9081426B2 · Armstrong · 2015 [cited by applicant]
US 9557473B2 · Nicol et al. · 2017 [cited by applicant]
US 11079603B2 · Cheng et al. · 2021 [cited by applicant]
US 20030007201A1 · Dickson · 2003 [cited by applicant]
US 20050094938A1 · Ghiron · 2005 [cited by examiner]
US 20050106746A1 · Shinn · 2005 [cited by examiner]
US 20050232530A1 · Kekas · 2005 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20060056028A1 · Wildnauer · 2006 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20090128911A1 · Itzkovitch et al. · 2009 [cited by applicant]
US 20090154322A1 · Sato · 2009 [cited by examiner]
US 20110242661A1 · Simmonds · 2011 [cited by applicant]
US 20110273906A1 · Nichol et al. · 2011 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20130308185A1 · Robinson et al. · 2013 [cited by applicant]
US 20140049983A1 · Nichol · 2014 [cited by examiner]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140140654A1 · Brown et al. · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt · 2014 [cited by applicant]
US 20140306866A1 · Miller et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150222883A1 · Welch · 2015 [cited by applicant]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150268415A1 · Schowengerdt et al. · 2015 [cited by applicant]
US 20150277044A1 · Hatori · 2015 [cited by examiner]
US 20150293415A1 · Wang · 2015 [cited by examiner]
US 20150302652A1 · Miller et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346490A1 · TeKolste et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160033698A1 · Escuti et al. · 2016 [cited by applicant]
US 20160327789A1 · Klug et al. · 2016 [cited by applicant]
US 20160377907A1 · Wu et al. · 2016 [cited by applicant]
US 20170373459A1 · Weng et al. · 2017 [cited by applicant]
US 20180284460A1 · Cheng · 2018 [cited by applicant]
US 20190011708A1 · Schultz · 2019 [cited by examiner]
US 20200166756A1 · DeLapp · 2020 [cited by examiner]
CN 103038567 · 2013 [cited by applicant]
CN 103038568 · 2013 [cited by applicant]
CN 103299358 · 2013 [cited by applicant]
CN 103823267 · 2014 [cited by applicant]
CN 104914588 · 2015 [cited by applicant]
CN 105934902 · 2016 [cited by applicant]
CN 106501938 · 2016 [cited by applicant]
CN 106371218 · 2017 [cited by applicant]
CN 106443867 · 2017 [cited by applicant]
EP 2196729 · 2010 [cited by applicant]
EP 2733517 · 2014 [cited by applicant]
JP 2003515160A · 2003 [cited by applicant]
JP 2005157164 · 2005 [cited by applicant]
JP 2011123499 · 2011 [cited by applicant]
JP 2015525493 · 2015 [cited by applicant]
JP 2018521350 · 2018 [cited by applicant]
JP 2021516359 · 2021 [cited by applicant]
KR 20040039400A · 2004 [cited by applicant]
WO WO2007031992 · 2007 [cited by applicant]
WO WO2011130718 · 2011 [cited by applicant]
WO WO2016205256 · 2016 [cited by applicant]
WO WO2018175653 · 2018 [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005, 3 pages. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/˜azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995, 262 pages. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005, 393 pages, https://web.media.mit.edu/˜raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No., PCT/US2018/023652, issued Sep. 24, 2019, 10 pages. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2018/023652, mailed Jun. 7, 2018, 16 pages. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
Mukawa et al., “A full-color eyewear display using planar waveguides with reflection volume holograms,” Journal of the Society for Information Display, The Society for Information Display, Jan. 2009, 17(3):185-193. [cited by applicant]
Office Action in Japanese Appln. No. 2019-550768, dated Feb. 2, 2022, 10 pages (with English translation). [cited by applicant]
Office Action in Japanese Appln. No. 2022-121456, dated Aug. 1, 2023, 8 pages (with English translation). [cited by applicant]
Search Report in Japanese Appln. No. 2019-550768, dated Jan. 14, 2022, 30 pages (with English translation). [cited by applicant]
Supplementary Search Report in Chinese Appln. No. 201880032797X, dated Jan. 25, 2021, 2 pages. [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. ACM CHI 2000 Human Factors in Computin… [cited by applicant]
Office Action in Japanese Appln. No. 2023-203661, dated Aug. 30, 2024, 7 pages (with English translation). [cited by applicant]
Office Action in Korean Appln. No. 10-2023-7038399, mailed on Nov. 4, 2024, 11 pages (with English translation). [cited by applicant]