IP Library Granted Patent US 12,270,999
Granted Patent B2
US 12,270,999 · App. 18/196,349 · Granted Apr 8, 2025

Method and system for high resolution digitized display

Inventors: Lionel Ernest Edwin (Plantation, FL); Ivan Li Chuen Yeoh (Tampa, FL); Brian T. Schowengerdt (Seattle, WA); Kevin Richard Curtis (Boulder, CO); William Hudson Welch (Fort Lauderdale, FL); Pierre St. Hilaire (Belmont, CA); Hui-Chuan Cheng (Cooper City, FL)
Assignee: Magic Leap, Inc.
G02B27/0172G02B6/0016G02B6/0023G02B6/0038G02B2027/011G02B2027/0138G02B2027/0147G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,270,999
App. No.
18/196,349
Granted
Apr 8, 2025
Kind
B2
Abstract

A method and system for increasing dynamic digitized wavefront resolution, i.e., the density of output beamlets, can include receiving a single collimated source light beam and producing multiple output beamlets spatially offset when out-coupled from a waveguide. The multiple output beamlets can be obtained by offsetting and replicating a collimated source light beam. Alternatively, the multiple output beamlets can be obtained by using a collimated incoming source light beam having multiple input beams with different wavelengths in the vicinity of the nominal wavelength of a particular color. The collimated incoming source light beam can be in-coupled into the eyepiece designed for the nominal wavelength. The input beams with multiple wavelengths take different paths when they undergo total internal reflection in the waveguide, which produces multiple output beamlets.

Claims (46)

1. A wearable display device comprising:

a pair of temple arms;

a pair of projector assemblies, each of the pair of projector assemblies being integrated into one of the pair of temple arms, wherein each of the pair of projector assemblies includes a light source for providing a collimated incoming light beam including a plurality of input light beams having different wavelengths;

a pair of optical devices, each of the pair of optical devices including a first prism, a second prism, a third prism, and a fourth prism, wherein each optical device is configured to receive the collimated incoming light beam and output a two-dimensional array of beamlets, wherein:

the first prism and the second prism are separated by a first air gap, a first surface of the first prism and a second surface of the second prism being disposed in parallel and adjacent to each other across the first air gap, the first surface being partially reflective and the second surface being substantially totally reflective, and

the third prism and the fourth prism are separated by a second air gap, a third surface of the third prism and a fourth surface of the fourth prism being disposed in parallel and adjacent to each other across the second air gap, the third surface being partially reflective and the fourth surface being substantially totally reflective;

the third prism and the fourth prism are disposed adjacent to and rotated with respect to the first prism and the second prism;

a pair of main displays, wherein each of the pair of main displays comprises a waveguide including a wavelength-sensitive input coupling element and an output coupling element;

wherein the waveguide is configured for:

in-coupling the two-dimensional array of beamlets into the waveguide using the wavelength-sensitive input coupling element;

propagating the two-dimensional array of beamlets by total internal reflection (TIR), each beamlet propagating along a different path; and

outputting multiple groups of output light beamlets using the output coupling element, each group of output light beamlets including a portion of each of the two-dimensional array of beamlets propagating in the waveguide by total internal reflection.

2. The wearable display device of claim 1 , wherein the waveguide is configured for a nominal wavelength of a color, and the plurality of input light beams have wavelengths in the vicinity of the nominal wavelength.

3. The wearable display device of claim 1 , wherein the collimated incoming light beam is provided by a fiber scanner.

4. The wearable display device of claim 1 , further comprising an eye lens for focusing the multiple groups of output light beamlets for display.

5. The wearable display device of claim 1 , wherein the collimated incoming light beam is incident on the wavelength-sensitive input coupling element at normal incidence.

6. The wearable display device of claim 1 , wherein the wavelength-sensitive input coupling element is coupled to a first surface of the waveguide and the output coupling element is coupled to a second surface of the waveguide opposite to the first surface.

7. A method for displaying an image, the method comprising:

providing a wearable display device including a pair of temple arms;

providing a pair of main displays, wherein each of the pair of main displays comprises a waveguide including a wavelength-sensitive input coupling element;

providing a pair of projector assemblies, each of the pair of projector assemblies being integrated into one of the pair of temple arms, wherein each of the pair of projector assemblies includes a light source for providing a collimated incoming light beam including a plurality of input light beams having different wavelengths;

providing a pair of optical devices, each optical device of the pair of optical devices including a first prism, a second prism, a third prism, and a fourth prism, wherein:

each of the first prism, the second prism, the third prism, and the fourth prism are right triangle prisms;

a first, partially reflective surface of the first prism and a second, totally reflective surface of the second prism are disposed in parallel and adjacent to each other; and

a third, partially reflective surface of the third prism and a fourth, totally reflective surface of the fourth prism are disposed in parallel and adjacent to each other; and

the third prism and the fourth prism are disposed adjacent to and rotated with respect to the first prism and the second prism;

receiving, at each optical device, the collimated incoming light beam;

outputting, from each optical device, a two-dimensional array of beamlets:

in-coupling the two-dimensional array of beamlets into the waveguide using the wavelength-sensitive input coupling element;

propagating the two-dimensional array of beamlets by total internal reflection (TIR), each beamlet propagating along a different path;

providing an output coupling element optically coupled to the waveguide; and

outputting multiple groups of output light beamlets using the output coupling element, each group of output light beamlets including a portion of each of the two-dimensional array of beamlets propagating in the waveguide by total internal reflection.

8. The method of claim 7 , wherein the waveguide is configured for a nominal wavelength of a color, and the plurality of input light beams have wavelengths in the vicinity of the nominal wavelength.

9. The method of claim 7 , wherein the collimated incoming light beam is provided by a fiber scanner.

10. The method of claim 7 , further comprising:

providing an eye lens for focusing the multiple groups of output light beamlets for display.

11. The method of claim 7 , wherein the collimated incoming light beam is incident on the wavelength-sensitive input coupling element at normal incidence.

12. The method of claim 7 , wherein the wavelength-sensitive input coupling element is coupled to a first surface of the waveguide and the output coupling element is coupled to a second surface of the waveguide opposite to the first surface.

13. The wearable display device of claim 1 , wherein the first prism and the second prism are configured to convert the collimated incoming light beam into a first plurality of spatially offset beamlets.

14. The wearable display device of claim 13 , wherein the third prism and the fourth prism are configured to convert the first plurality of spatially offset beamlets into the two-dimensional array of beamlets.

15. The wearable display device of claim 13 , wherein an output surface of the first prism is parallel to a first side surface of the third prism, wherein the first plurality of spatially offset beamlets propagate through the third prism to the third surface.

16. The wearable display device of claim 15 , wherein a second side surface of the third prism is parallel to the waveguide and perpendicular to the output surface of the first prism.

17. The wearable display device of claim 13 , wherein the first plurality of spatially offset beamlets enter the third prism perpendicular to a first side surface of the third prism.

18. The wearable display device of claim 13 , wherein the first plurality of spatially offset beamlets is offset across a longitudinal direction of the waveguide, and the two-dimensional array of beamlets is offset along a latitudinal direction of the waveguide.

19. The wearable display device of claim 13 , wherein the first prism and the second prism are configured to receive the collimated incoming light beam and output the first plurality of spatially offset beamlets.

20. The method of claim 7 wherein the first prism and the second prism are configured to convert the collimated incoming light beam into a first plurality of spatially offset beamlets and the third prism and the fourth prism are configured to convert the first plurality of spatially offset beamlets into the two-dimensional array of beamlets.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073422/0549 →
SECURITY INTEREST Recorded Oct 15, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073109/0238 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 11, 2023
From: EDWIN, LIONEL ERNEST; YEOH, IVAN LI-CHUEN; SCHOWENGERDT, BRIAN T.; CURTIS, KEVIN RICHARD; WELCH, WILLIAM HUDSON; ST.HILAIRE, PIERRE; CHENG, HUI-CHUAN
To: MAGIC LEAP, INC.
Reel/Frame 063618/0749 →
Continuity (4)
Division 16860756 · Apr 28, 2020
Division 15826315 · Nov 29, 2017
Provisional Application 62428510 · Nov 30, 2016
Related Publication 20230280594A1 · Sep 7, 2023
References Cited (119)
US 3544200A · Boll · 1970 [cited by applicant]
US 4711512A · Upatnieks · 1987 [cited by examiner]
US 5886822A · Spitzer · 1999 [cited by applicant]
US 6897992B2 · Kikuchi · 2005 [cited by applicant]
US 7181108B2 · Levola · 2007 [cited by examiner]
US 7206107B2 · Levola · 2007 [cited by applicant]
US 9791700B2 · Schowengerdt · 2017 [cited by applicant]
US 10678055B2 · Edwin et al. · 2020 [cited by applicant]
US 11686944B2 · Edwin et al. · 2023 [cited by applicant]
US 20020061178A1 · Winston et al. · 2002 [cited by applicant]
US 20020122015A1 · Song · 2002 [cited by examiner]
US 20020181103A1 · Davydov · 2002 [cited by applicant]
US 20040257664A1 · Hashimoto et al. · 2004 [cited by applicant]
US 20060018014A1 · Niv · 2006 [cited by examiner]
US 20060114420A1 · Kim et al. · 2006 [cited by applicant]
US 20100109976A1 · Gilbert · 2010 [cited by examiner]
US 20120062998A1 · Schultz et al. · 2012 [cited by applicant]
US 20130014380A1 · Tanimura · 2013 [cited by applicant]
US 20130077049A1 · Bohn · 2013 [cited by applicant]
US 20140172432A1 · Sendai · 2014 [cited by examiner]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150153569A1 · Yonekubo · 2015 [cited by applicant]
US 20150178939A1 · Bradski · 2015 [cited by examiner]
US 20150241844A1 · Horikawa · 2015 [cited by applicant]
US 20150277124A1 · Ide et al. · 2015 [cited by applicant]
US 20150279114A1 · Yonekubo · 2015 [cited by applicant]
US 20150346490A1 · Tekolste et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160041387A1 · Valera et al. · 2016 [cited by applicant]
US 20160048018A1 · De Matos Pereira Vieira · 2016 [cited by applicant]
US 20160143539A1 · Koerner et al. · 2016 [cited by applicant]
US 20160231567A1 · Saarikko et al. · 2016 [cited by applicant]
US 20160231568A1 · Saarikko et al. · 2016 [cited by applicant]
US 20160252724A1 · Nikkhoo · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20160327789A1 · Klug et al. · 2016 [cited by applicant]
US 20170075119A1 · Schultz et al. · 2017 [cited by applicant]
US 20170176745A1 · Poon et al. · 2017 [cited by applicant]
US 20170307886A1 · Stenberg et al. · 2017 [cited by applicant]
US 20180149873A1 · Edwin et al. · 2018 [cited by applicant]
US 20200326546A1 · Edwin et al. · 2020 [cited by applicant]
AU 2017366896A1 · 2019 [cited by applicant]
CA 3045046A1 · 2018 [cited by applicant]
CN 1444734A · 2003 [cited by applicant]
CN 1554033A · 2004 [cited by applicant]
CN 1641764A · 2005 [cited by applicant]
CN 1779502A · 2006 [cited by applicant]
CN 201173997Y · 2008 [cited by applicant]
CN 101730859A · 2010 [cited by applicant]
CN 101878654A · 2010 [cited by applicant]
CN 101952765A · 2011 [cited by applicant]
CN 104335117A · 2015 [cited by applicant]
CN 104678555A · 2015 [cited by applicant]
CN 105093366A · 2015 [cited by applicant]
CN 105572873A · 2016 [cited by applicant]
CN 110023819A · 2019 [cited by applicant]
EP 2165232A1 · 2010 [cited by applicant]
EP 3548959A1 · 2019 [cited by applicant]
IN 201947018178A · 2019 [cited by applicant]
JP 07311302A · 1995 [cited by applicant]
JP 08114705A · 1996 [cited by applicant]
JP 2003536102A · 2003 [cited by applicant]
JP 2004021078A · 2004 [cited by applicant]
JP 2006501499A · 2006 [cited by applicant]
JP 2007219106A · 2007 [cited by applicant]
JP 2010032997A · 2010 [cited by applicant]
JP 2014132328A · 2014 [cited by applicant]
JP 2015106105A · 2015 [cited by applicant]
JP 2016516221A · 2016 [cited by applicant]
JP 2020501185A · 2020 [cited by applicant]
KR 20160062030A · 2016 [cited by applicant]
KR 20190086763A · 2019 [cited by applicant]
SU 1163161A1 · 1985 [cited by applicant]
TW 201831959A · 2018 [cited by applicant]
WO 0014836A1 · 2000 [cited by applicant]
WO 2009009268A1 · 2009 [cited by applicant]
WO 2016094940A1 · 2016 [cited by applicant]
WO 2018102445A1 · 2018 [cited by applicant]
Wikipedia webpage “Head-up display” (Year: 2016). [cited by examiner]
Cakmakci et al. “Head-Worn Displays: A Review” Journal of Display Technology, vol. 2, No. 3 pp. 199-216 (Year: 2006). [cited by examiner]
BAE Systems “The evolution of the Head-Up Display” https://www.baesystems.com/en/feature/our-innovations-hud (Year: 2016). [cited by examiner]
Bailey “HUD Lessons-Learned for HMD Development” SPIE Proceedings vol. 2218, Helmet- and Head-Mounted Displays and Symbology Design Requirements, pp. 216-225 (Year: 1994). [cited by examiner]
U.S. Appl. No. 15/826,315, “Final Office Action”, Sep. 27, 2019, 18 pages. [cited by applicant]
U.S. Appl. No. 15/826,315, “Non-Final Office Action”, Jun. 11, 2019, 10 pages. [cited by applicant]
U.S. Appl. No. 15/826,315, “Notice of Allowance”, Jan. 31, 2020, 18 pages. [cited by applicant]
U.S. Appl. No. 15/826,315, “Restriction Requirement”, Jan. 30, 2019, 6 pages. [cited by applicant]
U.S. Appl. No. 16/860,756, “Final Office Action”, Jul. 18, 2022, 10 pages. [cited by applicant]
U.S. Appl. No. 16/860,756, “Non-Final Office Action”, Sep. 30, 2022, 11 pages. [cited by applicant]
U.S. Appl. No. 16/860,756, “Non-Final Office Action”, Oct. 13, 2022, 14 pages. [cited by applicant]
U.S. Appl. No. 16/860,756, “Non-Final Office Action”, Apr. 8, 2022, 15 pages. [cited by applicant]
U.S. Appl. No. 16/860,756, “Notice of Allowance”, Feb. 13, 2023, 7 pages. [cited by applicant]
AU 2017366896, “First Examination Report”, Nov. 25, 2021, 4 pages. [cited by applicant]
AU 2017366896, “Notice of Acceptance”, Nov. 24, 2022, 3 pages. [cited by applicant]
AU 2017366896, “Second Examination Report”, Sep. 15, 2022, 3 pages. [cited by applicant]
CN 201780073726.X, “Notice of Decision to Grant” and English translation, Mar. 25, 2022, 3 pages. [cited by applicant]
CN 201780073726.X, “Office Action” and English translation, Aug. 16, 2021, 11 pages. [cited by applicant]
CN201780073726.X, “Office Action” and English translation, Feb. 20, 2021, 15 pages. [cited by applicant]
CN 201780073726.X, “Office Action” and English translation, Jan. 18, 2022, 8 pages. [cited by applicant]
EP 17875416.4, “Extended European Search Report”, Nov. 14, 2019, 8 pages. [cited by applicant]
EP 17875416.4, “Notice of Decision to Grant”, Oct. 13, 2022, 2 pages. [cited by applicant]
EP 17875416.4, “Office Action”, May 25, 2021, 5 pages. [cited by applicant]
EP 22204975.1, “Extended European Search Report”, Feb. 13, 2023, 7 pages. [cited by applicant]
IL 266822, “Office Action”, May 12, 2022, 3 pages. [cited by applicant]
IN 201947018178, “First Examination Report”, Mar. 18, 2022, 5 pages. [cited by applicant]
JP 2019-528665, “Office Action” and English translation, Nov. 30, 2021, 11 pages. [cited by applicant]
JP 2019-528665, “Office Action” and English translation, Jun. 29, 2022, 7 pages. [cited by applicant]
KR 10-2019-7018964, “Notice of Decision to Grant” and English translation, May 26, 2023, 4 pages. [cited by applicant]
KR 10-2019-7018964, “Office Action” and English translation, Jun. 14, 2022, 18 pages. [cited by applicant]
KR 10-2019-7018964, “Office Action” and English translation, Dec. 26, 2022, 7 pages. [cited by applicant]
PCT/US2017/063763, “International Preliminary Report on Patentability”, Jun. 13, 2019, 9 pages. [cited by applicant]
PCT/US2017/063763, “International Search Report and Written Opinion”, Mar. 8, 2018, 10 pages. [cited by applicant]
Takeuchi et al., “Two-Beam X-Ray Holography Using Prism Optics”, Japanese Journal of Applied Physics, vol. 44, No. 5, May 10, 2005, pp. 3293-3298. [cited by applicant]
TW 106141820, “Notice of Decision to Grant” and English translation, Jan. 3, 2022, 4 pages. [cited by applicant]
TW 106141820, “Office Action” and English translation, Aug. 5, 2021, 27 pages. [cited by applicant]
KR10-2023-7028479, “Office Action” and English translation, Dec. 19, 2023, 13 pages. [cited by applicant]
AU2023201300, “First Examination Report”, Apr. 10, 2024, 4 pages. [cited by applicant]
JP2023-23489, “Office Action” and English translation, Feb. 13, 2024, 8 pages. [cited by applicant]
NZ753153, “First Examination Report”, May 28, 2024, 3 pages. [cited by applicant]
CA3,045,046, “Office Action”, May 7, 2024, 4 pages. [cited by applicant]