IP Library Granted Patent US 12,332,451
Granted Patent B2
US 12,332,451 · App. 18/733,144 · Granted Jun 17, 2025

Eyewear with pinhole and slit cameras

Inventors: Asif Sinay (Tel-Aviv, IL); Nizan Meitav (Kiryat Ata, IL); Chulwoo Oh (Sammamish, WA); Barak Freedman (Binyamina, IL); Michael Anthony Klug (Austin, TX); Adam C. Carlson (Miami, FL)
Assignee: Magic Leap, Inc.
G02B27/0172G02B6/0023G02B6/005G02B27/4205G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,332,451
App. No.
18/733,144
Granted
Jun 17, 2025
Kind
B2
Abstract

A head mounted display system can include a camera, at least one waveguide, at least one coupling optical element that is configured such that light is coupled into the waveguide(s) and guided therein, and at least one out-coupling element. The at least one out-coupling element can be configured to couple light that is guided within the waveguide(s) out of the waveguide(s) and direct the light to the camera. The at least one coupling element may include a diffractive optical element having optical power. Additionally or alternatively, the at least one coupling optical element may have a coupling area, for coupling light into the waveguide(s), the coupling area having an average thickness in a range from 0.1 to 3 millimeters across and/or may have a pinhole sized and/or slit shaped coupling area.

Claims (24)

1. A head-mounted display system configured to project light to an eye of a user to display augmented reality image content in a vision field of the user, the head-mounted display system comprising:

a frame configured to be supported on a head of the user;

an image projector configured to project images comprising image content;

at least one camera; and

an eyepiece supported by the frame, the eyepiece configured to direct the images into the eye of the user to display the image content in the vision field of the user, at least a portion of the eyepiece being transparent to enable the user to view an environment in front of the user while viewing the displayed image content, the eyepiece comprising:

a waveguide;

at least one in-coupling optical element configured such that light incident thereon is coupled into the waveguide and guided therein, wherein the incident light includes light reflected off a surface of the eye, wherein the at least one in-coupling optical element comprises a diffractive optical element having a coupling area for coupling the incident light into the waveguide, wherein the coupling area is a pinhole size coupling area having an average thickness in a range from 0.1 to 3 millimeters across; and

at least one out-coupling optical element configured to couple at least a portion of the light guided within the waveguide out of the waveguide to be captured by the at least one camera, wherein the at least one camera generates at least one image of the eye based on the captured light.

2. The system of claim 1 , wherein the average thickness of the coupling area is in a range from 0.5 to 2 millimeters.

3. The system of claim 1 , wherein the average thickness of the coupling area is in a range from 1 to 2 millimeters.

4. The system of claim 1 , wherein the coupling area has a rectangular shape.

5. The system of claim 1 , wherein the coupling area has an arcuate shape.

6. The system of claim 1 , wherein the coupling area has a non-arcuate shape.

7. The system of claim 1 , wherein the coupling area has a slit shape.

8. The system of claim 1 , wherein the coupling area has a length and a width, wherein the length is longer than the width, and wherein the coupling area is straight along the length.

9. The system of claim 1 , wherein the coupling area has an aspect ratio in a range from 5 to 100.

10. The system of claim 1 , wherein the coupling area has an aspect ratio in a range from 10 to 100.

11. The system of claim 1 , wherein the at least one out-coupling optical element comprises a diffractive optical element.

12. The system of claim 1 , wherein a coupling area of the at least one out-coupling optical element has an aspect ratio in a range from 1 to 2.

13. The system of claim 1 , wherein the at least one out-coupling optical element has a coupling area for coupling light out of the waveguide having a thickness from 0.5 mm to 3.0 millimeters across.

14. The system of claim 1 , further comprising at least one light source arranged to illuminate at least a portion of the eye of the user with infrared light.

15. The system of claim 14 , wherein the at least one light source comprises one or more infrared light emitting diodes.

16. The system of claim 14 , wherein the at least one light source is pulsed.

17. The system of claim 14 , further comprising an off-axis reflector arranged to receive the infrared light from the at least one light source and direct the received infrared light toward the eye.

Assignments (3)
SECURITY INTEREST Recorded Oct 31, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073439/0168 →
SECURITY INTEREST Recorded Oct 24, 2025
From: MAGIC LEAP, INC.; MENTOR ACQUISITION ONE, LLC; MOLECULAR IMPRINTS, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 073255/0581 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2024
From: SINAY, ASIF; MEITAV, NIZAN; OH, CHULWOO; FREEDMAN, BARAK; KLUG, MICHAEL ANTHONY; CARLSON, ADAM C.
To: MAGIC LEAP, INC.
Reel/Frame 067872/0981 →
Continuity (4)
Continuation 17279428
Provisional Application 62737817 · Sep 27, 2018
Provisional Application 62737063 · Sep 26, 2018
Related Publication 20240319508A1 · Sep 26, 2024
References Cited (77)
US 6850221B1 · Tickle · 2005 [cited by applicant]
US 8878749B1 · Wu et al. · 2014 [cited by applicant]
US 12050318B2 · Sinay et al. · 2024 [cited by applicant]
US 20060028436A1 · Armstrong · 2006 [cited by applicant]
US 20070064310A1 · Mukawa et al. · 2007 [cited by applicant]
US 20070081123A1 · Lewis · 2007 [cited by applicant]
US 20090002787A1 · Cable · 2009 [cited by examiner]
US 20090303212A1 · Akutsu et al. · 2009 [cited by applicant]
US 20100046750A1 · Asfour · 2010 [cited by examiner]
US 20100284090A1 · Simmonds · 2010 [cited by applicant]
US 20110157667A1 · Lacoste · 2011 [cited by examiner]
US 20120051694A1 · Russert · 2012 [cited by applicant]
US 20120127062A1 · Bar-Zeev et al. · 2012 [cited by applicant]
US 20120162549A1 · Gao et al. · 2012 [cited by applicant]
US 20120224062A1 · Lacoste · 2012 [cited by examiner]
US 20130082922A1 · Miller · 2013 [cited by applicant]
US 20130117377A1 · Miller · 2013 [cited by applicant]
US 20130125027A1 · Abovitz · 2013 [cited by applicant]
US 20130208234A1 · Lewis · 2013 [cited by applicant]
US 20130242262A1 · Lewis · 2013 [cited by applicant]
US 20140071539A1 · Gao · 2014 [cited by applicant]
US 20140177023A1 · Gao et al. · 2014 [cited by applicant]
US 20140218468A1 · Gao et al. · 2014 [cited by applicant]
US 20140267420A1 · Schowengerdt et al. · 2014 [cited by applicant]
US 20150016777A1 · Abovitz et al. · 2015 [cited by applicant]
US 20150103306A1 · Kaji et al. · 2015 [cited by applicant]
US 20150178939A1 · Bradski et al. · 2015 [cited by applicant]
US 20150182748A1 · Gefen et al. · 2015 [cited by applicant]
US 20150205126A1 · Schowengerdt · 2015 [cited by applicant]
US 20150219834A1 · Nichol et al. · 2015 [cited by applicant]
US 20150268399A1 · Futterer · 2015 [cited by applicant]
US 20150289762A1 · Popovich et al. · 2015 [cited by applicant]
US 20150309263A2 · Abovitz et al. · 2015 [cited by applicant]
US 20150326570A1 · Publicover et al. · 2015 [cited by applicant]
US 20150346495A1 · Welch et al. · 2015 [cited by applicant]
US 20160011419A1 · Gao · 2016 [cited by applicant]
US 20160018639A1 · Spitzer et al. · 2016 [cited by applicant]
US 20160026253A1 · Bradski et al. · 2016 [cited by applicant]
US 20160033698A1 · Escuti et al. · 2016 [cited by applicant]
US 20160085300A1 · Robbins et al. · 2016 [cited by applicant]
US 20160169798A1 · Kostka et al. · 2016 [cited by applicant]
US 20160209657A1 · Popovich et al. · 2016 [cited by applicant]
US 20160225190A1 · Yamazaki · 2016 [cited by applicant]
US 20160270656A1 · Samec et al. · 2016 [cited by applicant]
US 20160349517A1 · Miyasaka et al. · 2016 [cited by applicant]
US 20170255013A1 · Tam et al. · 2017 [cited by applicant]
US 20170264817A1 · Yan et al. · 2017 [cited by applicant]
US 20180046859A1 · Jarvenpaa · 2018 [cited by applicant]
US 20180052325A1 · Bohn · 2018 [cited by applicant]
US 20180059304A1 · Bhargava et al. · 2018 [cited by applicant]
US 20180130391A1 · Bohn · 2018 [cited by applicant]
US 20180231779A1 · Bohn · 2018 [cited by applicant]
US 20180239177A1 · Oh · 2018 [cited by applicant]
US 20180321496A1 · Bohn · 2018 [cited by applicant]
US 20180330652A1 · Perreault et al. · 2018 [cited by applicant]
US 20200209627A1 · Roggatz · 2020 [cited by applicant]
US 20220011578A1 · Sinay et al. · 2022 [cited by applicant]
JP 2003337298A · 2003 [cited by applicant]
JP 2005250408A · 2005 [cited by applicant]
JP 2010102215A · 2010 [cited by applicant]
JP 2015060071A · 2015 [cited by applicant]
JP 2015194549A · 2015 [cited by applicant]
WO 2020069037A1 · 2020 [cited by applicant]
ARToolKit: https://web.archive.org/web/20051013062315/http://www.hitl.washington.edu:80/artoolkit/documentation/hardware.htm, archived Oct. 13, 2005. [cited by applicant]
Azuma, “A Survey of Augmented Reality,” Teleoperators and Virtual Environments 6, 4 (Aug. 1997), pp. 355-385. https://web.archive.org/web/20010604100006/http://www.cs.unc.edu/ azuma/ARpresence.pdf. [cited by applicant]
Azuma, “Predictive Tracking for Augmented Realty,” TR95-007, Department of Computer Science, UNC-Chapel Hill, NC, Feb. 1995. [cited by applicant]
Bimber, et al., “Spatial Augmented Reality—Merging Real and Virtual Worlds,” 2005 https://web.media.mit.edu/raskar/book/BimberRaskarAugmentedRealityBook.pdf. [cited by applicant]
IL273397 Office Action dated Nov. 13, 2022. [cited by applicant]
International Preliminary Report on Patentability for PCT Application No. PCT/US2019/021799, issued Sep. 15, 2020. [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/US2019/021799, mailed May 16, 2019. [cited by applicant]
Jacob, “Eye Tracking in Advanced Interface Design,” Human-Computer Interaction Lab Naval Research Laboratory, Washington, D.C. / paper/ in Virtual Environments and Advanced Interface Design, ed. by W. Barfield and T.A. … [cited by applicant]
JP2020-516716 Official Action dated Feb. 9, 2023. [cited by applicant]
JP2021-516924 Office Action dated Jul. 7, 2023. [cited by applicant]
KR2020-7010603 Office Action dated Jul. 3, 2023. [cited by applicant]
Tanriverdi and Jacob, “Interacting With Eye Movements in Virtual Environments,” Department of Electrical Engineering and Computer Science, Tufts University, Medford, MA—paper/Proc. AMC CHI 2000 Human Factors in Computin… [cited by applicant]
U.S. Appl. No. 16/138,228 Office Action dated Apr. 5, 2023. [cited by applicant]
U.S. Appl. No. 16/138,228 Office Action dated Sep. 15, 2022. [cited by applicant]