IP Library Granted Patent US 12,443,032
Granted Patent B2
US 12,443,032 · App. 17/697,600 · Granted Oct 14, 2025

Eye tracking with switchable gratings

Inventors: Sihui He (Sunnyvale, CA); Jacques Gollier (Sammamish, WA); Maxwell Parsons (Seattle, WA); Babak Amirsolaimani (Redmond, WA); Wanli Chi (Sammamish, WA); Daniel Guenther Greif (Redmond, WA); Renate Eva Klementine Landig (Seattle, WA); Xiayu Feng (Kirkland, WA); Zhimin Shi (Bellevue, WA); Nicholas John Diorio (Duvall, WA); Yang Yang (Redmond, WA); Giuseppe Calafiore (Redmond, WA); Fenglin Peng (Redmond, WA); Tanya Malhotra (Redmond, WA); Andrew John Ouderkirk (Redmond, WA)
Assignee: Meta Platforms Technologies, LLC
G02B27/0093G01B11/22G01S7/4865G01S17/10G02B6/0016G02B6/0031G02B6/0035G02B6/005G02B6/0066G02B6/3518G02B26/0816G02B27/0081G02B27/0172G02B27/0179G02B27/4205G02B27/44G02F1/133504G02F1/133526G02F1/292G02F1/294G02F1/33G02F1/335G03H1/0248G06F1/163G06F3/013G06T3/4038G06T7/246G09G3/002G09G3/3413H04N23/56H04N23/698G02B2027/0105G02B2027/0138G02B2027/0174G02B2027/0178G02B2027/0187G06T2207/30201G09G2310/0235H04N23/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,443,032
App. No.
17/697,600
Granted
Oct 14, 2025
Kind
B2
Abstract

A switchable grating may be used to redirect illuminating light for illuminating a user's eye in an eye tracking system, to facilitate the determination of eye position and/or orientation. The eye tracking system may be used in a near-eye display. An eye tracking camera obtains an eye image, and a controller performs an initial determination of the eye position. The controller may switch the switchable grating to direct the illuminating light beam onto the eye, for a better position and/or eye orientation determination.

Claims (38)

1. An eye tracking system for determining at least one of a position or orientation of an eye at an eyebox, the eye tracking system comprising:

a light source for providing illuminating light;

a switchable grating structure optically coupled to the light source for receiving and redirecting the illuminating light to a location of the eye at an eyebox; and

an eye tracking camera configured for obtaining images of the eye at the eyebox by detecting the illuminating light redirected by the switchable grating and reflected by the eye.

2. The eye tracking system of claim 1 , further comprising a controller operably coupled to the switchable grating structure and the eye tracking camera and configured to:

determine the location of the eye at the eyebox from an image obtained by the eye tracking camera; and

cause the switchable grating structure to redirect the illuminating light to the location of the eye at the eyebox.

3. The eye tracking system of claim 2 , wherein the controller is further configured to determine the orientation of the eye at the eyebox by detecting a glint of the illuminating light in an image obtained by the eye tracking camera, wherein the glint is formed by a reflection of the illuminating light from the eye upon redirecting of the illuminating light to the location of the eye.

4. The eye tracking system of claim 1 , wherein the switchable grating structure comprises a switchable polarization volume hologram (PVH) grating.

5. The eye tracking system of claim 1 , wherein the switchable grating structure comprises at least one of: a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating, a switchable surface relief LC grating, or a fluidic grating.

6. The eye tracking system of claim 1 , wherein the redirected illuminating light is invisible to the eye.

7. The eye tracking system of claim 6 , wherein the light source is an infrared light source.

8. The eye tracking system of claim 1 , further comprising an acoustic actuator coupled to a slab of transparent material, wherein the switchable grating structure is formed by an acoustic wave generated by the acoustic actuator in the slab.

9. A near-eye display comprising:

a projector for providing image light carrying an image in angular domain for viewing by an eye at an eyebox;

a light source for providing illuminating light for illumination of the eye at the eyebox, wherein the illuminating light is invisible to the eye; and

a switchable grating structure optically coupled to the light source for receiving and redirecting the illuminating light to a location of the eye at an eyebox.

10. The near-eye display of claim 9 , further comprising:

an eye tracking camera configured for obtaining images of the eye at the eyebox; and a controller operably coupled to the switchable grating structure and the eye tracking

camera and configured to:

determine the location of the eye at the eyebox from an image obtained by the eye tracking camera; and

cause the switchable grating structure to redirect the illuminating light to the location of the eye at the eyebox.

11. The near-eye display of claim 10 , wherein the controller is further configured to determine orientation of the eye at the eyebox by detecting a glint of the illuminating light in an image obtained by the eye tracking camera, wherein the glint is formed by a reflection of the illuminating light from the eye upon redirecting of the illuminating light to the location of the eye.

12. The near-eye display of claim 9 , wherein the switchable grating structure comprises a switchable polarization volume hologram (PVH) grating.

13. The near-eye display of claim 9 , wherein the switchable grating structure comprises a switchable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating.

14. The near-eye display of claim 9 , wherein the switchable grating structure comprises a switchable surface relief liquid crystal (LC) grating.

15. The near-eye display of claim 9 , wherein the switchable grating structure comprises a fluidic grating.

16. The near-eye display of claim 9 , further comprising an acoustic actuator coupled to a slab of transparent material, wherein the switchable grating structure is formed by an acoustic wave generated by the acoustic actuator in the slab.

17. A method for determining at least one of a position or orientation of an eye at an eyebox, the method comprising:

providing illuminating light for illuminating the eye at the eyebox, wherein the illuminating light is invisible to the eye;

using a switchable grating structure to redirect the illuminating light to a location of the eye at an eyebox; and

using an eye tracking camera to obtain an image of the eye at the eyebox.

18. The method of claim 17 , further comprising:

determining the location of the eye at the eyebox from the image obtained by the eye tracking camera; and

causing the switchable grating structure to redirect the illuminating light to the location of the eye at the eyebox.

19. The method of claim 18 , further comprising:

determining the orientation of the eye at the eyebox by detecting a glint of the illuminating light in an image obtained by the eye tracking camera, wherein the glint is formed by a reflection of the illuminating light from the eye upon redirecting of the illuminating light to the location of the eye.

20. The method of claim 17 , wherein using the switchable grating structure comprises using at least one of: a polarization volume hologram (PVH) grating; a tunable Pancharatnam-Berry phase (PBP) liquid crystal (LC) grating; a tunable liquid crystal (LC) grating; a fluidic grating; or an acoustic wave generated by an acoustic actuator in a slab of transparent material.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2025
From: HE, SIHUI; GOLLIER, JACQUES; PARSONS, MAXWELL; AMIRSOLAIMANI, BABAK; CHI, WANLI; GREIF, DANIEL GUENTHER; LANDIG, RENATE EVA KLEMENTINE; FENG, XIAYU; SHI, ZHIMIN; DIORIO, NICHOLAS JOHN; YANG, YANG; CALAFIORE, GIUSEPPE; PENG, FENGLIN; MALHOTRA, TANYA; OUDERKIRK, ANDREW JOHN
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 070278/0205 →
CHANGE OF NAME Recorded Feb 20, 2025
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 070284/0739 →
Continuity (3)
Provisional Application 63286230 · Dec 6, 2021
Provisional Application 63286381 · Dec 6, 2021
Related Publication 20230176444A1 · Jun 8, 2023
References Cited (161)
US 6400885B1 · Hu et al. · 2002 [cited by applicant]
US 7884977B2 · Mori · 2011 [cited by examiner]
US 8086044B2 · Feng · 2011 [cited by examiner]
US 8878773B1 · Bozarth · 2014 [cited by examiner]
US 9274597B1 · Karakotsios · 2016 [cited by examiner]
US 9557568B1 · Ouderkirk · 2017 [cited by examiner]
US 9664824B2 · Simmonds et al. · 2017 [cited by applicant]
US 10108014B2 · Vallius et al. · 2018 [cited by applicant]
US 10217286B1 · Angel · 2019 [cited by examiner]
US 10295723B1 · Lee et al. · 2019 [cited by applicant]
US 10466484B1 · Yoon · 2019 [cited by examiner]
US 10466779B1 · Liu · 2019 [cited by examiner]
US 10502963B1 · Noble · 2019 [cited by examiner]
US 10571699B1 · Parsons et al. · 2020 [cited by applicant]
US 10712576B1 · McEldowney · 2020 [cited by applicant]
US 10775633B1 · Lee et al. · 2020 [cited by applicant]
US 10838132B1 · Calafiore et al. · 2020 [cited by applicant]
US 10885843B1 · Lu · 2021 [cited by examiner]
US 10890823B1 · Jiang et al. · 2021 [cited by applicant]
US 11120728B2 · Nagasaki · 2021 [cited by examiner]
US 11176367B1 · Fix · 2021 [cited by examiner]
US 11393430B2 · Nagasaki · 2022 [cited by examiner]
US 20040227838A1 · Atarashi et al. · 2004 [cited by applicant]
US 20070188837A1 · Shimizu et al. · 2007 [cited by applicant]
US 20080143820A1 · Peterson · 2008 [cited by examiner]
US 20080212161A1 · Valette et al. · 2008 [cited by applicant]
US 20080212942A1 · Gordon · 2008 [cited by examiner]
US 20080309649A1 · Kojima · 2008 [cited by examiner]
US 20090040580A1 · Mukawa · 2009 [cited by applicant]
US 20090196460A1 · Jakobs · 2009 [cited by examiner]
US 20110234750A1 · Lai · 2011 [cited by examiner]
US 20120188467A1 · Escuti et al. · 2012 [cited by applicant]
US 20120218481A1 · Popovich et al. · 2012 [cited by applicant]
US 20120249957A1 · Shibata · 2012 [cited by examiner]
US 20120250980A1 · Gillard · 2012 [cited by examiner]
US 20120254369A1 · Gillard · 2012 [cited by examiner]
US 20120257005A1 · Browne · 2012 [cited by examiner]
US 20130099700A1 · Kreye · 2013 [cited by examiner]
US 20130182066A1 · Ishimoto · 2013 [cited by examiner]
US 20140037213A1 · Niederberger · 2014 [cited by examiner]
US 20140049452A1 · Maltz · 2014 [cited by examiner]
US 20140098010A1 · Travis · 2014 [cited by applicant]
US 20140300966A1 · Travers et al. · 2014 [cited by applicant]
US 20150243718A1 · Kwon · 2015 [cited by examiner]
US 20150253591A1 · Kato et al. · 2015 [cited by applicant]
US 20160029883A1 · Cox · 2016 [cited by examiner]
US 20160085300A1 · Robbins · 2016 [cited by examiner]
US 20160241892A1 · Cole · 2016 [cited by examiner]
US 20160342205A1 · Shigeta · 2016 [cited by examiner]
US 20170307886A1 · Stenberg et al. · 2017 [cited by applicant]
US 20180046859A1 · Jarvenpaa · 2018 [cited by examiner]
US 20180073686A1 · Quilici et al. · 2018 [cited by applicant]
US 20180081322A1 · Robbins et al. · 2018 [cited by applicant]
US 20180143586A1 · Narducci et al. · 2018 [cited by applicant]
US 20180196263A1 · Vallius et al. · 2018 [cited by applicant]
US 20180232048A1 · Popovich et al. · 2018 [cited by applicant]
US 20180237696A1 · Tuffin et al. · 2018 [cited by applicant]
US 20180239177A1 · Oh · 2018 [cited by applicant]
US 20180275409A1 · Gao · 2018 [cited by examiner]
US 20180307048A1 · Alexander · 2018 [cited by examiner]
US 20180364487A1 · Yeoh et al. · 2018 [cited by applicant]
US 20190041634A1 · Popovich et al. · 2019 [cited by applicant]
US 20190079292A1 · Alexander et al. · 2019 [cited by applicant]
US 20190086674A1 · Sinay · 2019 [cited by examiner]
US 20190094981A1 · Bradski et al. · 2019 [cited by applicant]
US 20190147564A1 · Yuan et al. · 2019 [cited by applicant]
US 20190243134A1 · Perreault et al. · 2019 [cited by applicant]
US 20190310456A1 · Meng et al. · 2019 [cited by applicant]
US 20190317450A1 · Yaroshchuk et al. · 2019 [cited by applicant]
US 20190361241A1 · Amitai · 2019 [cited by applicant]
US 20200041787A1 · Popovich et al. · 2020 [cited by applicant]
US 20200043398A1 · Salazar · 2020 [cited by applicant]
US 20200081252A1 · Jamali et al. · 2020 [cited by applicant]
US 20200116995A1 · Chi et al. · 2020 [cited by applicant]
US 20200116996A1 · Lee et al. · 2020 [cited by applicant]
US 20200143741A1 · Tsuboi · 2020 [cited by examiner]
US 20200159084A1 · Choi · 2020 [cited by applicant]
US 20200183159A1 · Danziger · 2020 [cited by applicant]
US 20200183174A1 · Noui · 2020 [cited by examiner]
US 20200271936A1 · Leibovici et al. · 2020 [cited by applicant]
US 20200336645A1 · Fukuda · 2020 [cited by examiner]
US 20200368616A1 · Delamont · 2020 [cited by examiner]
US 20200371388A1 · Geng et al. · 2020 [cited by applicant]
US 20200412965A1 · Yoshida · 2020 [cited by examiner]
US 20210011284A1 · Andreev · 2021 [cited by examiner]
US 20210041948A1 · Berkner-Cieslicki · 2021 [cited by examiner]
US 20210055555A1 · Chi et al. · 2021 [cited by applicant]
US 20210191122A1 · Yaroshchuk et al. · 2021 [cited by applicant]
US 20210199958A1 · Huang · 2021 [cited by examiner]
US 20210199970A1 · Huang et al. · 2021 [cited by applicant]
US 20210208397A1 · Lu et al. · 2021 [cited by applicant]
US 20210209364A1 · Park et al. · 2021 [cited by applicant]
US 20210405374A1 · Komanduri et al. · 2021 [cited by applicant]
US 20210405380A1 · Urness et al. · 2021 [cited by applicant]
US 20220004001A1 · Danziger et al. · 2022 [cited by applicant]
US 20220197376A1 · Boyle · 2022 [cited by examiner]
US 20220299754A1 · Gollier et al. · 2022 [cited by applicant]
US 20220350219A1 · Danziger · 2022 [cited by applicant]
US 20220382061A1 · Schultz · 2022 [cited by applicant]
US 20220382064A1 · Rohn · 2022 [cited by examiner]
US 20220394234A1 · Etigson · 2022 [cited by examiner]
US 20220397956A1 · Lundell · 2022 [cited by examiner]
US 20220413302A1 · Meitav · 2022 [cited by examiner]
US 20220413603A1 · Held · 2022 [cited by examiner]
US 20230014577A1 · Gollier et al. · 2023 [cited by applicant]
US 20230057514A1 · Fix · 2023 [cited by examiner]
CN 210323583U · 2020 [cited by applicant]
CN 113075793A · 2021 [cited by applicant]
CN 115698819A · 2023 [cited by applicant]
EP 2767852A1 · 2014 [cited by applicant]
GB 422680A · 1935 [cited by applicant]
GB 2422680A · 2006 [cited by applicant]
GB 2585211A · 2021 [cited by applicant]
JP H0682851A · 1994 [cited by applicant]
KR 20170094350A · 2017 [cited by applicant]
KR 20180135646A · 2018 [cited by applicant]
KR 20210004776A · 2021 [cited by applicant]
WO 2019178398A1 · 2019 [cited by applicant]
WO 2021030093A1 · 2021 [cited by applicant]
WO 2021091622A1 · 2021 [cited by applicant]
WO 2021242667A1 · 2021 [cited by applicant]
WO 2022052949A1 · 2022 [cited by applicant]
Aalizadeh M., et al., “Toward Electrically Tunable, Lithography-Free, Ultra-Thin Color Filters Covering the Whole Visible Spectrum,” Scinetific Reports, vol. 8, No. 1, Jul. 27, 2018, 11 pages. [cited by applicant]
Chang A. S. P., “Tunable Liquid Crystal-Resonant Grating Filter Fabricated by Nanoimprint Lithography,” IEEE Photonics Technology Letters, vol. 19, No. 19, Oct. 1, 2007, pp. 1457-1459. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051388, mailed Apr. 6, 2023, 12 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051487, mailed Apr. 11, 2023, 8 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051608, mailed Apr. 5, 2023, 11 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051751, mailed Apr. 11, 2023, 14 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051758, mailed Mar. 22, 2023, 9 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051809, mailed Apr. 5, 2023, 10 pages. [cited by applicant]
Invitation to Pay Additional Fees for International Application No. PCT/US2022/051814, mailed Apr. 11, 2023, 14 pages. [cited by applicant]
Jolly S., et al., “Near-to-Eye Electroholography via Guided-Wave Acousto-Optics for Augmented Reality,” Proceedings of SPIE, vol. 10127, Mar. 2, 2017, 11 pages. [cited by applicant]
Kollosche M., et al., “Voltage-Controlled Compression for Period Tuning of Optical Surface Relief Gratings,” Optics Letters, vol. 36, No. 8, Apr. 15, 2011, pp. 1389-1391. [cited by applicant]
Lee K. M., et al., “Color-Tunable Mirrors Based on Electrically Regulated Bandwidth Broadening in Polymer-Stabilized Cholesteric Liquid Crystals,” ACS Photonics, Sep. 17, 2014, pp. 1033-1041. [cited by applicant]
Lin I-T., et al., “Electro-Responsive Surfaces with Controllable Wrinkling Patterns for Switchable Light reflection—Diffusion-Grating Devices,” Marterials Today, vol. 41, Dec. 2020, 11 pages. [cited by applicant]
Maimone A., et al., “Holographic Optics for Thin and Lightweight Virtual Reality,” Facebook Reality Labs, ACM Trans. Graph. Article 67, vol. 39, No. 4, Jul. 2020, 14 pages. [cited by applicant]
Shih W-C., et aL, “High-Resolution Electrostatic Analog Tunable Grating With a Single-Mask Fabrication Process,” Journal of Microelectromechanical Systems, vol. 15, No. 4, Aug. 2006, pp. 763-769. [cited by applicant]
Sirleto L., et al., “Electro-Optical Switch and Continuously Tunable Filter based on a Bragg Grating in a Planar Waveguide with a Liquid Crystal Overlayer,” Optical Engineering, vol. 41, No. 11, Nov. 2002, pp. 2890-2898. [cited by applicant]
Xiang J., et al., “Electrically Tunable Selective Refl ection of Light from Ultraviolet to Visible and Infrared by Heliconical Cholesterics,” Advanced Materials, vol. 27, Issue19, May 20, 2015, 5 pages. [cited by applicant]
Draper C.T., et al., “Holographic Waveguide Head-Up Display with 2-D Pupil Expansion and Longitudinal Image Magnification,” Applied Optics, Feb. 10, 2019, vol. 58, No. 5, pp. A251-A257. [cited by applicant]
Palto S.P., “Dynamic and Photonic Properties of Field-Induced Gratings in Flexoelectric LC Layers,” Crystals, 2021, vol. 11, 894, 13 pages. [cited by applicant]
Pogue R.T., et al., “Electrically Switchable Bragg Gratings from Liquid Crystal/Polymer Composites,” Applied Spectroscopy, 2000, vol. 54, No. 1, pp. 12A-28A. [cited by applicant]
Smalley D.E., et al., “Status of Leaky Mode of Holography,” Photonics, 2021, 8, 292, 22 pages. [cited by applicant]
Xiang J., et al., “Electrooptic Response of Chiral Nematic Liquid Crystals with Oblique Helicoidal Director,” Physical Review Letters, 2014, 112, 217801, 14 pages. [cited by applicant]
Zhan T., et al., “High-Efficiency Switchable Optical Elements for Advanced Head-Up Displays,” Journal of the Society for Information Display, Mar. 21, 2019, vol. 27, No. 4, pp. 1-9. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2023/021926, mailed Sep. 4, 2023, 12 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2023/022012, mailed Sep. 1, 2023, 11 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051755, mailed Apr. 26, 2023, 9 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051781, mailed Apr. 18, 2023, 13 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051801 mailed Apr. 14, 2023, 11 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051805 mailed Apr. 14, 2023, 10 pages. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2022/051814, mailed Jun. 2, 2023, 20 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051388, mailed Jun. 20, 2024, 10 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051487, mailed Jun. 20, 2024, 7 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051608, mailed Jun. 20, 2024, 9 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051755, mailed Jun. 20, 2024, 7 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051758, mailed Jun. 20, 2024, 7 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051781, mailed Jun. 20, 2024, 11 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051801, mailed Jun. 20, 2024, 10 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051805, mailed Jun. 20, 2024, 9 pages. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/US2022/051814, mailed Jun. 20, 2024, 16 pages. [cited by applicant]