IP Library › Granted Patent US 12,474,773
Granted Patent B2
US 12,474,773 · App. 18/562,445 · Granted Nov 18, 2025

Eye movement determination

Inventors: Daniel Najer (Eindhoven, NL); Jens Geiger (Eindhoven, NL); Ferran Suarez (Eindhoven, NL); Laurent Nevou (Eindhoven, NL); Svenja Mauthe (Eindhoven, NL)
Assignee: ams International AG
G06F3/013G02B27/0093G02B27/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,474,773
App. No.
18/562,445
Granted
Nov 18, 2025
Kind
B2
Abstract

A method for operating a display of a virtual reality or augmented reality headset includes determining a direction of movement of a user's eye, estimating a future gaze direction from the determined direction of movement, and rendering an image on the display having higher resolution image data in a region including the estimated gaze direction and lower resolution image data outside of the region including the determined gaze direction. The determining the direction of movement of the user's eye includes illuminating the user's eye with a beam of light emitted by a first laser, receiving, at the first laser, light redirected from the user's eye_such that self-mixing interference occurs within the laser cavity between light generated by the first laser and the light redirected from the user's eye, measuring the self-mixing interference, and determining a direction of movement of the user's eye-from the measured self-mixing interference.

Claims (35)

1 . A method for operating a display of a virtual reality (VR) or augmented reality (AR) headset, the method comprising:

determining a direction of movement of a user's eye;

estimating a future gaze direction from the determined direction of movement; and

rendering an image on the display comprising higher resolution image data in a region comprising the estimated gaze direction and lower resolution image data outside of the region comprising the estimated gaze direction, wherein determining a direction of movement of the user's eye comprises:

illuminating the user's eye with a first pair of lasers, wherein the first pair of lasers comprises a first laser and a second laser,

wherein the first laser is configured to emit light in a first direction, and wherein the second laser is configured to emit light in a second direction, wherein the second direction is nonparallel to the first direction;

illuminating the user's eye with a second pair of lasers, wherein the second pair of lasers comprises a third laser and a fourth laser,

wherein the third laser is configured to emit light in a direction parallel to the first direction and wherein the fourth laser is configured to emit light in a direction parallel to the second direction;

receiving, at the first laser, light redirected from the user's eye, such that self- mixing interference occurs within a laser cavity between light generated by the first laser and the light redirected from the user's eye;

measuring the self-mixing interference; and

determining a direction of movement of the user's eye from the measured self-mixing interference.

2 . The method according to claim 1 , wherein illuminating the user's eye comprises illuminating only a sclera of the user's eye.

3 . The method according to claim 1 , wherein the method further comprises determining a speed of movement of the user's eye from the measured self-mixing interference.

4 . The method according to claim 1 , wherein determining the direction of movement of the user's eye from the self-mixing interference comprises determining the direction of movement of the user's eye from self-mixing interference caused by a Doppler shift of the redirected light due to movement of the user's eye.

5 . The method according to claim 4 , wherein determining the direction of movement of the user's eye from self-mixing interference caused by a Doppler shift of the redirected light due to movement of the user's eye comprises performing a Fourier transform on the measured self-mixing interference.

6 . The method according to claim 1 , wherein measuring the self-mixing interference comprises measuring a voltage or current of the first laser.

7 . A virtual reality (VR) or augmented reality (AR) headset comprising:

a frame for mounting to a user's head;

a device for determining eye movement integrated in or located on the frame, the device comprising:

a first laser configured to emit a beam of light for illuminating the user's eye when in use and to receive light redirected from the user's eye, such that self-mixing interference occurs within a laser cavity between light generated by the first laser and the light redirected from the user's eye;

a measurement apparatus configured to measure the self-mixing interference; and

a processing unit configured to determine a direction of movement of the user's eye from the measured self-mixing interference, wherein the processing unit is further configured to estimate a future gaze direction from the determined direction of movement of the user's eye; and

a display configured to render an image on the display comprising higher resolution image data in a display region in the determined future gaze direction and lower resolution image data outside of the display region in the determined future gaze direction;

a first pair of lasers each configured to emit a beam of light for illuminating the user's eye when in use,

wherein the first pair of lasers comprises the first laser and a second laser, and wherein the first laser is configured to emit light in a first direction, and wherein the second laser is configured to emit light in a second direction, wherein the second direction is nonparallel to the first direction; and

a second pair of lasers each configured to emit a beam of light for illuminating the user's eye when in use, wherein the second pair of lasers comprises a third laser and a fourth laser, wherein the third laser is configured to emit light in a direction parallel to the first direction and wherein the fourth laser is configured to emit light in a direction parallel to the second direction.

8 . The VR or AR headset according to claim 7 , wherein the first laser is configured to emit light towards only a sclera of the user's eye.

9 . The VR or AR headset according to claim 7 , wherein the processing unit is further configured to determine speed of movement of the user's eye from the measured self-mixing interference.

10 . The VR or AR headset according to claim 7 , wherein the processing unit is configured to determine the direction of movement of the user's eye from self-mixing interference caused by a Doppler shift of the redirected light due to movement of the user's eye.

11 . The VR or AR headset according to claim 7 , wherein the first laser comprises a vertical cavity surface emitting laser; and/or wherein the measurement apparatus comprises a sensor configured to measure a voltage input or current input of the first laser.

12 . The VR or AR headset according to claim 7 , wherein the measurement apparatus comprises a photodetector.

13 . The VR or AR headset according to claim 12 , wherein the processing unit is configured to determine a frequency modulation of light incident on the photodetector; and/or wherein the first laser comprises a vertical cavity surface emitting laser and wherein the photodetector is integrated with the vertical cavity surface emitting laser as single semiconductor device; and/or wherein the photodetector is spatially separated from the first laser and wherein the device further comprises an optical element configured to redirect at least a portion of the self-mixing interference towards the photodetector.

14 . The VR or AR headset according to claim 7 , wherein the first laser is configured to emit the beam of light such that an optical axis of the emitted beam of light forms an acute angle with respect to a surface of the user's eye.

15 . The VR or AR headset according to claim 7 , wherein the device is configured such that an offset of the emitted beam of light from the first laser relative to a first plane bisecting the center of the user's eye is equal to an offset of the emitted beam of light from the third laser relative to the first plane bisecting the center of the user's eye, and wherein the device is configured such that an offset of the emitted beam of light from the second laser relative to a second plane bisecting the center of the user's eye is equal to an offset of the emitted beam of light from the fourth laser relative to the second plane bisecting the center of the user's eye.

16 . The VR or AR headset according to claim 7 , wherein the third laser is configured to emit light in a third direction, wherein the third direction is different to the first direction, and wherein the fourth laser is configured to emit light in a fourth direction different to the second direction and non-parallel to the third direction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2024
From: NAJER, DANIEL; GEIGER, JENS; SUAREZ, FERRAN; NEVOU, LAURENT; MAUTHE, SVENJA
To: AMS INTERNATIONAL AG
Reel/Frame 066085/0813 →
Priority Claims (1)
GB 2107238 · May 20, 2021 · national
Continuity (1)
Related Publication 20240310906A1 · Sep 19, 2024
References Cited (40)
US 5717413A · Mizouchi · 1998 [cited by applicant]
US 11868522B2 · Fiess et al. · 2024 [cited by applicant]
US 20150206321A1 · Scavezze et al. · 2015 [cited by applicant]
US 20170261610A1 · Scally et al. · 2017 [cited by applicant]
US 20170316264A1 · Gustafsson et al. · 2017 [cited by applicant]
US 20180205943A1 · Trail · 2018 [cited by applicant]
US 20190041634A1 · Popovich et al. · 2019 [cited by applicant]
US 20190317454A1 · Holenarsipur et al. · 2019 [cited by applicant]
US 20190354173A1 · Young et al. · 2019 [cited by applicant]
US 20200143516A1 · Martin · 2020 [cited by examiner]
US 20210271320A1 · Fiess et al. · 2021 [cited by applicant]
US 20210373659A1 · Petersen · 2021 [cited by examiner]
CN 112639555A · 2021 [cited by applicant]
JP H7261728A · 1995 [cited by applicant]
KR 20160111942A · 2016 [cited by applicant]
KR 20210031597A · 2021 [cited by applicant]
WO 2020043472A1 · 2020 [cited by applicant]
WO 2021049740A1 · 2021 [cited by applicant]
Japanese Reasons for Rejection issued for the corresponding JP patent application No. JP 2023-571730, dated Jan. 28, 2025, 10 pages (For informational purposes only). [cited by applicant]
Iwamoto, K., et al., “Study on Acceptable Time Delay of Displayed Image for Eye Movement in the Eye Movement Tracking Type Image Display System”, The Japanese Journal of Ergonomics, Journal of the Japan Ergonomics Socie… [cited by applicant]
Japanese Notice of Reasons for Refusal for corresponding Japanese Patent Application No. 2023-571730, dated Dec. 3, 2024, 5 pages (for informational purposes only). [cited by applicant]
Search Report for corresponding British Patent Application No. 2107238.4, dated Nov. 16, 2021, 4 pages (for informational purposes only). [cited by applicant]
Iwamoto, Kazuyo et al.; “Study on acceptable time delay of displayed image for eye movement in the eye movement tracking type image display system”; The Japanese Journal of Ergonomics; vol. 40 Issue 1; retrieved from ht… [cited by applicant]
Capelli, Giorgio et al., “Laser velocimeter for the measurement of eye movements”, 2011 International Workshop on Biophotonics, Jun. 2011, 3 pages. [cited by applicant]
International Search Report issued for the corresponding PCT patent application No. PCT/EP2022/061864, dated Sep. 5, 2022, 4 pages (For informational purposes only). [cited by applicant]
Sarkar, N., et al., “A Resonant Eye-Tracking Microsystem for Velocity Estimation of Saccades and Foveated Rendering”, MEMS, 2017, pp. 304-307. [cited by applicant]
Meyer, J., et al., “A Novel Camera-Free Eye Tracking Sensor For Augmented Reality based on Laser Scanning”, IEEE Sensors Council, 2017, 9 pages. [cited by applicant]
Meyer, J., et al., “Low Power Scanned Laser Eye Tracking for Retinal Projection AR Glases”, ETRA, Jun. 2020, Germany, 3 pages. [cited by applicant]
Sangu, S., et al., “Ultracompact eye annd pupil tracking device using VCSEL arrays and position sensitive detector”, Proceedings of SPIE, USA, 2020, 12 pages. [cited by applicant]
Meyer Johannes et al., “A nove-Eye-Tracking Sensor for AR Glasses based on Laser Self-Mixing Showing Exceptional Robustness Against Illumination”, Germany, 2020, 5 pages. [cited by applicant]
Li, Tianxing et al., “Battery-Free Eye Tracker on Glasses”, MobiCom 2018, dated 2018, 7 pages. [cited by applicant]
Dietrich, Marc Philipp et al., “Towards EEG-Based Eye-Tracking for Interaction Design in Head-Mounted Devices”; retrieved from https://www.google.com/url?sa=t&source=web&rct=j&opi=89978449&url=https://downloads.hci.info… [cited by applicant]
Halfacree, Gareth; “Nvidia shows off next-generation AR glasses prototypes”; retrieved from https://www.bit-tech/net/news/tech/peripherals/nvidia-shows-off-next-generation-ar-glasses-prototypes/1/ on May 16, 2025; dated… [cited by applicant]
Sarkar, N. et al., “A large angle, low voltage, small footprint micromirror for eye tracking and near-eye display applications”, IEEE 18th International Conference on Solid-State Sensors, Actuators and Microsystems, 201… [cited by applicant]
Arar, Nuro Murat; “Robust Eye Tracking Based on Adaptive Fusion of Multiple Cameras”, Éole Polytechnique Fédérale De Lausanne; retrieved from https://www.google.com/url?sa=t&source=web&rct=j&opi=89978449&url=https://inf… [cited by applicant]
Sarkar, Neil; “Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras for Mobile AR Headsets”; retrieved from https://www.youtube.com/watch?v=JEg4I5KuQgl on May 16, 2025; dated 2019; 2 pages. [cited by applicant]
“How do Tobii eye trackers work?”; retrieved from https://www.tobiipro.com/learn-and-support/learn/eye-tracking-essentials/how-do-tobii-eye-trackers-work/ on May 16, 2025; dated 2024; 2 pages. [cited by applicant]
Korean office action issued for the corresponding Korean patent application No. 202280036398.7, dated Jul. 7, 2025, 13 pages (for informational purposes only). [cited by applicant]
Woongbi Cho et al., Highly Sensitive and Cost-Effective Polymeric-Sulfur-Based Mid-Wavelength Infrared Linear Polarizers with Tailored Fabry-Pérot Resonance, Advanced Materials, 2022, 2209377, 13 pages. [cited by applicant]
Johannes Meyer et al., A Novel Gaze Gesture Sensor for Smart Glasses Based on Laser Self-Mixing, 2021 CHI Conference, 6 pages. [cited by applicant]