IP Library › Granted Patent US 12,387,343
Granted Patent B2
US 12,387,343 · App. 17/496,516 · Granted Aug 12, 2025

Eye position tracking sensor and method

Inventors: Gavril Nikolaevich Vostrikov (Moscow, RU); Nikolay Viktorovich Muravyev (Moscow Region, RU); Vladimir Nikolaevich Borisov (St. Petersburg, RU); Aleksandr Evgenyevich Angervaks (St. Petersburg, RU); Roman Aleksandrovich Okun (St. Petersburg, RU); Mikhail Vyacheslavovich Popov (Moscow Region, RU)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/20G06V10/60G06V40/19G06V40/193G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,343
App. No.
17/496,516
Granted
Aug 12, 2025
Kind
B2
Abstract

A method of eye tracking includes: irradiating a light pattern, output from at least one collimated light source, to a cornea surface; detecting at least a part of the light pattern reflected from the cornea surface, the at least the part of the light pattern being guided by a sensor waveguide; obtaining a mapping image corresponding to the at least the part of the light pattern; and determining a direction of a gaze based on the obtained mapping image. The sensor waveguide used to determine the direction of the gaze is different from a waveguide for displaying output information.

Claims (45)

1. A method of eye tracking with an eye sensor including a sensor waveguide, at least one collimated light source, and a detector, wherein a first light path is directly between the at least one collimated light source and a cornea surface, a second light path is directly between the cornea surface and the sensor waveguide, and a third light path is directly between the sensor waveguide and the detector,

the method comprising:

irradiating a light pattern, output from at least one collimated light source, directly to the cornea surface via the first light path;

detecting at least a part of the light pattern reflected from the cornea surface, wherein the at least the part of the light pattern is guided by the sensor waveguide, and wherein the at least the part of the light pattern guided by the sensor waveguide is in-coupled from the cornea surface into the sensor waveguide via the second light path and out-coupled from the sensor waveguide to the detector via the third light path through a same diffractive optical element (DOE) included in the sensor waveguide;

obtaining a mapping image corresponding to the at least the part of the light pattern, wherein the mapping image is in a form of at least one spot; and

determining a direction of a gaze based on the obtained mapping image,

wherein the sensor waveguide used to determine the direction of the gaze is different from a waveguide for displaying output information.

2. The method of claim 1 , wherein the light pattern is generated by the at least one collimated light source configured to operate in a near infrared (NIR) band.

3. The method of claim 1 , wherein the light pattern is irradiated to the cornea surface as a plurality of parallel lines via the first light path.

4. The method of claim 1 , wherein the light pattern is irradiated by at least one laser diode.

5. The method of claim 1 , wherein the sensor waveguide comprises an in-coupling DOE and an out-coupling DOE,

wherein the at least the part of the light pattern guided by the sensor waveguide is in-coupled into the sensor waveguide through the in-coupling DOE and out-coupled from the sensor waveguide through the out-coupling DOE,

wherein the at least the part of the light pattern reflected from the cornea surface comprises a first light and a second light, and

wherein in-coupling the at least the part of the light pattern reflected from the cornea surface into the sensor waveguide comprises multiplying a direction of the first light and of the second light.

6. The method of claim 1 , wherein the at least the part of the light pattern reflected from the cornea surface comprises a first light and a second light,

wherein in-coupling the at least the part of the light pattern reflected from the cornea surface into the sensor waveguide comprises multiplying a direction of the first light and of the second light.

7. The method of claim 1 , wherein the irradiated light pattern is output from more than one collimated light source, and the more than one collimated light source irradiate the light pattern intermittently.

8. The method of claim 1 , wherein the light pattern is irradiated to a constant position on the cornea surface without scanning.

9. The method of claim 1 , wherein the sensor waveguide is arranged along a first axis, and wherein the at least one collimated light source is opposite to the detector along the first axis.

10. An eye tracking sensor comprising:

at least one collimated light source configured to irradiate a light pattern directly on a cornea surface via a first light path directly between the at least one collimated light source and the cornea surface;

a sensor waveguide configured to guide at least a part of the light pattern reflected from the cornea surface, wherein the sensor waveguide comprises a diffractive optical element (DOE) configured to:

in-couple the light pattern reflected from the cornea surface into the sensor waveguide via a second light path directly between the cornea surface and the sensor waveguide, and

out-couple the light pattern guided by the sensor waveguide to a detector via a third light path directly between the sensor waveguide and the detector;

the detector which is configured to detect at least the part of the light pattern guided to the detector by the sensor waveguide and to obtain a mapping image corresponding to the at least the part of the light pattern, wherein the mapping image is in a form of at least one spot; and

a controller configured to determine a direction of a gaze based on the obtained mapping image.

11. The eye tracking sensor of claim 10 , wherein the at least one collimated light source is configured to emit light in a near infrared (NIR) band.

12. The eye tracking sensor of claim 10 , wherein the light pattern is irradiated to the cornea surface as a plurality of parallel lines via the first light path.

13. The eye tracking sensor of claim 10 , wherein the at least one collimated light source comprises a laser diode.

14. The eye tracking sensor of claim 10 , wherein the sensor waveguide further comprises an in-coupling DOE configured to in-couple the light pattern reflected from the cornea surface into the sensor waveguide, and an out-coupling DOE configured to out-couple the light pattern guided by the sensor waveguide to the detector,

wherein the at least a portion of the light pattern reflected from the cornea surface comprises a first light and a second light, and

wherein the in-coupling DOE is further configured to multiply a direction of the first light and of the second light.

15. The eye tracking sensor of claim 10 , wherein the at least a portion of the light pattern reflected from the cornea surface comprises a first light and a second light, and wherein the in-coupling DOE is further configured to multiply a direction of the first light and of the second light.

16. The eye tracking sensor of claim 10 , further comprising more than one collimated light source configured to irradiate a light pattern on a cornea surface intermittently.

17. The eye tracking sensor of claim 10 , wherein the light pattern is irradiated to a constant position on the cornea surface without scanning.

18. The eye tracking sensor of claim 10 , wherein the sensor waveguide is arranged along a first axis, and wherein the at least one collimated light source is opposite to the detector along the first axis.

19. An augmented reality device comprising:

an eye tracking sensor comprising:

at least one collimated light source configured to irradiate a light pattern directly on a cornea surface via a first light path directly between the at least one collimated light source and the cornea surface;

a sensor waveguide configured to guide at least a part of the light pattern reflected from the cornea surface, wherein the sensor waveguide comprises a diffractive optical element (DOE) configured to:

in-couple the light pattern reflected from the cornea surface into the sensor waveguide via a second light path directly between the cornea surface and the sensor waveguide, and

out-couple the light pattern guided by the sensor waveguide to a detector via the third light path directly between the sensor waveguide and the detector;

the detector which is configured to detect at least the part of the light pattern guided to the detector by the sensor waveguide and to obtain a mapping image corresponding to the at least the part of the light pattern, wherein the mapping image is in a form of at least one spot; and

a controller configured to determine a direction of a gaze based on the obtained mapping image, and

a display waveguide for displaying output information, the display waveguide being different from the sensor waveguide.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2022
From: VOSTRIKOV, GAVRIL NIKOLAEVICH; MURAVYEV, NIKOLAY VIKTOROVICH; BORISOV, VLADIMIR NIKOLAEVICH; ANGERVAKS, ALEKSANDR EVGENYEVICH; OKUN, ROMAN ALEKSANDROVICH; POPOV, MIKHAIL VYACHESLAVOVICH
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 059303/0016 →
Priority Claims (2)
RU 2020133060 · Oct 7, 2020 · national
KR 10-2021-0132734 · Oct 6, 2021 · national
Continuity (1)
Related Publication 20220108458A1 · Apr 7, 2022
References Cited (32)
US 7809160B2 · Vertegaal et al. · 2010 [cited by applicant]
US 8955973B2 · Raffle et al. · 2015 [cited by applicant]
US 9456744B2 · Popovich et al. · 2016 [cited by applicant]
US 9804389B2 · Popovich et al. · 2017 [cited by applicant]
US 10168531B1 · Trail et al. · 2019 [cited by applicant]
US 10209517B2 · Popovich et al. · 2019 [cited by applicant]
US 10213105B2 · Sarkar · 2019 [cited by applicant]
US 10437051B2 · Popovich et al. · 2019 [cited by applicant]
US 10983340B2 · Popovich et al. · 2021 [cited by applicant]
US 20130176533A1 · Raffle · 2013 [cited by examiner]
US 20160166146A1 · Sarkar · 2016 [cited by applicant]
US 20180232048A1 · Popovich et al. · 2018 [cited by applicant]
US 20180275409A1 · Gao · 2018 [cited by examiner]
US 20190041634A1 · Popovich · 2019 [cited by examiner]
US 20190179153A1 · Popovich et al. · 2019 [cited by applicant]
US 20200041787A1 · Popovich et al. · 2020 [cited by applicant]
US 20200089319A1 · Popovich et al. · 2020 [cited by applicant]
CN 105934902A · 2016 [cited by applicant]
CN 109073889A · 2018 [cited by applicant]
CN 109116566A · 2019 [cited by applicant]
EP 3318914A1 · 2018 [cited by applicant]
RU 2700373C1 · 2019 [cited by applicant]
WO 2013167864A1 · 2013 [cited by applicant]
WO 2014188149A1 · 2014 [cited by applicant]
WO 2015081313A2 · 2015 [cited by applicant]
WO 2015081313A9 · 2015 [cited by applicant]
WO 2015099924A1 · 2015 [cited by applicant]
WO 2016046514A1 · 2016 [cited by applicant]
WO 2017134412A1 · 2017 [cited by applicant]
WO 2018224847A1 · 2018 [cited by applicant]
Communication issued Mar. 18, 2021 by the Russian Federation in counterpart Russian Patent Aplication No. 2020133060. [cited by applicant]
Communication issued Mar. 22, 2021 by the Russian Federation in counterpart Russian Patent Aplication No. 2020133060. [cited by applicant]