IP Library › Granted Patent US 12,213,734
Granted Patent B2
US 12,213,734 · App. 18/336,747 · Granted Feb 4, 2025

Eye tracking fixation monitoring systems and methods

Inventors: Sascha Birkner (Berlin, DE); Martin Gründig (Rangsdorf, DE)
Assignee: Alcon Inc.
A61B3/113A61B3/0025A61B3/102A61B3/1225A61B3/14A61B3/18G06T7/0016G06T7/248G06T7/74G06V40/19G06T2207/10101G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,213,734
App. No.
18/336,747
Granted
Feb 4, 2025
Kind
B2
Abstract

Systems and methods for tracking eye movement during a diagnostic procedure include an eye tracker capturing images of an eye, and a control processor configured to detect an eye position and orientation in each of the images, determine an eye fixation position and orientation relative to an optical axis of the eye tracker, estimate eye fixation parameters based at least in part on the determined eye fixation position and orientation, and track the eye position and orientation by analyzing the images to determine the eye position and orientation relative to the eye fixation parameters. The eye fixation parameters may comprise a reference position and orientation of the eye when fixated. A histogram is constructed of detected eye positions and orientations and analyzed to determine an eye fixation position and orientation.

Claims (46)

1. A system comprising:

an eye tracker configured to capture a first plurality of images of a current eye; and

a control processor configured to:

detect an eye position and orientation in each of the first plurality of images;

determine an eye fixation position and orientation relative to an optical axis of the eye tracker by inputting the eye position and orientation of the eye in the first plurality of images into a neural network trained using a set of historical data to determine when a historical eye was fixating and to output a determination of the current eye fixation position and orientation relative to the optical axis, wherein the neural network is trained by constructing and analyzing one or more histograms of detected historical eye positions and orientations;

estimate eye fixation parameters based at least in part on the determined eye fixation position and orientation; and

track the eye position and orientation by analyzing one or more images from the first plurality of images to determine the eye position and orientation relative to the eye fixation parameters.

2. The system of claim 1 , wherein the eye fixation parameters comprise a reference position and orientation of the eye when fixated.

3. The system of claim 1 , wherein analyzing the histogram further comprises determining a relative maximum value and determining whether coordinates of the relative maximum value comprise a fixation position and orientation.

4. The system of claim 3 , wherein determining whether coordinates of the relative maximum value comprise a fixation position and orientation further comprise comparing the relative maximum value with a threshold and/or an average coordinate value of the histogram.

5. The system of claim 1 , further comprising:

a retina imaging system comprising an optical coherence tomography (OCT) scanner and/or a fundus camera configured to perform a retinal scan.

6. The system of claim 5 , wherein the retina imaging system is configured to capture a second plurality of images of an eye;

detect whether a fovea is present in one or more of the second plurality of images;

identify a first image from the second plurality of images having the detected fovea;

determine a second image from the first plurality of images having a temporal proximity to the first image; and

analyze the second image to determine eye fixation parameters.

7. The system of claim 1 , wherein the control processor is configured to track the eye position and orientation and calculate an offset from the eye fixation parameters and determine if the offset is less than a threshold value;

wherein when the offset is less than the threshold value the eye is determined to be fixated and the control processor generates an indication of fixation; and

wherein when the offset is greater than the threshold value the eye is determined to be out of alignment and the control processor generates an indication of no fixation.

8. The system of claim 1 , wherein the control processor is further configured to perform an eye diagnostic procedure, and track eye position using the eye tracker during the eye diagnostic procedure.

9. The system of claim 1 , further comprising a diagnostic device configured to perform an eye diagnostic procedure while tracking the position and orientation of the eye using an image capture device;

wherein the diagnostic device is further configured to receive data representative of fixation and eye position during the eye diagnostic procedure based, at least in part, on the data representative of fixation and eye position.

10. A method comprising:

capturing a first plurality of images of an eye;

detecting an eye position and orientation in each of the first plurality of images;

determining an eye fixation position and orientation relative to an optical axis of the eye tracker by inputting the eye position and orientation of the eye in the first plurality of images into a neural network trained using a set of historical data to determine when a historical eye was fixating and to output a determination of the current eye fixation position and orientation relative to the optical axis, wherein the neural network is trained by constructing and analyzing one or more histograms of detected historical eye positions and orientations;

estimating eye fixation parameters based at least in part on the determined eye fixation position and orientation; and

tracking the eye position and orientation by analyzing one or more images from the first plurality of images to determine the eye position and orientation relative to the eye fixation parameters.

11. The method of claim 10 , further comprising training a neural network to receive the first plurality of images and output a determination of an eye position.

12. The method of claim 10 , wherein the eye fixation parameters comprise a reference position and orientation of the eye when fixated.

13. The method of claim 10 , wherein analyzing the histogram further comprises determining a relative maximum value.

14. The method of claim 10 , further comprising:

performing a retina imaging scan of the eye using an optical coherence tomography (OCT) scanner.

15. The method of claim 14 , further comprising:

capturing a second plurality of images of an eye from the retina imaging scan;

detecting whether a fovea is present in one or more of the second plurality of images;

identifying a first image from the second plurality of images having the detected fovea;

determining a second image from the first plurality of images having a temporal proximity to the first image; and

analyzing the second image to determine eye fixation parameters.

16. The method of claim 10 , further comprising tracking the eye position and orientation and calculating an offset from the eye fixation parameters and determine if the offset is less than a threshold value;

wherein when the offset is less than the threshold value the eye is determined to be fixated and the control processor generates an indication of fixation; and

wherein when the offset is greater than the threshold value the eye is determined to be out of alignment and the control processor generates an indication of no fixation.

17. The method of claim 10 , further comprising performing an eye diagnostic procedure, and tracking eye position using an eye tracker during the eye diagnostic procedure.

18. The method of claim 10 , further comprising performing an eye diagnostic procedure while tracking the position and orientation of the eye using an image capture device; and

modifying the eye diagnostic procedure based, at least in part, on data representative of eye fixation parameters and a tracked eye position.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2023
From: BIRKNER, SASCHA; GRUENDIG, MARTIN
To: WAVELIGHT GMBH
Reel/Frame 064783/0314 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2023
From: WAVELIGHT GMBH
To: ALCON INC.
Reel/Frame 064783/0337 →
Continuity (3)
Continuation 16991937 · Aug 12, 2020
Provisional Application 62886517 · Aug 14, 2019
Related Publication 20230329548A1 · Oct 19, 2023
References Cited (8)
US 11717156B2 · Birkner · 2023 [cited by examiner]
US 20030227611A1 · Fein · 2003 [cited by examiner]
US 20050024586A1 · Teiwes · 2005 [cited by examiner]
US 20160249806A1 · Yates · 2016 [cited by examiner]
US 20170280995A1 · Yates · 2017 [cited by examiner]
US 20180084989A1 · Su · 2018 [cited by examiner]
JP H03215243A · 1991 [cited by applicant]
Dean Pomerleau et al., Non-Intrusive Gaze Tracking Using Artifical Neural Networks, AAAI Technical Report, FS-93-04, U.S.A., AAAI, pp. 153-156, 1993. [cited by applicant]