IP Library › Granted Patent US 12,217,421
Granted Patent B2
US 12,217,421 · App. 18/397,535 · Granted Feb 4, 2025

Point of gaze tracking with integrated calibration process

Inventor: Eran Harpaz (Tel Aviv, IL)
Assignee: Neuralight Ltd.
G06T7/0012G06V10/82G06V40/18G06T2207/30041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,217,421
App. No.
18/397,535
Granted
Feb 4, 2025
Kind
B2
Abstract

Disclosed herein are system, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for tracking a point of gaze of a subject in a manner that incorporates automatic eye tracking calibration. In an embodiment, video is obtained of the subject viewing content presented by a display. The video is analyzed to determine a series of time points at which a gaze of the subject is dwelling on a visual target and, for each time point in the series, a set of eye feature values. A location of a stimulus presented by the display is also obtained for each time point in the series. This information is utilized to determine a mapping that maps a set of eye feature values to a point of gaze. The mapping is used to map a set of eye features obtained by analyzing the video to the point of gaze of the subject.

Claims (104)

1. A computer-implemented method for tracking a point of gaze of a subject, comprising:

obtaining, by at least one computer processor, video of at least a portion of a face of the subject while the subject is viewing content of a test sequence presented within a display area of a display, wherein an integrated calibration process is performed during the test sequence, the integrated calibration process comprising:

determining, by analyzing the video a series of time points at which a gaze of the subject is dwelling on a visual target and, for at least each time point in the series of time points, a corresponding set of eye features;

after determining the series of time points, obtaining, for each of the time points in the series of time points, a location of a visual stimulus presented within the display area of the display; and

determining a mapping that maps a set of eye features to a point of gaze, wherein the determining is performed based at least on (i) the set of eye features for each of the time points in the series of time points and (ii) the location of the visual stimulus within the display area of the display for each of the time points in the series of time points; and

using the mapping to respectively map one or more sets of eye features to one or more points of gaze of the subject.

2. The computer-implemented method of claim 1 , wherein:

the one or more sets of eye features obtained by analyzing the video comprises one or more sets of right eye features and the one or more points of gaze of the subject comprises one or more points of gaze of a right eye of the subject; or

the one or more sets of eye features obtained by analyzing the video comprises one or more sets of left eye features and the one or more points of gaze of the subject comprises one or more points of gaze of a left eye of the subject.

3. The computer-implemented method of claim 1 , further comprising:

detecting a neurological or mental health condition of the subject based at least on the one or more points of gaze of the subject.

4. The computer-implemented method of claim 1 , wherein obtaining the video of the at least a portion of the face of the subject while the subject is viewing the content of the test sequence presented within the display area of the display comprises:

obtaining the video of the at least a portion of the face of the subject while the subject is performing a directed oculometric task in response to the visual stimulus presented within the display area of the display.

5. The computer-implemented method of claim 4 , wherein the directed oculometric task comprises one of:

a saccade test;

a smooth pursuit test; or

a long fixation test.

6. The computer-implemented method of claim 1 , wherein each set of eye features comprises one or more of:

a pupil location relative to an eye opening;

eye corner locations of an eye; or

a length and an orientation of minor and major elliptical axes of an iris of an eye.

7. The computer-implemented method of claim 1 , wherein determining the mapping comprises:

performing a regression analysis to determine the mapping.

8. The computer-implemented method of claim 7 , wherein performing the regression analysis to determine the mapping comprises one of:

performing a linear regression analysis;

performing a polynomial regression analysis; or

performing a decision tree regression analysis.

9. The computer-implemented method of claim 1 , wherein analyzing the video to determine, for each of the time points in the series of time points, the set of eye features comprises:

extracting an eye image from a frame of the video corresponding to the time point in the series of time points; and

providing the eye image to a neural network that, based at least on the eye image, outputs an estimated point of gaze for the time point in the series of time points.

10. The computer-implemented method of claim 1 , wherein the integrated calibration process further comprising:

analyzing the video to determine one or more additional time points at which the gaze of the subject is dwelling on a visual target and, for each of the one or more additional time points, a set of corresponding eye features;

obtaining, for each of the one or more additional time points, a location of the visual stimulus within the display area of the display; and

recalculating the mapping based at least on (i) the set of eye features for each of the one or more additional time points and (ii) the location of the visual stimulus within the display area of the display for each of the one or more additional time points.

11. A system for measuring tracking a point of gaze of a subject, comprising:

one or more memories; and

at least one processor each coupled to at least one of the memories and configured to perform operations comprising:

obtaining video of at least a portion of a face of the subject while the subject is viewing content of a test sequence presented within a display area of a display, wherein an integrated calibration process is performed during the test sequence, the integrated calibration process comprising:

determining, by analyzing the video a series of time points at which a gaze of the subject is dwelling on a visual target and, for at least each time point in the series of time points, a corresponding set of eye features;

after determining the series of time points, obtaining, for each of the time points in the series of time points, a location of a visual stimulus presented within the display area of the display; and

determining a mapping that maps a set of eye features to a point of gaze, wherein the determining is performed based at least on (i) the set of eye features for each of the time points in the series of time points and (ii) the location of the visual stimulus within the display area of the display for each of the time points in the series of time points; and

using the mapping to respectively map one or more sets of eye features to one or more points of gaze of the subject.

12. The system of claim 11 , wherein:

the one or more sets of eye features obtained by analyzing the video comprises one or more sets of right eye features and the one or more points of gaze of the subject comprises one or more points of gaze of a right eye of the subject; or

the one or more sets of eye features obtained by analyzing the video comprises one or more sets of left eye features and the one or more points of gaze of the subject comprises one or more points of gaze of a left eye of the subject.

13. The system of claim 11 , wherein the operations further comprise:

detecting a neurological or mental health condition of the subject based at least on the one or more points of gaze of the subject.

14. The system of claim 11 , wherein obtaining the video of the at least a portion of the face of the subject while the subject is viewing the content of the test sequence presented within the display area of the display comprises:

obtaining the video of the at least a portion of the face of the subject while the subject is performing a directed oculometric task in response to the visual stimulus presented within the display area of the display.

15. The system of claim 14 , wherein the directed oculometric task comprises one of:

a saccade test;

a smooth pursuit test; or

a long fixation test.

16. The system of claim 11 , wherein each set of eye features comprises one or more of:

a pupil location relative to an eye opening;

eye corner locations of an eye; or

a length and an orientation of minor and major elliptical axes of an iris of an eye.

17. The system of claim 11 , wherein determining the mapping comprises:

performing a regression analysis to determine the mapping.

18. The system of claim 17 , wherein performing the regression analysis to determine the mapping comprises one of:

performing a linear regression analysis;

performing a polynomial regression analysis; or

performing a decision tree regression analysis.

19. The system of claim 11 , wherein analyzing the video to determine, for each of the time points in the series of time points, the set of eye features comprises:

extracting an eye image from a frame of the video corresponding to the time point in the series of time points; and

providing the eye image to a neural network that, based at least on the eye image, outputs an estimated point of gaze for the time point in the series of time points.

20. The system of claim 11 , wherein the integrated calibration process further comprises:

analyzing the video to determine one or more additional time points at which the gaze of the subject is dwelling on a visual target and, for each of the one or more additional time points, a set of corresponding eye features;

obtaining, for each of the one or more additional time points, a location of the visual stimulus within the display area of the display; and

recalculating the mapping based at least on (i) the set of eye features for each of the one or more additional time points and (ii) the location of the visual stimulus within the display area of the display for each of the one or more additional time points.

21. A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computer processor, cause the at least one computer processor to perform operations for tracking a point of gaze of a subject, the operations comprising:

obtaining video of at least a portion of a face of the subject while the subject is viewing content of a test sequence presented within a display area of a display, wherein an integrated calibration process is performed during the test sequence, the integrated calibration process comprising:

determining, by analyzing the video a series of time points at which a gaze of the subject is dwelling on a visual target and, for at least each time point in the series of time points, a corresponding set of eye features;

after determining the series of time points, obtaining, for each of the time points in the series of time points, a location of a visual stimulus presented within the display area of the display; and

determining a mapping that maps a set of eye features to a point of gaze, wherein the determining is performed based at least on (i) the set of eye features for each of the time points in the series of time points and (ii) the location of the visual stimulus within the display area of the display for each of the time points in the series of time points; and

using the mapping to respectively map one or more sets of eye features to one or more points of gaze of the subject.

22. The non-transitory computer-readable medium of claim 21 , wherein:

the one or more sets of eye features obtained by analyzing the video comprises one or more sets of right eye features and the one or more points of gaze of the subject comprises one or more points of gaze of a right eye of the subject; or

the one or more sets of eye features obtained by analyzing the video comprises one or more sets of left eye features and the one or more points of gaze of the subject comprises one or more points of gaze of a left eye of the subject.

23. The non-transitory computer-readable medium of claim 21 , wherein the operations further comprise:

detecting a neurological or mental health condition of the subject based at least on the one or more points of gaze of the subject.

24. The non-transitory computer-readable medium of claim 21 , wherein obtaining the video of the at least a portion of the face of the subject while the subject is viewing the content of the test sequence presented within the display area of the display comprises:

obtaining the video of the at least a portion of the face of the subject while the subject is performing a directed oculometric task in response to the visual stimulus presented within the display area of the display.

25. The non-transitory computer-readable medium of claim 24 , wherein the directed oculometric task comprises one of:

a saccade test;

a smooth pursuit test; or

a long fixation test.

26. The non-transitory computer-readable medium of claim 21 , wherein each set of eye features comprises one or more of:

a pupil location relative to an eye opening;

eye corner locations of an eye; or

a length and an orientation of minor and major elliptical axes of an iris of an eye.

27. The non-transitory computer-readable medium of claim 21 , wherein determining the mapping comprises:

performing a regression analysis to determine the mapping.

28. The non-transitory computer-readable medium of claim 27 , wherein performing the regression analysis to determine the mapping comprises one of:

performing a linear regression analysis;

performing a polynomial regression analysis; or

performing a decision tree regression analysis.

29. The non-transitory computer-readable medium of claim 21 , wherein analyzing the video to determine, for each of the time points in the series of time points, the set of eye features comprises:

extracting an eye image from a frame of the video corresponding to the time point in the series of time points; and

providing the eye image to a neural network that, based at least on the eye image, outputs an estimated point of gaze for the time point in the series of time points.

30. The non-transitory computer-readable medium of claim 21 , wherein the integrated calibration process comprises:

analyzing the video to determine one or more additional time points at which the gaze of the subject is dwelling on a visual target and, for each of the one or more additional time points, a set of corresponding eye features;

obtaining, for each of the one or more additional time points, a location of the visual stimulus within the display area of the display; and

recalculating the mapping based at least on (i) the set of eye features for each of the one or more additional time points and (ii) the location of the visual stimulus within the display area of the display for each of the one or more additional time points.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 29, 2023
From: HARPAZ, ERAN
To: NEURALIGHT LTD.
Reel/Frame 065981/0508 →
Continuity (2)
Provisional Application 63437136 · Jan 5, 2023
Related Publication 20240233119A1 · Jul 11, 2024
References Cited (150)
US 6820979B1 · Stark et al. · 2004 [cited by applicant]
US 7428320B2 · Northcott et al. · 2008 [cited by applicant]
US 7753525B2 · Hara et al. · 2010 [cited by applicant]
US 7869627B2 · Northcott et al. · 2011 [cited by applicant]
US 8061840B2 · Mizuochi · 2011 [cited by applicant]
US 8132916B2 · Johansson · 2012 [cited by applicant]
US 8401248B1 · Moon · 2013 [cited by examiner]
US 9552061B2 · Zhang · 2017 [cited by examiner]
US 9730582B1 · Stone · 2017 [cited by examiner]
US 9965860B2 · Nguyen et al. · 2018 [cited by applicant]
US 10016130B2 · Ganesan et al. · 2018 [cited by applicant]
US 10109056B2 · Nguyen et al. · 2018 [cited by applicant]
US 10231614B2 · Krueger · 2019 [cited by applicant]
US 10575728B2 · Zakariaie et al. · 2020 [cited by applicant]
US 10713813B2 · De Villers-Sidani et al. · 2020 [cited by applicant]
US 10713814B2 · De Villers-Sidani et al. · 2020 [cited by applicant]
US 10867252B2 · Lindén · 2020 [cited by examiner]
US 11074714B2 · De Villers-Sidani et al. · 2021 [cited by applicant]
US 11100323B2 · Wilhelm et al. · 2021 [cited by applicant]
US 11382545B2 · Zakariaie et al. · 2022 [cited by applicant]
US 11503998B1 · De Villers-Sidani et al. · 2022 [cited by applicant]
US 11513593B2 · Drozdov et al. · 2022 [cited by applicant]
US 11514720B2 · Haimovitch-Yogev et al. · 2022 [cited by applicant]
US 11776315B2 · Haimovitch-Yogev et al. · 2023 [cited by applicant]
US 12033432B2 · Ben-Ami · 2024 [cited by examiner]
US 20050228236A1 · Diederich et al. · 2005 [cited by applicant]
US 20060110008A1 · Vertegaal · 2006 [cited by examiner]
US 20070009169A1 · Bhattacharjya · 2007 [cited by applicant]
US 20090018419A1 · Torch · 2009 [cited by applicant]
US 20140320397A1 · Hennessey et al. · 2014 [cited by applicant]
US 20140364761A1 · Benson et al. · 2014 [cited by applicant]
US 20150077543A1 · Kerr et al. · 2015 [cited by applicant]
US 20150293588A1 · Strupczewski et al. · 2015 [cited by applicant]
US 20160150955A1 · Kiderman et al. · 2016 [cited by applicant]
US 20170135577A1 · Komogortsev · 2017 [cited by applicant]
US 20170151089A1 · Chernyak · 2017 [cited by applicant]
US 20170231490A1 · Toth et al. · 2017 [cited by applicant]
US 20170249434A1 · Brunner · 2017 [cited by applicant]
US 20170365101A1 · Samec · 2017 [cited by examiner]
US 20170367633A1 · Samadani · 2017 [cited by examiner]
US 20180018515A1 · Spizhevoy et al. · 2018 [cited by applicant]
US 20180249941A1 · Liston · 2018 [cited by examiner]
US 20200097076A1 · Alcaide et al. · 2020 [cited by applicant]
US 20200268296A1 · Alcaide et al. · 2020 [cited by applicant]
US 20200305708A1 · Krueger · 2020 [cited by applicant]
US 20200323480A1 · Shaked et al. · 2020 [cited by applicant]
US 20200364539A1 · Anisimov et al. · 2020 [cited by applicant]
US 20200405148A1 · Tran · 2020 [cited by applicant]
US 20210174959A1 · Abel Fernandez · 2021 [cited by applicant]
US 20210186318A1 · Yellin et al. · 2021 [cited by applicant]
US 20210186395A1 · Zakariaie et al. · 2021 [cited by applicant]
US 20210186397A1 · Weisberg et al. · 2021 [cited by applicant]
US 20210327595A1 · Abdallah · 2021 [cited by applicant]
US 20220019791A1 · Drozdov et al. · 2022 [cited by applicant]
US 20220206571A1 · Drozdov et al. · 2022 [cited by applicant]
US 20220211310A1 · Zakariaie et al. · 2022 [cited by applicant]
US 20220236797A1 · Drozdov et al. · 2022 [cited by applicant]
US 20220301294A1 · Boutinon · 2022 [cited by applicant]
US 20220313083A1 · Zakariaie et al. · 2022 [cited by applicant]
US 20220351545A1 · Ben-Ami et al. · 2022 [cited by applicant]
US 20220354363A1 · Ben-Ami et al. · 2022 [cited by applicant]
US 20220369923A1 · De Villers-Sidani et al. · 2022 [cited by applicant]
US 20220390771A1 · David et al. · 2022 [cited by applicant]
US 20220391012A1 · Vertegaal · 2022 [cited by examiner]
US 20230074569A1 · Drozdov et al. · 2023 [cited by applicant]
US 20230210442A1 · Krueger · 2023 [cited by examiner]
US 20230233072A1 · Haimovitch-Yogev et al. · 2023 [cited by applicant]
US 20230334326A1 · Haimovitch-Yogev et al. · 2023 [cited by applicant]
CA 2618352A1 · 2007 [cited by applicant]
CN 106265006A · 2017 [cited by applicant]
EP 1947604A1 · 2008 [cited by applicant]
WO WO2020235939A2 · 2020 [cited by applicant]
WO WO2021097300A1 · 2021 [cited by applicant]
Akinyelu, A.A. and Blignaut, P., “Convolutional Neural Network-Based Technique for Gaze Estimation on Mobile Devices,” Frontiers in Artificial Intelligence 4:796825 11 pages, Frontiers Media SA, Switzerland (Jan. 2022). [cited by applicant]
Ali, E., et al., “Pupillary Response to Sparse Multifocal Stimuli in Multiple Sclerosis Patients,” Multiple Sclerosis Journal 20(7): 1-8, (Nov. 2013). [cited by applicant]
Aljaafreh, A., et al., “A Low-cost Webcam-based Eye Tracker and Saccade Measurement System,” International Journal of Circuits, Systems and Signal Processing 14:102-107, (Apr. 2020). [cited by applicant]
Alnajar, F., et al., “Auto-Calibrated Gaze Estimation Using Human Gaze Patterns,” International Journal of Computer Vision 124:223-236, (2017). [cited by applicant]
Bafna, T., et al., “EyeTell: Tablet-based Calibration-free Eye-typing Using Smooth-pursuit Movements,” Proceedings of the ETRA '21 Short Papers, (2021). [cited by applicant]
Bedell, H., et al., “Eye Movement Testing in Clinical Examination,” Vision Research 90:32-37, Elsevier Science Limited, United Kingdom (Sep. 2013). [cited by applicant]
Bijvank, J.A.N., et al., “Quantification of Visual Fixation in Multiple Sclerosis,” Investigative Ophthalmology & Visual Science 60(5):1372-1383, Association for Research in Vision and Ophthalmology (Arvo), United State… [cited by applicant]
Borza, D., et al., “Real-Time Detection and Measurement of Eye Features from Color Images,” Sensors 16(7):1105 1-24, MDPI, Switzerland (Jul. 2016). [cited by applicant]
Chen, S. and Epps, J., “Eyelid and Pupil Landmark Detection and Blink Estimation Based on Deformable Shape Models for Near-Field Infrared Video,” Frontiers in ICT 6:18 1-11, (Oct. 2019). [cited by applicant]
Cherng, Y., et al., “Background Luminance Effects on Pupil Size Associated With Emotion and Saccade Preparation,” Scientific Reports 10(1):15718 11 Pages, Nature Publishing Group, United Kingdom (Sep. 2020). [cited by applicant]
Chernov, N., et al., “Fitting Quadratic Curves to Data Points,” British Journal of Mathematics & Computer Science 4(1):33-60, (2014). [cited by applicant]
De Almeida Junior, F.L., et al.,“Image Quality Treatment to Improve Iris Biometric Systems,” Infocomp Journal of Computer Science 16(1-2):21-30, (2017). [cited by applicant]
De Seze, J., et al., “Pupillary Disturbances in Multiple Sclerosis: Correlation With MRI Findings,” Journal of the Neurological Sciences 188(1-2):37-41, Elsevier, Netherlands (Jul. 2001). [cited by applicant]
Derwenskus, J., et al., “Abnormal Eye Movements Predict Disability in MS: Two-year Follow-up,” Annals of the New York Academy of Sciences 1039:521-523, Blackwell, United States (Apr. 2005). [cited by applicant]
Felmingham, K., “Eye Tracking and PTSD,” Comprehensive Guide to Post-traumatic Stress Disorder Chapter 69:1241-1256, (Jan. 2015). [cited by applicant]
Ferreira, M., et al., “Using Endogenous Saccades to Characterize Fatigue in Multiple Sclerosis,” Multiple Sclerosis and Related Disorders 14:16-22, Elsevier B. V., Netherlands (May 2017). [cited by applicant]
Fielding, J., et al., “Ocular Motor Signatures of Cognitive Dysfunction in Multiple Sclerosis,” Nature Reviews. Neurology, 11(11):637-645, Nature Publishing Group, United Kingdom (Nov. 2015). [cited by applicant]
Fink, L., et al., “From Pre-processing to Advanced Dynamic Modeling of Pupil Data,” Behavior Research Methods 37 Pages, Springer, United States (Jun. 2023). [cited by applicant]
Frohman, E.M., et al., “Quantitative Oculographic Characterisation of Internuclear Ophthalmoparesis in Multiple Sclerosis: the Versional Dysconjugacy Index Z Score,” Journal of Neurology, Neurosurgery, and Psychiatry 73… [cited by applicant]
Frohman, E.M., et al., “The Neuro-Ophthalmology of Multiple Sclerosis”, The Lancet Neurology, 4(2):111-121, Lancet Public Group, United Kingdom (Feb. 2005). [cited by applicant]
Frohman, T.C., et al., “Accuracy of Clinical Detection of INO in MS: Corroboration With Quantitative Infrared Oculography,” Neurology 61(6):848-850, Lippincott Williams & Wilkins, United States (Sep. 2003). [cited by applicant]
Grillini, A., et al., “Eye Movement Evaluation in Multiple Sclerosis and Parkinson's Disease Using a Standardized Oculomotor and Neuro-Ophthalmic Disorder Assessment (SONDA),” Frontiers in Neurology 11:971 1-15, Frontie… [cited by applicant]
Guri, M., et al., “Brightness: Leaking Sensitive Data from Air-Gapped Workstations via Screen Brightness,” IEEE 12th CMI Conference on Cybersecurity and Privacy 7 pages, (2020). [cited by applicant]
Hasasneh, A., et al., “Deep Learning Approach for Automatic Classification of Ocular and Cardiac Artifacts in Meg Data,” Hindawi Journal of Engineering 10 Pages, (Apr. 2018). [cited by applicant]
Hoffner, S., et al., “Gaze Tracking Using Common Webcams,” Osnabruck University, (Feb. 2018). [cited by applicant]
Holzman, P.S., et al., “Eye-tracking Dysfunctions in Schizophrenic Patients and Their Relatives,” Archives of General Psychiatry 31(2):143-151, American Medical Association, United States (Aug. 1974). [cited by applicant]
Hooge, I.T.C., et al., “Gaze Tracking Accuracy in Humans: One Eye is Sometimes Better Than Two,” Behavior Research Methods 51(6):2712-2721, Springer, United States (Dec. 2019). [cited by applicant]
Hou, L., et al., “Illumination-Based Synchronization of High-Speed Vision Sensors,” Sensors 10(6):5530-5547, Basel, Switzerland (2010). [cited by applicant]
Hutt, S. and D'Mello, S.K., “Evaluating Calibration-free Webcam-based Eye Tracking for Gaze-based User Modeling,” ICMI '22: Proceedings of the 2022 International Conference on Multimodal Interaction 224-235, (Nov. 2022). [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/027201, mailed on Sep. 19, 2022, 10 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2022/027312, mailed on Oct. 27, 2022, 10 pages. [cited by applicant]
Jacobsen, J., “Pupillary Function in Multiple Sclerosis,” Acta Neurologica Scandinavica 82(6):392-395, Wiley-Blackwell, Denmark (Dec. 1990). [cited by applicant]
Jamaludin, S., et al., “Deblurring of Noisy Iris Images in Iris Recognition,” Bulletin of Electrical Engineering and Informatics (BEEI) 10(1):156-159, (Feb. 2021). [cited by applicant]
Joyce, D.S., et al., “Melanopsin-mediated Pupil Function is Impaired in Parkinson's Disease,” Scientific Reports 8(1):7796, Nature Publishing Group, United Kingdom (May 2018). [cited by applicant]
Kelbsch, C., et al., “Standards in Pupillography,” Frontiers in Neurology 10(129):1-26, Frontiers Research Foundation, Switzerland (Feb. 2019). [cited by applicant]
Krafka, K., et al., “Eye Tracking for Everyone,” The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 9 Pages, (Jun. 2016). [cited by applicant]
Lai, H., et al., “Measuring Saccade Latency Using Smartphone Cameras,” IEEE Journal of Biomedical and Health Informatics 24(3):1-13, Institute of Electrical and Electronics Engineers, United States (Mar. 2020). [cited by applicant]
Liu, G., et al., “A Differential Approach for Gaze Estimation,” IEEE transactions on pattern analysis and machine intelligence 43(3):1092-1099, IEEE Computer Society, United States (Mar. 2021). [cited by applicant]
Liu, J., et al., “Iris Image Deblurring Based on Refinement of Point Spread Function,” Chinese Conference on Biometric Recognition (CCBR), Lecture Notes in Computer Science 7701:184-192, (Dec. 2012). [cited by applicant]
Lizak, N., et al., “Impairment of Smooth Pursuit as a Marker of Early Multiple Sclerosis,” Frontiers in Neurology 7(3):206 1-7, Frontiers Research Foundation, Switzerland (Nov. 2016). [cited by applicant]
Mahanama, B., et al., “Eye Movement and Pupil Measures: a Review,” Frontiers in Computer Science 3:733531 1-12, (Jan. 2022). [cited by applicant]
Matza, L.S., “Multiple Sclerosis Relapse: Qualitative Findings From Clinician and Patient Interviews,” Multiple Sclerosis and Related Disorders 27 Pages, Elsevier B. V., Netherlands (Jan. 2019). [cited by applicant]
Model, D., “A Calibration Free Estimation of the Point of Gaze and Objective Measurement of Ocular Alignment in Adults and Infants,” University of Toronto 160 pages, (2011). [cited by applicant]
Mollers, Maximilian., “Calibration-Free Gaze Tracking an Experimental Analysis,” RWTH Aachen University 111 pages, (2007). [cited by applicant]
Niestroy, A., “Neuro-ophthalmologic Aspects of Multiple Sclerosis: Using Eye Movements as a Clinical and Experimental Tool,” Clinical Ophthalmology 1(3):267-272, Dove Medical Press, New Zealand (Sep. 2007). [cited by applicant]
Park, S., et al., “Few-Shot Adaptive Gaze Estimation,” Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 13 pages, (2019). [cited by applicant]
Patel, A.S., et al., “Optical Axes and Angle Kappa,” American Academy of Ophthalmology, (Oct. 2021). [cited by applicant]
Peysakhovich, V., et al., “The Impact of Luminance on Tonic and Phasic Pupillary Responses to Sustained Cognitive Load,” International Journal of Psychophysiology 112:40-45, Elsevier, Netherlands (Feb. 2017). [cited by applicant]
Pfeuffer, K., et al., “Pursuit Calibration: Making Gaze Calibration Less Tedious and More Flexible,” UIST 13 Proceedings of the 26th Annual Acm Symposium on User Interface Software and Technology 261-270, (Oct. 2013). [cited by applicant]
Pi, J. and Shi, B.E., et al., “Task-embedded Online Eye-tracker Calibration for Improving Robustness to Head Motion,” Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications ETRA '19 8:1-9, (Jun. 2… [cited by applicant]
Polak, P.E., et al., “Locus Coeruleus Damage and Noradrenaline Reductions in Multiple Sclerosis and Experimental Autoimmune Encephalomyelitis,” Brain 134(Pt 3):665-677, Oxford University Press, United Kingdom (Mar. 2011… [cited by applicant]
Rasulo, F.A., et al., “Essential Noninvasive Multimodality Neuromonitoring for the Critically III Patient,” Critical Care 24(1):100 12 Pages, BioMed Central Ltd, United Kingdom (Mar. 2020). [cited by applicant]
Rayner, K., “Eye Movements in Reading and Information Processing: 20 Years of Research,” Psychological Bulletin 124(3):372-422, American Psychological Association, United States (Nov. 1998). [cited by applicant]
Rodrigues, A.C., “Response Surface Analysis: A Tutorial for Examining Linear and Curvilinear Effects,” Journal of Contemporary Administration 25(6):1-14, (Apr. 2021). [cited by applicant]
Romero, K., et al., “Neurologists' Accuracy in Predicting Cognitive Impairment in Multiple Sclerosis,” Multiple Sclerosis and Related Disorders 4(4):291-295, Elsevier B. V., Netherlands (Jul. 2015). [cited by applicant]
Schuler, C.J., “Machine Learning Approaches to Image Deconvolution,” Dissertation University of Tubingen 142 Pages, Germany (2017). [cited by applicant]
Schweitzer, R and Rolfs, M., “An Adaptive Algorithm for Fast and Reliable Online Saccade Detection,” Behavior Research Methods 52(3):1122-1139, Springer, United States (Jun. 2020). [cited by applicant]
Serra, A., et al., “Eye Movement Abnormalities in Multiple Sclerosis: Pathogenesis, Modeling, and Treatment,” Frontiers in Neurology 9:31 1-7, Frontiers Research Foundation, Switzerland (Feb. 2018). [cited by applicant]
Serra, A., et al., “Role of Eye Movement Examination and Subjective Visual Vertical in Clinical Evaluation of Multiple Sclerosis,” Journal of Neurology 250(5):569-575, Springer-Verlag, Germany (May 2003). [cited by applicant]
Servillo, G., et al., “Bedside Tested Ocular Motor Disorders in Multiple Sclerosis Patients,” Multiple Sclerosis International 2014:732329 1-5, Hindawi Publishing Corporation, Egypt (Apr. 2014). [cited by applicant]
Sheehy, C.K., et al., “Fixational Microsaccades: a Quantitative and Objective Measure of Disability in Multiple Sclerosis,” Multiple Sclerosis 26(3):1-11, SAGE Publications, United Kingdom (Mar. 2020). [cited by applicant]
Smith, J.D., “Viewpointer: Lightweight Calibration-free Eye Tracking for Ubiquitous Handsfree Deixis,” UIST 05: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, 84 pages (2005). [cited by applicant]
Strobl, M.A.R., et al., “Look Me in the Eye: Evaluating the Accuracy of Smartphone-based Eye Tracking for Potential Application in Autism Spectrum Disorder Research,” Biomedical Engineering Online 18(1):51 1-12, BioMed … [cited by applicant]
System and Method for Measuring Delay from Monitor Output to Camera Sensor, Unpublished Disclosure; 16 pages. [cited by applicant]
Teikari, P., et al., “Embedded Deep Learning in Ophthalmology: Making Ophthalmic Imaging Smarter,” Therapeutic Advances in Ophthalmology 11: 21 Pages, Sage Publications Limited, United States (Mar. 2019). [cited by applicant]
Tur, C., et al., “Assessing Treatment Outcomes in Multiple Sclerosis Trials and in the Clinical Setting,” Nature Reviews. Neurology 14(2):164 Pages, Nature Publishing Group, United Kingdom (Feb. 2018). [cited by applicant]
Valliappan, N., et al., “Accelerating Eye Movement Research via Accurate and Affordable Smartphone Eye Tracking,” Nature Communications 11(1):4553 1-12, Nature Publishing Group, United Kingdom (Sep. 2020). [cited by applicant]
Valliappan, N., et al., “Accelerating Eye Movement Research via Accurate and Affordable Smartphone Eye Tracking,” Supplementary Information, 18 pages, (Jul. 2020). [cited by applicant]
Van Munset, C.E.P., et al., “Outcome Measures in Clinical Trials for Multiple Sclerosis,” CNS Drugs 31(3):217-236, Springer International, New Zealand (Mar. 2017). [cited by applicant]
Villers-Sidani, E.D., et al., “A Novel Tablet-based Software for the Acquisition and Analysis of Gaze and Eye Movement Parameters: A Preliminary Validation Study in Parkinson's Disease,” Frontiers in Neurology 14(120473… [cited by applicant]
Villers-Sidani, E.D., et al., “Oculomotor Analysis to Assess Brain Health: Preliminary Findings From a Longitudinal Study of Multiple Sclerosis Using Novel Tablet-based Eye-tracking Software,” Frontiers in Neurology 14(… [cited by applicant]
Wang, K. and JI, Qiang., “3D Gaze Estimation Without Explicit Personal Calibration,” Pattern Recognition 70:216-227, Elsevier, (Jul. 2018). [cited by applicant]
Williams, B.M., et al., “Fast Blur Detection and Parametric Deconvolution of Retinal Fundus Images,” Fetal, Infan and Ophthalmic Medical Image Analysis 8 Pages, Springer, Cham. (2017). [cited by applicant]
Yang, T., et al., “Gaze Angle Estimate and Correction in Iris Recognition,” IEEE Symposium on Computational Intelligence in Biometrics and Identity Management (CIBIM) 7 Pages, (Dec. 2014). [cited by applicant]
Zammarchi, G., et al., “Application of Eye Tracking Technology in Medicine: a Bibliometric Analysis,” Vision 5(4):56 1-14, MDPI AG, Switzerland (Nov. 2021). [cited by applicant]
Zhang, Y., et al., “Luminance Effects on Pupil Dilation in Speech-in-noise Recognition,” PloS one 17(12):e0278506 1-18, Public Library of Science, United States (Dec. 2022). [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority directed to International Patent Application No. PCT/IB2024/050060, mailed Apr. 3, 2024; 7 pages. [cited by applicant]