IP Library Granted Patent US 11,379,035
Granted Patent B2
US 11,379,035 · App. 17/087,302 · Granted Jul 5, 2022

System and method for resonant eye-tracking

Inventor: Niladri Sarkar (Waterloo, CA)
Assignee: AdHawk Microsystems Inc.
G06F3/013G02B26/0833G02B26/105G02B27/0093G02B27/0172G02B27/0176G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,379,035
App. No.
17/087,302
Granted
Jul 5, 2022
Kind
B2
Abstract

Aspects of the present disclosure describe systems, methods, and structures that provide eye-tracking by 1) steering a beam of light through the effect of a microelectromechanical system (MEMS) operating at a resonant frequency onto a corneal surface; and 2) detecting the light reflected from the corneal surface.

Claims (49)

1. An eye-tracking system comprising:

a scanner that scans a beam of light in a two-dimensional pattern over a portion of an eye comprising a cornea having a corneal surface, wherein the scanner comprises a microelectromechanical system (MEMS) that has a first resonant frequency in a first axis and a second resonant frequency in a second axis that is orthogonal to the first axis;

a driver that drives the MEMS in the first axis with a first drive signal characterized by a first drive frequency that is based on the first resonant frequency and in the second axis with a second drive signal characterized by a second drive frequency that is based on the second resonant frequency;

a photodiode that provides a first output signal that is based on the intensity of a reflected signal that includes a portion of the beam of light reflected from the cornea, wherein the photodiode is a non-imaging photodiode;

a timer that provides a timer value based on the first drive signal; and

a processor configured to:

(i) detect a first corneal glint based on the first output signal;

(ii) determine a first time at which the first corneal glint is detected; and

(iii) estimate a first position of the cornea along the first axis based on the first time.

2. The system of claim 1 wherein the second resonant frequency is equal to one-half of the first resonant frequency.

3. The system of claim 1 wherein the first drive frequency is equal to the first resonant frequency.

4. The system of claim 3 wherein the second drive frequency is equal to the second resonant frequency.

5. The system of claim 3 wherein the second drive frequency is equal to one-half of the first resonant frequency.

6. The system of claim 1 further comprising a peak-hold circuit that provides a peak-hold signal based on the first output signal, wherein the peak-hold signal is characterized by an envelope having at least one inflection point, and wherein the processor is further configured to (v) estimate a second position of the cornea along the second axis based on at the least one inflection point.

7. The system of claim 1 wherein the scanner is isothermal in at least one of the first axis and second axis.

8. The system of claim 1 wherein the processor is further configured to:

(iv) determine a position of the cornea along at least one dimension during each of a plurality of scans of the beam of light over the portion of the eye;

(v) determine a velocity of the cornea during a saccade based on the plurality of positions; and

(vi) predict a post-saccade position of the cornea based on the velocity.

9. The system of claim 1 wherein the processor is further configured to:

(iv) identify a first location of the cornea;

(v) center the two-dimensional pattern at a bias position along a first direction, the bias position being based on the first location; and

(vi) drive the scanner in resonance along a second direction around the bias position, wherein the second direction is orthogonal to the first direction.

10. The system of claim 1 wherein the processor is further configured to:

(iv) determine a phase offset based on the detection of a first pair of glints during a first period of the first drive signal; and

(v) estimate the first position based further on the phase offset.

11. The system of claim 1 further comprising a Virtual and Augmented Reality (VR/AR) system for projecting a virtual object to the eye at a first projected position, wherein the processor is further configured to (iv) determine a vestibulo-ocular reflex (VOR) response of the eye, and wherein the VR/AR system is configured to constrain the first projected position within the VOR response.

12. An eye-tracking system comprising:

an isothermal scanner that scans a beam of light in a Lissajous pattern over a portion of an eye comprising a cornea having a corneal surface, wherein the scanner comprises a microelectromechanical system (MEMS) that has a first resonant frequency in a first axis and a second resonant frequency in a second axis that is orthogonal to the first axis;

a driver that drives the MEMS in the first axis with a first drive signal characterized by a first drive frequency that is equal to the first resonant frequency and in the second axis with a second drive signal characterized by a second drive frequency that is equal to the second resonant frequency;

a photodiode that provides a first output signal that is based on the intensity of a reflected signal that includes a portion of the beam of light reflected from the cornea, wherein the photodiode is a non-imaging photodiode;

a timer that provides a timer value based on the first drive signal; and

a processor configured to:

determine a first time at which a first corneal glint is detected; and

estimate a first position of the cornea along the first axis based on the first time.

13. The system of claim 12 wherein the second resonant frequency is equal to one-half of the first resonant frequency.

14. The system of claim 12 wherein the processor is further configured to:

determine a position of the cornea along at least one dimension during each of a plurality of scans of the beam of light over the portion of the eye;

determine a velocity of the cornea during a saccade based on the plurality of positions; and

predict a post-saccade position of the cornea based on the velocity.

15. The system of claim 12 wherein the processor is further configured to:

identify a first location of the cornea;

center the two-dimensional pattern at a bias position along a first direction, the bias position being based on the first location; and

drive the scanner in resonance along a second direction around the bias position, wherein the second direction is orthogonal to the first direction.

16. The system of claim 12 wherein the processor is further configured to determine a phase offset based on the detection of a first pair of glints during a first period of the first drive signal, and wherein the estimate of the first position is based further on the phase offset.

17. The system of claim 12 wherein the processor includes a servo loop for adjusting the phase offset.

18. The system of claim 12 further comprising a Virtual and Augmented Reality (VR/AR) system for projecting a virtual object to the eye at a first projected position, wherein the processor is further configured to determine a vestibulo-ocular reflex (VOR) response of the eye, and wherein the VR/AR system is configured to constrain the first projected position within the VOR response.

19. The system of claim 12 wherein the first resonant frequency is higher than the second resonant frequency.

20. The system of claim 12 wherein the second resonant frequency is higher than the first resonant frequency.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: ADHAWK MICROSYSTEMS INC.
To: GOOGLE LLC
Reel/Frame 071720/0287 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: THE XCHANGE FUND I, L.P.
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0756 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: CANSO TECHNOLOGY VALUE FUND
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0229 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0777 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: GRIP INVESTMENTS LIMITED
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0787 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: CANSO TECHNOLOGY VALUE FUND LP
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0797 →
SECURITY INTEREST Recorded Oct 8, 2024
From: ADHAWK MICROSYSTEMS INC. D/B/A ADHAWK MICROSYSTEMS
To: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 068826/0207 →
SECURITY INTEREST Recorded Mar 13, 2024
From: ADHAWK MICROSYSTEMS INC.
To: GRIP INVESTMENTS LIMITED; THE XCHANGE FUND I, L.P.; CANSO TECHNOLOGY VALUE FUND; CANSO TECHNOLOGY VALUE FUND LP
Reel/Frame 066794/0640 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2020
From: ICSPI CORP.
To: ADHAWK MICROSYSTEMS
Reel/Frame 054254/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2020
From: SARKAR, NILADRI
To: ICSPI CORP.
Reel/Frame 054254/0127 →