IP Library Granted Patent US 12,146,985
Granted Patent B2
US 12,146,985 · App. 18/201,950 · Granted Nov 19, 2024

Methods and systems for low-power eye tracking

Inventors: Niladri Sarkar (Waterloo, CA); Nino Zahirovic (Waterloo, CA)
Assignee: AdHawk Microsystems Inc.
G01S7/4816G01S7/4817G01S17/88G06F3/013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,146,985
App. No.
18/201,950
Granted
Nov 19, 2024
Kind
B2
Abstract

Systems and methods for performing eye tracking using a scanning light signal with low power consumption are disclosed herein. Power consumption is reduced by intelligent disabling and re-enabling of non-imaging photodetector(s) and/or light source(s). In one embodiment, the scan region is contracted to a single feature of the eye (e.g., the pupil, a glint, etc.) in view of a particular type of event of interest to detect.

Claims (56)

1. An apparatus comprising:

a light source to generate a light signal;

a scanner to steer the light signal in a two-dimensional scan pattern that defines a scan region of an eye of a user;

a non-imaging photodetector to generate one or more output signals based on one or more reflected signals from the scan region; and

a processing system to:

select one or more features of the eye based on a specified type of eye event to detect;

determine a subregion of the scan region that contains at least a portion of each of the one or more selected features;

transmit one or more signals to (1) disable at least one of the non-imaging photodetector or the light source while scanning portions of the scan region outside of the subregion, and (2) enable the non-imaging photodetector and the light source while the scanner scans the subregion;

detect, during scanning of the subregion, at least one of: a change in a characteristic of at least one of the one or more selected features, a change in position of at least one of the one or more selected features, or a change in detectability of at least one of the one or more selected features;

determine, in response to the detection, an expanded subregion that is larger than the subregion; and

monitor the expanded subregion for a subsequent event.

2. The apparatus of claim 1 wherein at least one of the one or more selected features is a pupil or a glint.

3. The apparatus of claim 1 wherein the type of eye event is a change in gaze direction.

4. The apparatus of claim 1 wherein the type of eye event is a change in gaze direction exceeding a threshold amount.

5. The apparatus of claim 1 wherein the type of eye event is a blink.

6. The apparatus of claim 1 wherein the type of eye event is stationary eye.

7. The apparatus of claim 1 wherein the characteristic is one of size or shape.

8. The apparatus of claim 1 wherein the type of eye event to detect is determined based on an occurrence of a prior event.

9. The apparatus of claim 8 wherein the prior event is one of a prior eye event or an external event.

10. The apparatus of claim 1 wherein the subregion contains the entire feature.

11. The apparatus of claim 10 wherein the subregion does not contain any other features of the eye.

12. An apparatus comprising:

a light source to generate a light signal;

a scanner to steer the light signal in a two-dimensional scan pattern that defines a scan region of an eye of a user;

a first non-imaging photodetector to generate one or more output signals based on one or more diffuse-reflection signals from the scan region;

a second non-imaging photodetector to generate one or more output signals based on one or more specular-reflection signals from the scan region; and

a processing system to:

transmit one or more signals to the second non-imaging photodetector to disable the second non-imaging photodetector during scanning of at least a portion of the pupil of the eye; and

transmit one or more signals to the first non-imaging photodetector to disable the first non-imaging photodetector during scanning of at least a portion of a glint of the eye;

wherein the first non-imaging photodetector is enabled during at least a portion of the pupil scanning; and

wherein the second non-imaging photodetector is enabled during at least a portion of the glint scanning.

13. The apparatus of claim 12 wherein the processing system is further to determine a subregion of the scan region that contains the pupil and does not contain the glint.

14. The apparatus of claim 13 wherein the processing system is further to determine an expanded subregion that is larger than the subregion, wherein the determining of the expanded subregion is in response to detecting at least one of: a change in a characteristic of the pupil, a change in position of the pupil, or a change in detectability of the pupil.

15. The apparatus of claim 12 wherein the processing system is further to determine a subregion of the scan region that contains the glint and does not contain the pupil.

16. The apparatus of claim 15 wherein the processing system is further to determine an expanded subregion that is larger than the subregion, wherein the determining of the expanded subregion is in response to detecting at least one of: a change in a characteristic of the glint, a change in position of the glint, or a change in detectability of the glint.

17. An apparatus comprising:

a light source to generate a light signal;

a scanner to steer the light signal in a two-dimensional scan pattern that defines a scan region of an eye of a user;

a non-imaging photodetector to generate one or more output signals based on one or more reflected signals from the scan region; and

a processing system to:

select one or more features of the eye based on a specified type of eye event to detect;

determine a subregion of the scan region that contains at least a portion of each of the one or more selected features;

transmit one or more signals to (1) disable at least one of the non-imaging photodetector or the light source while scanning portions of the scan region outside of the subregion, and (2) enable the non-imaging photodetector and the light source while the scanner scans the subregion;

detect, during scanning of the subregion, a lack of change in the one or more selected features, a lack of change in position of the one or more selected features, and a lack of change in detectability of the one or more selected features, for a duration of time exceeding a time duration threshold;

determine, in response to the detection, an expanded subregion that is larger than the subregion; and

monitor the expanded subregion for a subsequent event.

18. The apparatus of claim 17 wherein the lack of change in position is with respect to a threshold.

19. The apparatus of claim 17 wherein the lack of change in the one or more selected features is with respect to size and shape.

20. The apparatus of claim 19 wherein the lack of change in the one or more selected features is also with respect to a threshold.

21. An apparatus comprising:

a light source to generate a light signal;

a scanner to steer the light signal in a two-dimensional scan pattern that defines a scan region of an eye of a user;

a first non-imaging photodetector to generate one or more output signals based on one or more reflected signals from a first feature of the eye within the scan region;

a second non-imaging photodetector to generate one or more output signals based on one or more reflected signals from a second feature of the eye within the scan region;

a processing system to transmit one or more signals to the second non-imaging photodetector to disable the second non-imaging photodetector during scanning of at least a portion of the first feature.

22. The apparatus of claim 21 wherein the processing system is further to transmit one or more signals to the first non-imaging photodetector to disable the first non-imaging photodetector during scanning of at least a portion of the second feature.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2025
From: ADHAWK MICROSYSTEMS INC.
To: GOOGLE LLC
Reel/Frame 071720/0287 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: THE XCHANGE FUND I, L.P.
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0756 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0777 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: GRIP INVESTMENTS LIMITED
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0787 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: CANSO TECHNOLOGY VALUE FUND LP
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0797 →
RELEASE OF SECURITY INTEREST Recorded Apr 3, 2025
From: CANSO TECHNOLOGY VALUE FUND
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 070730/0229 →
SECURITY INTEREST Recorded Oct 8, 2024
From: ADHAWK MICROSYSTEMS INC. D/B/A ADHAWK MICROSYSTEMS
To: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 068826/0207 →
SECURITY INTEREST Recorded Mar 13, 2024
From: ADHAWK MICROSYSTEMS INC.
To: GRIP INVESTMENTS LIMITED; THE XCHANGE FUND I, L.P.; CANSO TECHNOLOGY VALUE FUND; CANSO TECHNOLOGY VALUE FUND LP
Reel/Frame 066794/0640 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 25, 2023
From: SARKAR, NILADRI; ZAHIROVIC, NINO
To: ADHAWK MICROSYSTEMS INC.
Reel/Frame 063763/0290 →