IP Library Granted Patent US 10,241,572
Granted Patent B2
US 10,241,572 · App. 15/837,239 · Granted Mar 26, 2019

Systems, devices, and methods for proximity-based eye tracking

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,241,572
App. No.
15/837,239
Granted
Mar 26, 2019
Kind
B2
Abstract

Systems, devices, and methods for proximity-based eye tracking are described. A proximity sensor positioned near the eye monitors the distance to the eye, which varies depending on the position of the corneal bulge. The corneal bulge protrudes outward from the surface of the eye and so, all other things being equal, a static proximity sensor detects a shorter distance to the eye when the cornea is directed towards the proximity sensor and a longer distance to the eye when the cornea is directed away from the proximity sensor. Optical proximity sensors that operate with infrared light are used as a non-limiting example of proximity sensors. Multiple proximity sensors may be used and processed simultaneously in order to provide a more accurate/precise determination of the gaze direction of the user. Implementations in which proximity-based eye trackers are incorporated into wearable heads-up displays are described.

Claims (17)

1. A method of determining a gaze direction of a user, the method comprising:

illuminating at least a portion of an eye of the user with infrared light by a first illumination source;

detecting reflections of infrared light from the eye of the user by a first photodetector;

determining, by a processor communicatively coupled to at least the first photodetector, a distance between the first photodetector and the eye of the user based on reflections of infrared light from the eye of the user detected by the first photodetector; and

determining, by the processor, the gaze direction of the user based on at least the distance between the first photodetector and the eye of the user, wherein determining, by the processor, the gaze direction of the user based on at least the distance between the first photodetector and the eye of the user includes determining, by the processor, that the user is gazing in a direction towards the first photodetector when the distance between the first photodetector and the eye of the user is determined to be at or near a minimum value and that the user is gazing in a direction other than towards the first photodetector when the distance between the first photodetector and the eye of the user is determined to be at or near a maximum value.

2. The method of claim 1 , further comprising:

illuminating at least a portion of the eye of the user with infrared light by a second illumination source;

detecting reflections of infrared light from the eye of the user by a second photodetector, wherein the processor is communicatively coupled to the second photodetector; and

determining, by the processor, a distance between the second photodetector and the eye of the user based on reflections of infrared light from the eye of the user detected by the second photodetector, wherein determining, by the processor, the gaze direction of the user based on at least the distance between the first photodetector and the eye of the user includes determining, by the processor, the gaze direction of the user based on both the distance between the first photodetector and the eye of the user and at least the distance between the second photodetector and the eye of the user.

3. The method of claim 2 , further comprising:

illuminating at least a portion of the eye of the user with infrared light by at least one additional illumination source;

detecting reflections of infrared light from the eye of the user by at least one additional second photodetector, wherein the processor is communicatively coupled to the at least one additional photodetector; and

determining, by the processor, a distance between the at least one additional photodetector and the eye of the user based on reflections of infrared light from the eye of the user detected by the at least one additional photodetector, wherein determining, by the processor, the gaze direction of the user based on both the distance between the first photodetector and the eye of the user and at least the distance between the second photodetector and the eye of the user includes determining, by the processor, the gaze direction of the user based on: the distance between the first photodetector and the eye of the user, the distance between the second photodetector and the eye of the user, and the distance between the at least one additional photodetector and the eye of the user.

4. The method of claim 1 wherein the processor is communicatively coupled to a non-transitory processor-readable storage medium that stores data and/or instructions that, when executed by the processor, cause the processor to:

determine the distance between the first photodetector and the eye of the user based on reflections of infrared light from the eye of the user detected by the first photodetector; and

determine the gaze direction of the user based on at least the distance between the first photodetector and the eye of the user.

5. The method of claim 1 wherein determining, by a processor communicatively coupled to at least the first photodetector, a distance between the first photodetector and the eye of the user based on reflections of infrared light from the eye of the user detected by the first photodetector includes determining, by the processor, the distance between the first photodetector and the eye of the user based on at least one property selected from a group consisting of: an intensity of reflections of infrared light from the eye of the user detected by the first photodetector, a power of reflections of infrared light from the eye of the user, a luminance of reflections of infrared light from the eye of the user, and a time of flight of reflections of infrared light from the eye of the user.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2020
From: NORTH INC.
To: GOOGLE LLC
Reel/Frame 054113/0744 →
CHANGE OF NAME Recorded Feb 7, 2019
From: THALMIC LABS INC.
To: NORTH INC.
Reel/Frame 048287/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2018
From: VIDAL, MELODIE; CHAPESKIE, JAKE
To: THALMIC LABS INC.
Reel/Frame 047083/0018 →