IP Library Granted Patent US 9,939,893
Granted Patent B2
US 9,939,893 · App. 14/631,819 · Granted Apr 10, 2018

Eye gaze tracking

Inventors: Sashi Kanth Saripalle (Kansas City, KS); Reza Derakhshani (Shawnee, KS); Vikas Gottemukkula (Kansas City, KS)
Assignee: EyeVerify Inc.
G06F3/013G06K9/00597G06T7/246G06T2207/30041G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,939,893
App. No.
14/631,819
Granted
Apr 10, 2018
Kind
B2
Abstract

Methods and systems for eye gaze tracking are provided, in which a plurality of images of at least one eye are received and, for each image of the eye(s), a plurality of stable vascular points associated with a vasculature of the eye(s) are identified. Based on the identified stable vascular points in the received images of the eye(s), a gaze angle of the eye(s) is determined.

Claims (43)

1. A computer-implemented method comprising:

directing a user to gaze in a plurality of defined angles;

receiving during a first time period, for each angle in the plurality of defined angles, at least one image of at least one eye of the user gazing in the angle;

creating, for each angle in the plurality of defined angles and based on the at least one image of the at least one eye of the user gazing in the angle, at least one enrollment template comprising eye vascular interest point locations and corresponding local features;

receiving during a second, later time period at least one image of at least one eye of the user;

identifying, for the at least one image of the at least one eye received during the second, later time period, a plurality of stable vascular points associated with a vasculature of the at least one eye;

creating at least one verification template based on the stable vascular points identified in the at least one image received during the second, later time period; and

determining a gaze angle of the at least one eye based on matching the at least one verification template to at least one of the enrollment templates.

2. The method of claim 1 , further comprising:

extracting a plurality of feature descriptors around the identified stable vascular points wherein creating the at least one verification template comprises creating a plurality of templates based on the feature descriptors and identified stable vascular points.

3. The method of claim 1 , further comprising identifying one or more stable peri-ocular anchor points based on one or more of the received images of the at least one eye.

4. The method of claim 3 , further comprising:

tracking one or more of the identified stable vascular points over time; and

determining a gaze angle of the at least one eye based on a displacement of one or more of the identified stable vascular points relative to one or more of the stable peri-ocular anchor points.

5. The method of claim 4 , wherein a particular stable peri-ocular anchor point comprises a corner of the at least one eye.

6. The method of claim 4 , wherein the identified stable vascular points comprises stable vascular points on a left eye and a right eye, and wherein the stable peri-ocular anchor points comprise stable peri-ocular anchor points relative to the left eye and the right eye.

7. The method of claim 1 , further comprising:

enhancing a contrast of a white part of the at least one eye in a particular received image of the at least one eye; and

removing noise from a white part of the at least one eye in a particular received image of the at least one eye.

8. The method of claim 7 , wherein the noise comprises an eyelash.

9. The method of claim 1 , further comprising determining an approximate location of an iris of the at least one eye based on a particular received image of the at least one eye.

10. A system comprising:

one or more computers programmed to perform operations comprising:

directing a user to gaze in a plurality of defined angles;

receiving during a first time period, for each angle in the plurality of defined angles, at least one image of at least one eye of the user gazing in the angle;

creating, for each angle in the plurality of defined angles and based on the at least one image of the at least one eye of the user gazing in the angle, at least one enrollment template comprising eye vascular interest point locations and corresponding local features;

receiving during a second, later time period at least one image of at least one eye of the user;

identifying, for the at least one image of the at least one eye received during the second, later time period, a plurality of stable vascular points associated with a vasculature of the at least one eye;

creating at least one verification template based on the stable vascular points identified in the at least one image received during the second, later time period; and

determining a gaze angle of the at least one eye based on matching the at least one verification template to at least one of the enrollment templates.

11. The system of claim 10 , wherein the operations further comprise:

extracting a plurality of feature descriptors around the identified stable vascular points wherein creating the at least one verification template comprises creating a plurality of templates based on the feature descriptors and identified stable vascular points.

12. The system of claim 10 , wherein the operations further comprise identifying one or more stable peri-ocular anchor points based on one or more of the received images of the at least one eye.

13. The system of claim 12 , wherein the operations further comprise:

tracking one or more of the identified stable vascular points over time; and

determining a gaze angle of the at least one eye based on a displacement of one or more of the identified stable vascular points relative to one or more of the stable peri-ocular anchor points.

14. The system of claim 13 , wherein a particular stable peri-ocular anchor point comprises a corner of the at least one eye.

15. The system of claim 13 , wherein the identified stable vascular points comprises stable vascular points on a left eye and a right eye, and wherein the stable peri-ocular anchor points comprise stable peri-ocular anchor points relative to the left eye and the right eye.

16. The system of claim 10 , wherein the operations further comprise:

enhancing a contrast of a white part of the at least one eye in a particular received image of the at least one eye; and

removing noise from a white part of the at least one eye in a particular received image of the at least one eye.

17. The system of claim 16 , wherein the noise comprises an eyelash.

18. The system of claim 10 , wherein the operations further comprise determining an approximate location of an iris of the at least one eye based on a particular received image of the at least one eye.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: EYEVERIFY INC.
To: JUMIO CORPORATION
Reel/Frame 061004/0708 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 035488 FRAME 0250. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 1, 2016
From: SARIPALLE, SASHI K.; DERAKHSHANI, REZA R.; GOTTEMUKKULA, VIKAS
To: EYEVERIFY INC.
Reel/Frame 038329/0244 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2015
From: SARIPALLE, SASHI K.; DERAKHSHANI, REZA R.; GOTTEMUKKULA, VIKAS
To: EYEVERIFY, INC.
Reel/Frame 035488/0250 →
Continuity (2)
Provisional Application 61944438 · Feb 25, 2014
Related Publication 20150241967A1 · Aug 27, 2015