IP Library Granted Patent US 9,791,927
Granted Patent B2
US 9,791,927 · App. 15/483,012 · Granted Oct 17, 2017

Systems and methods of eye tracking calibration

Inventors: Javier San Agustin Lopez (Copenhagen S., DK); John Paulin Hansen (Roskilde, DK); Sebastian Sztuk (Copenhagen N., DK); Martin Henrik Tall (Frederiksberg C., DK)
Assignee: Facebook, Inc.
G06F3/013G06F21/31G06K9/00604
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,791,927
App. No.
15/483,012
Granted
Oct 17, 2017
Kind
B2
Abstract

Methods and systems to facilitate eye tracking control calibration are provided. One or more objects are displayed on a display of a device, where the one or more objects are associated with a function unrelated to a calculation of one or more calibration parameters. The one or more calibration parameters relate to a calibration of a calculation of gaze information of a user of the device, where the gaze information indicates where the user is looking. While the one or more objects are displayed, eye movement information associated with the user is determined, which indicates eye movement of one or more eye features associated with at least one eye of the user. The eye movement information is associated with a first object location of the one or more objects. The one or more calibration parameters are calculated based on the first object location being associated with the eye movement information.

Claims (69)

1. A method comprising:

determining a sequence of characters, the determination of each character in the sequence comprising:

displaying a plurality of moving objects on a display of a computing device, each of the moving objects moving along one of a plurality of object paths and corresponding to a respective single alphanumeric character,

capturing images of at least one eye of a user while the plurality of moving objects are displayed,

while the plurality of moving objects are displayed, determining, based on the images, eye movement information associated with the user, the eye movement information indicating eye movement of one or more eye features associated with at least one eye of the user,

determining that a path of the plurality of object paths matches the eye movement information,

identifying a moving object of the plurality of moving objects, the identified moving object moving along the matching object path, and

appending a single alphanumeric character corresponding to the identified moving object to the sequence of characters;

determining whether the sequence of characters matches a login sequence of the user; and

responsive to a determination that the sequence of characters matches the login sequence of the user, granting access to an account of the user.

2. The method of claim 1 , wherein the characters corresponding to the moving objects are single-digit numbers, and wherein the login sequence is a personal identification number.

3. The method of claim 1 , wherein identifying a moving object of the plurality of moving objects comprises:

calculating an eye movement path of the user based on the eye movement information;

calculating a plurality of matching coefficients, each of the matching coefficients indicating a degree of similarity between the eye movement path and one of the object paths; and

selecting one or more of the moving objects, each of the selected moving objects moving along an object path associated with a matching coefficient exceeding a threshold matching coefficient.

4. The method of claim 3 , wherein identifying a moving object of the plurality of moving objects further comprises:

responsive to selecting exactly one of the moving objects, identifying the selected moving object.

5. The method of claim 3 , wherein identifying a moving object of the plurality of moving objects further comprises:

responsive to selecting two or more of the moving objects, modifying the object paths of the selected moving objects.

6. The method of claim 1 , wherein determining a sequence of characters, the determination of each character in the sequence further comprises:

responsive to identifying a moving object of the plurality of moving objects, changing a direction of one or more of the object paths.

7. The method of claim 1 , wherein determining a sequence of characters, the determination of each character in the sequence further comprises:

responsive to identifying a moving object of the plurality of moving objects, providing a notification to the user to look at a next character in the login sequence of the user.

8. A non-transitory computer-readable storage medium comprising instructions executable by a processor, the instructions comprising instructions for:

determining a sequence of characters, the determination of each character in the sequence comprising:

displaying a plurality of moving objects on a display of a computing device, each of the moving objects moving along one of a plurality of object paths and corresponding to a respective single alphanumeric character,

capturing images of at least one eye of a user while the plurality of moving objects are displayed,

while the plurality of moving objects are displayed, determining, based on the images, eye movement information associated with the user, the eye movement information indicating eye movement of one or more eye features associated with at least one eye of the user,

determining that a path of the plurality of object paths matches the eye movement information,

identifying a moving object of the plurality of moving objects, the identified moving object moving along the matching object path, and

appending a single alphanumeric character corresponding to the identified moving object to the sequence of characters;

determining whether the sequence of characters matches a login sequence of the user; and

responsive to a determination that the sequence of characters matches the login sequence of the user, granting access to an account of the user.

9. The computer-readable storage medium of claim 8 , wherein the characters corresponding to the moving objects are single-digit numbers, and wherein the login sequence is a personal identification number.

10. The computer-readable storage medium of claim 8 , wherein identifying a moving object of the plurality of moving objects comprises:

calculating an eye movement path of the user based on the eye movement information;

calculating a plurality of matching coefficients, each of the matching coefficients indicating a degree of similarity between the eye movement path and one of the object paths; and

selecting one or more of the moving objects, each of the selected moving objects moving along an object path associated with a matching coefficient exceeding a threshold matching coefficient.

11. The computer-readable storage medium of claim 10 , wherein identifying a moving object of the plurality of moving objects further comprises:

responsive to selecting exactly one of the moving objects, identifying the selected moving object.

12. The computer-readable storage medium of claim 10 , wherein identifying a moving object of the plurality of moving objects further comprises:

responsive to selecting two or more of the moving objects, modifying the object paths of the selected moving objects.

13. The computer-readable storage medium of claim 8 , wherein determining a sequence of characters, the determination of each character in the sequence further comprises:

responsive to identifying a moving object of the plurality of moving objects, changing a direction of one or more of the object paths.

14. The computer-readable storage medium of claim 8 , wherein determining a sequence of characters, the determination of each character in the sequence further comprises:

responsive to identifying a moving object of the plurality of moving objects, providing a notification to the user to look at a next character in the login sequence of the user.

15. A system comprising:

a processor; and

a non-transitory computer-readable storage medium comprising instructions executable by the processor, the instructions when executed by the processor causing the processor to perform steps including:

determining a sequence of characters, the determination of each character in the sequence comprising:

displaying a plurality of moving objects on a display of a computing device, each of the moving objects moving along one of a plurality of object paths and corresponding to a respective single alphanumeric character,

capturing images of at least one eye of a user while the plurality of moving objects are displayed,

while the plurality of moving objects are displayed, determining, based on the images, eye movement information associated with the user, the eye movement information indicating eye movement of one or more eye features associated with at least one eye of the user,

determining that a path of the plurality of object paths matches the eye movement information,

identifying a moving object of the plurality of moving objects, the identified moving object moving along the matching object path, and

appending a single alphanumeric character corresponding to the identified moving object to the sequence of characters;

determining whether the sequence of characters matches a login sequence of the user; and

responsive to a determination that the sequence of characters matches the login sequence of the user, granting access to an account of the user.

16. The system of claim 15 , wherein the characters corresponding to the moving objects are single-digit numbers, and wherein the login sequence is a personal identification number.

17. The system of claim 15 , wherein identifying a moving object of the plurality of moving objects comprises:

calculating an eye movement path of the user based on the eye movement information;

calculating a plurality of matching coefficients, each of the matching coefficients indicating a degree of similarity between the eye movement path and one of the object paths; and

selecting one or more of the moving objects, each of the selected moving objects moving along an object path associated with a matching coefficient exceeding a threshold matching coefficient.

18. The system of claim 17 , wherein identifying a moving object of the plurality of moving objects further comprises:

responsive to selecting exactly one of the moving objects, identifying the selected moving object.

19. The system of claim 17 , wherein identifying a moving object of the plurality of moving objects further comprises:

responsive to selecting two or more of the moving objects, modifying the object paths of the selected moving objects.

20. The system of claim 15 , wherein determining a sequence of characters, the determination of each character in the sequence further comprises:

responsive to identifying a moving object of the plurality of moving objects, changing a direction of one or more of the object paths.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2018
From: FACEBOOK, INC.
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047687/0942 →
Continuity (3)
Continuation 14180974 · Feb 14, 2014
Provisional Application 61764939 · Feb 14, 2013
Related Publication 20170212586A1 · Jul 27, 2017