IP Library Granted Patent US 9,829,971
Granted Patent B2
US 9,829,971 · App. 14/159,168 · Granted Nov 28, 2017

Systems and methods of eye tracking control

Inventors: Javier San Agustin Lopez (Copenhagen S, DK); Sebastian Sztuk (Copenhagen N., DK); Martin Henrik Tall (Frederiksberg C., DK)
Assignee: Facebook, Inc.
G06F3/013G06F3/0482G06F3/0488
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,829,971
App. No.
14/159,168
Granted
Nov 28, 2017
Kind
B2
Abstract

Methods and systems to facilitate eye tracking control are provided. A user input is received at a computing device. Point of regard information associated with a user of the computing device is determined while the user input is being received. The point of regard information indicates a location on a display of the computing device at which the user is looking. An operation associated with a display object identified based on the point of regard information is performed when receipt of the user input is determined to have terminated.

Claims (35)

1. A method, comprising:

receiving a user touch input at a computing device;

while continuing to receive the user touch input:

periodically determining, by a processor and at a plurality of time instances while the user touch input is being continuously received, point of regard information associated with a user of the computing device, the point of regard information comprising a plurality of point of regard measurements obtained during the plurality of time instances and indicating a location on a display of the computing device at which the user is looking during continuous reception of the user touch input; and

activating, in response to the user touch input, an eye control mode at the computing device, the eye control mode providing a plurality of display objects on the display while the user touch input is being received, each display object positioned at a different location within the display and associated with a respective operation capable of being performed based on a point of regard measurement of the plurality of point of regard measurements obtained at a time when the receipt of the user touch input has terminated;

determining whether receipt of the user touch input has terminated; and

performing an operation associated with a display object of the plurality of display objects identified by the point of regard at a moment the user touch input selecting the display object has terminated.

2. The method of claim 1 , wherein the user touch input is any one of a touch sensor input, a push button input, a mouse input, a keyboard input, or a biometric signal input.

3. The method of claim 1 , wherein the operation associated with the display object includes moving or selecting the display object.

4. The method of claim 1 , wherein the operation associated with the display object includes launching an application.

5. The method of claim 1 , further comprising:

terminating the eye control mode when the receipt of the user touch input has terminated.

6. A non-transitory machine-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

receiving a user touch input at a computing device;

while continuing to receive the user touch input:

periodically determining, by the one or more processors and at a plurality of time instances while the user touch input is being continuously received, point of regard information associated with a user of the computing device, the point of regard information comprising a plurality of point of regard measurements obtained during the plurality of time instances and indicating a location on a display of the computing device at which the user is looking during continuous reception of the user touch input; and

activating, in response to the user touch input, an eye control mode at the computing device, the eye control mode providing a plurality of display objects on the display while the user touch input is being received, each display object positioned at a different location within the display and associated with a respective operation capable of being performed based on a point of regard measurement of the plurality of point of regard measurements obtained at a time when the receipt of the user touch input has terminated;

determining whether receipt of the user touch input has terminated; and

performing an operation associated with a display object of the plurality of display objects identified by the point of regard at a moment the user touch input selecting the display object has terminated.

7. The non-transitory machine-readable storage medium of claim 6 , wherein the user touch input is any one of a touch sensor input, a push button input, a mouse input, a keyboard input, or a biometric signal input.

8. The non-transitory machine-readable storage medium of claim 6 , wherein the operation associated with the display object includes moving or selecting the display object.

9. The non-transitory machine-readable storage medium of claim 6 , wherein the operation associated with the display object includes launching an application.

10. A computing device, comprising:

a memory having instructions embodied thereon;

one or more processors configured by the instructions to perform operations comprising:

receiving a user touch input at the computing device;

while continuing to receive the user touch input:

periodically determining at a plurality of time instances while the user touch input is being continuously received, point of regard information associated with a user of the computing device, the point of regard information comprising a plurality of point of regard measurements obtained during the plurality of time instances and indicating a location on a display of the computing device at which the user is looking during continuous reception of the user touch input; and

activating, in response to the user touch input, an eye control mode at the computing device, the eye control mode providing a plurality of display objects on the display while the user touch input is being received, each display object positioned at a different location within the display and associated with a respective operation capable of being performed based on a point of regard measurement of the plurality of point of regard measurements obtained at a time when the receipt of the user touch input has terminated;

determining whether receipt of the user touch input has terminated; and

performing an operation associated with a display object of the plurality of display objects identified by the point of regard at a moment the user touch input selecting the display object has terminated.

11. The computing device of claim 10 , wherein the user touch input is any one of a touch sensor input, a push button input, a mouse input, a keyboard input, or a biometric signal input.

12. The computing device of claim 10 , wherein the operation associated with the display object includes moving or selecting the display object.

13. The computing device of claim 10 , wherein the operation associated with the display object includes launching an application.

14. The computing device of claim 10 , wherein the operations further comprise terminating the eye control mode when the receipt of the user touch input has terminated.

Assignments (5)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2018
From: FACEBOOK, INC.
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047687/0942 →
CORRECTIVE ASSIGNMENT TO CORRECT THE FIRST AND THIRD ASSIGNOR NAME PREVIOUSLY RECORDED AT REEL: 032765 FRAME: 0006. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 5, 2017
From: SAN AGUSTIN LOPEZ, JAVIER; SZTUK, SEBASTIAN; TALL, MARTIN HENRIK
To: THE EYE TRIBE APS
Reel/Frame 044136/0145 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2017
From: THE EYE TRIBE APS
To: FACEBOOK, INC.
Reel/Frame 041291/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2014
From: SAN AGUSTIN LOPEZ, JAVIER; SZTUK, SEBASTIAN; HENRIK TALL, MARTIN
To: THE EYE TRIBE APS
Reel/Frame 032765/0006 →
Continuity (2)
Provisional Application 61754888 · Jan 21, 2013
Related Publication 20140204029A1 · Jul 24, 2014