IP Library Granted Patent US 9,829,973
Granted Patent B2
US 9,829,973 · App. 14/580,286 · Granted Nov 28, 2017

Eye gaze determination

Inventors: Anders Vennström (Stockholm, SE); Mårten Skogö (Danderyd, SE); John Elvesjö (Stockholm, SE)
Assignee: Tobii AB
G06F3/013G06F3/04842G06T7/73G06T2207/10016G06T2207/10048G06T2207/20076G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,829,973
App. No.
14/580,286
Granted
Nov 28, 2017
Kind
B2
Abstract

There is provided methods, systems and computer program products for identifying an interaction element from one or more interaction elements present in a user interface, comprising: receiving gaze information from an eye tracking system; determining the likelihood that an interaction element is the subject of the gaze information from the eye tracking system; and identifying an interaction element from the one or more interaction elements based on said likelihood determination.

Claims (61)

1. A computer system providing a gaze-controlled interface, the computer system comprising:

an operating system for executing an application;

a display module for displaying at least one interaction element on a visual display;

an eye tracking system operable to determine at least one gaze position of a user; and

an identification module operable to determine an interaction element displayed on the visual display that is the subject of the gaze position;

wherein the identification module comprises a processor configured to determine an interaction element by:

assigning a first weighting to an interaction element based on at least one property of the interaction element;

determining a likelihood that the user will direct their gaze to the interaction element dependent on the gaze position by using an alpha mask representing a weight distribution of said interaction element;

assigning a second weighting to the interaction element dependent on the likelihood;

determining the distance from the determined gaze position to a selected coordinate or area within the interaction element, wherein the selected coordinate or area is a center of the interaction element; and

identifying an interaction element dependent on the first weighting, the second weighting, and the determined distance from the determined gaze position to the selected coordinate or area.

2. The computer system according to claim 1 , wherein the at least one property is selected from a group consisting of:

an intended use;

a visual context;

an interaction context; and

collected data indicating how often one or more users interacts with the interaction element.

3. The computer system according to claim 1 , wherein identifying the interaction element is further based on information on the physiological properties of an eye of the user.

4. The computer system according to claim 1 , wherein identifying the interaction element comprises:

determining a weighting of a first and a second interaction element;

comparing the difference in the weighting between said first and second interaction elements with a threshold value; and

selecting from said first and second interaction elements based at least in part on said comparison with said threshold value.

5. A computer program product comprising a non-transitory computer-readable medium with instructions for causing a programmable computer to at least:

execute an application;

display at least one interaction element on a visual display;

use an eye tracking system to determine at least one gaze position of a user; and

determine an interaction element displayed on the visual display that is the subject of the gaze position by:

assigning a first weighting to an interaction element based on at least one property of the interaction element;

determining a likelihood that the user will direct their gaze to the interaction element dependent on the gaze position by using an alpha mask representing a weight distribution of said interaction element;

assigning a second weighting to the interaction element dependent on the likelihood;

determining the distance from the determined gaze position to a selected coordinate or area within the interaction element, wherein the selected coordinate or area is a center of the interaction element; and

identifying an interaction element dependent on the first weighting, the second weighting, and the determined distance from the determined gaze position to the selected coordinate or area.

6. The computer program product according to claim 5 , wherein the at least one property is selected from a group consisting of:

an intended use;

a visual context;

an interaction context; and

collected data indicating how often one or more users interacts with the interaction element.

7. The computer program product according to claim 5 , wherein identifying the interaction element is further based on information on the physiological properties of an eye of the user.

8. The computer program product according to claim 5 , wherein identifying the interaction element comprises:

determining a weighting of a first and a second interaction element;

comparing the difference in the weighting between said first and second interaction elements with a threshold value; and

selecting from said first and second interaction elements based at least in part on said comparison with said threshold value.

9. A method of providing a gaze-controlled interface, the method comprising:

executing an application;

displaying at least one interaction element on a visual display;

using an eye tracking system to determine at least one gaze position of a user; and

determining an interaction element displayed on the visual display that is the subject of the gaze position by:

assigning a first weighting to an interaction element based on at least one property of the interaction element;

determining a likelihood that the user will direct their gaze to the interaction element dependent on the gaze position by using an alpha mask representing a weight distribution of said interaction element;

assigning a second weighting to the interaction element dependent on the likelihood;

determining the distance from a determined gaze position to a selected coordinate or area within the interaction element, wherein the selected coordinate or area is a center of the interaction element; and

identifying an interaction element dependent on the first weighting, the second weighting, and the determined distance from the determined gaze position to the selected coordinate or area.

10. The method according to claim 9 , wherein the at least one property is selected from a group consisting of:

an intended use;

a visual context;

an interaction context; and

collected data indicating how often one or more users interacts with the interaction element.

11. The method according to claim 9 , wherein identifying the interaction element is further based on information on the physiological properties of an eye of the user.

12. The method according to claim 9 , wherein identifying the interaction element comprises:

determining a weighting of a first and a second interaction element;

comparing the difference in the weighting between said first and second interaction elements with a threshold value; and

selecting from said first and second interaction elements based at least in part on said comparison with said threshold value.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2017
From: VENNSTRÖM, ANDERS; SKOGÖ, MÅRTEN; ELVESJÖ, JOHN
To: TOBII TECHNOLOGY AB
Reel/Frame 042077/0644 →
CHANGE OF NAME Recorded Mar 23, 2017
From: TOBII TECHNOLOGY AB
To: TOBII AB
Reel/Frame 042079/0471 →
Priority Claims (1)
GB 1322873.9 · Dec 23, 2013 · national
Continuity (1)
Related Publication 20150177833A1 · Jun 25, 2015