Granted Patent B2

US 12,620,128 · App. 18/628,899 · Granted May 5, 2026

Inventors: Richard Andersson (Danderyd, SE); Ihor Lomachenko (Danderyd, SE); Yevhen Dobronohov (Danderyd, SE); Ihor Bielousov (Danderyd, SE); Oleksandra Kunatova (Danderyd, SE)

Assignee: Tobii AB

G06T7/73A61B5/163A61B5/168G06F3/013G06T11/26G06T2207/30196

Abstract

Claims (38)

1 . A method for an eye tracking system comprising at least one camera, the method being configured to provide a heatmap based on an observation of at least one user and comprising the steps of:

defining a region that is to be analysed;

receiving an input in the form of a stimulus whereby the stimulus is positioned within the region;

determining a first gaze metric comprising gaze point data and gaze duration data of the user, the first gaze metric being determined in relation to the region comprising the stimulus and over a duration of time;

determining a second metric related to the user, the second metric comprising data different from the first gaze metric, the second metric being determined in relation to the region comprising the stimulus and over a duration of time, wherein the second metric is at least one parameter of pupil diameter, eye openness, saccade start positions, saccade stop positions, saccade peak velocity positions, saccade peak velocities, a start position of a first saccade and/or a start position of a last saccade or a stop position of a first saccade and/or a stop position of a last saccade;

dividing the region into a plurality of sections;

processing data related to the first gaze metric and the second metric by allocating values to the sections, so that a heatmap can be generated based on these allocated values and the sections; mapping the processed data to the plurality of sections and generating a heatmap for visually illustrating the processed data; and

storing a separate heatmap for each of the parameters of the second metric on a computer readable storage medium for analysis purposes.

2 . The method according to claim 1 , wherein the region is part of a display external to the eye tracking system and each section corresponds to a pixel of the display and wherein the first gaze metric and the second metric are determined in relation to each pixel of the display.

3 . The method according to claim 1 , wherein the second metric further comprises physiological data or behavioural data.

4 . The method according to claim 3 , wherein the region is part of a display and wherein the second metric is any parameter of: cursor position and/or cursor click; and

wherein the cursor position and/or cursor click is determined in relation to the region of the display.

5 . The method according to claim 1 , comprising the step of:

correlating the parameter of pupil diameter with a diameter of the eye openness, in order to determine mental workload of the user while looking at the region and the stimulus.

6 . The method according to claim 1 , comprising the steps of:

detecting hotspots in each heatmap generated in the previous steps; and

predicting which second metric has the highest probability for pattern identification based on the detected hotspots.

7 . The method according to claim 1 , comprising the step of performing any of the above steps for at least a second region and/or at least a second stimulus.

8 . A system comprising a processor, a camera and a computer readable storage medium, the computer readable storage medium comprising instructions executable by the processor operative to:

define a region that is to be analysed;

receive an input in the form of a stimulus whereby the stimulus is positioned within the region;

determine a first gaze metric comprising gaze point data and gaze duration data of the user, the first gaze metric being determined in relation to the region comprising the stimulus and over a duration of time;

determine a second metric related to the user, said second metric comprising data different from the first gaze metric, the second metric being determined in relation to the region comprising the stimulus and over a duration of time, wherein the second metric is at least one parameter of pupil diameter, eye openness, saccade start positions, saccade stop positions, saccade peak velocity positions, saccade peak velocities, a start position of a first saccade and/or a start position of a last saccade or a stop position of a first saccade and/or a stop position of a last saccade;

divide the region into a plurality of sections;

process data related to the first gaze metric and the second metric by allocating values to the sections, so that a heatmap can be generated based on these allocated values and the sections; map the processed data to the plurality of sections for visualization in a heatmap; and

store a separate heatmap for each of the parameters of the second metric on a computer readable storage medium for analysis purposes.

9 . The system according to claim 8 , wherein the defined region that is to be analysed is part of a display external to the eye tracking system and each section corresponds to a pixel of the display and wherein the first gaze metric and the second metric are determined in relation to each pixel of the display.

10 . A head mounted device comprising a system according to claim 8 .

11 . The head mounted device according to claim 10 , further comprising a display.

12 . A non-transitory computer readable storage medium comprising a computer program, comprising instructions which, when executed by a processor, cause the processor to:

define a region that is to be analysed;

receive an input in the form of a stimulus whereby the stimulus is positioned within the region;

determine a first gaze metric comprising gaze point data and gaze duration data of the user, the first gaze metric being determined in relation to the region comprising the stimulus and over a duration of time;

determine a second metric related to the user, said second metric comprising data different from the first gaze metric, the second metric being determined in relation to the region comprising the stimulus and over a duration of time, wherein the second metric is at least one parameter of pupil diameter, eye openness, saccade start positions, saccade stop positions, saccade peak velocity positions, saccade peak velocities, a start position of a first saccade and/or a start position of a last saccade or a stop position of a first saccade and/or a stop position of a last saccade;

divide the region into a plurality of sections;

process data related to the first gaze metric and the second metric by allocating values to the sections, so that a heatmap can be generated based on these allocated values and the sections;

map the processed data to the plurality of sections for visualization in a heatmap; and

store a separate heatmap for each of the parameters of the second metric on a computer readable storage medium for analysis purposes.

Assignments (1)

Continuity (1)

References Cited (17)