ARRANGEMENT, METHOD AND COMPUTER PROGRAM FOR CONTROLLING A COMPUTER APPARATUS BASED ON EYE-TRACKING
A computer apparatus is associated with a graphical display presenting at least one GUI-component adapted to be manipulated based on user-generated commands. An event engine is adapted to receive an eye-tracking data signal that describes a user's point of regard on the display. Based on the signal, the event engine produces a set of non-cursor controlling event output signals, which influence the at least one GUI-component. Each non-cursor controlling event output signal describes a particular aspect of the user's ocular activity in respect of the display. Initially, the event engine receives a control signal request from each of the at least one GUI-component. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.
1 . An arrangement for controlling a computer apparatus associated with a graphical display, the graphical display displaying a representation of at least one GUI-component, the arrangement comprising:
an event engine configured to receive both an eye-tracking data signal describing a user's point of regard on the display and at least one auxiliary input signal, and configured to produce a non-cursor controlling event based on a combination of the eye-tracking data signal and the at least one auxiliary input signal,
wherein the non-cursor controlling event causes the computer apparatus to alter the display of the at least one GUI-component.
2 . The arrangement according to claim 1 , wherein the auxiliary input signal originates from a button, a switch, a speech signal, eye-tracking data, a movement pattern of an input member, a camera registered gesture pattern, a camera image, a keyboard signal, a mouse signal, a facial expression or an EEG-signal.
3 . The arrangement according to claim 2 , wherein the non-cursor controlling event indicates an estimated intention of the user.
4 . The arrangement according to claim 3 , wherein the display of the at least one GUI-component is manipulated to match the estimated intention of the user.
5 . The arrangement according to claim 3 , wherein the estimated intention of the user is determined based on the eye-tracking data.
6 . The arrangement according to claim 5 , wherein the estimated intention of the user is determined based on gaze patterns and fixation times of the user's point of regard.
7 . The arrangement according to claim 6 , wherein the display of the at least one GUI-component is manipulated to match the estimated intention of the user.
8 . The arrangement according to claim 2 , wherein the non-cursor controlling event indicates an estimated attention level of the user.
9 . The arrangement according to claim 8 , wherein the display of the at least one GUI-component is manipulated to match the estimated attention level of the user.
10 . The arrangement according to claim 8 , wherein the non-cursor controlling event is produced based solely on the eye-tracking data.
11 . The arrangement according to claim 10 , wherein the estimated attention level of the user is determined based on at least one of gaze patterns, fixation points and fixation times of the user's point of regard.
12 . The arrangement according to claim 11 , wherein the display of the at least one GUI-component is manipulated to match the estimated attention level of the user.
13 . A method for controlling a computer apparatus associated with a graphical display, the graphical display displaying a representation of at least one GUI-component, the method comprising:
receiving, by an event engine, both an eye-tracking data signal describing a user's point of regard on the display and at least one auxiliary input signal; and
producing, by the event engine, a non-cursor controlling event based on a combination of the eye-tracking data signal and the at least one auxiliary input signal,
wherein the non-cursor controlling event causes the computer apparatus to alter the display of the at least one GUI-component.
14 . The method according to claim 13 , wherein the auxiliary input signal originates from a button, a switch, a speech signal, eye-tracking data, a movement pattern of an input member, a camera registered gesture pattern, a camera image, a keyboard signal, a mouse signal, a facial expression or an EEG-signal.
15 . The method according to claim 14 , wherein the non-cursor controlling event indicates an estimated intention of the user.
16 . The method according to claim 15 , further comprising manipulating the display of the at least one GUI-component to match the estimated intention of the user.
17 . The method according to claim 15 , wherein the estimated intention of the user is determined based on the eye-tracking data.
18 . The method according to claim 17 , wherein the estimated intention of the user is determined based on gaze patterns and fixation times of the user's point of regard.
19 . The method according to claim 18 , further comprising manipulating the display of the at least one GUI-component to match the estimated intention of the user.
20 . The method according to claim 14 , wherein the non-cursor controlling event indicates an estimated attention level of the user.
21 . The method according to claim 20 , further comprising manipulating the display of the at least one GUI-component to match the estimated attention level of the user.
22 . The method according to claim 20 , wherein the non-cursor controlling event is produced based solely on the eye-tracking data.
23 . The method according to claim 22 , wherein the estimated attention level of the user is determined based on at least one of gaze patterns, fixation points and fixation times of the user's point of regard.
24 . The method according to claim 23 , further comprising manipulating the display of the at least one GUI-component to match the estimated attention level of the user.
25 . A non-transitory computer readable medium containing a computer program product for controlling a computer apparatus associated with a graphical display, the graphical display displaying a representation of at least one GUI-component, the computer program product comprising computer-executable instructions for:
receiving, by an event engine, both an eye-tracking data signal describing a user's point of regard on the display and at least one auxiliary input signal; and
producing, by the event engine, a non-cursor controlling event based on a combination of the eye-tracking data signal and the at least one auxiliary input signal,
wherein the non-cursor controlling event causes the computer apparatus to alter the display of the at least one GUI-component.
26 . The non-transitory computer readable medium according to claim 25 , wherein the auxiliary input signal originates from a button, a switch, a speech signal, eye-tracking data, a movement pattern of an input member, a camera registered gesture pattern, a camera image, a keyboard signal, a mouse signal, a facial expression or an EEG-signal.
27 . The non-transitory computer readable medium according to claim 26 , wherein the non-cursor controlling event indicates an estimated intention of the user.
28 . The non-transitory computer readable medium according to claim 27 , wherein the computer program product further comprises computer-executable instructions for manipulating the display of the at least one GUI-component to match the estimated intention of the user.
29 . The non-transitory computer readable medium according to claim 27 , wherein the estimated intention of the user is determined based on the eye-tracking data.
30 . The non-transitory computer readable medium according to claim 29 , wherein the estimated intention of the user is determined based on gaze patterns and fixation times of the user's point of regard.
31 . The non-transitory computer readable medium according to claim 30 , wherein the computer program product further comprises computer-executable instructions for manipulating the display of the at least one GUI-component to match the estimated intention of the user.
32 . The non-transitory computer readable medium according to claim 26 , wherein the non-cursor controlling event indicates an estimated attention level of the user.
33 . The non-transitory computer readable medium according to claim 32 , wherein the computer program product further comprises computer-executable instructions for manipulating the display of the at least one GUI-component to match the estimated attention level of the user.
34 . The non-transitory computer readable medium according to claim 32 , wherein the non-cursor controlling event is produced based solely on the eye-tracking data.
35 . The non-transitory computer readable medium according to claim 34 , wherein the estimated attention level of the user is determined based on at least one of gaze patterns, fixation points and fixation times of the user's point of regard.
36 . The non-transitory computer readable medium according to claim 35 , wherein the computer program product further comprises computer-executable instructions for manipulating the display of the at least one GUI-component to match the estimated attention level of the user.