SYSTEM FOR GAZE INTERACTION
A method and system for assisting a user when interacting with a graphical user interface combines gaze based input with gesture based user commands. A user of a computer system without a traditional touch-screen can interact with graphical user interfaces in a touch-screen like manner using a combination of gaze based input and gesture based user commands. A solution for touch-screen like interaction uses gaze input and gesture based input as a complement or an alternative to touch-screen interactions with a computer device having a touch-screen. Combined gaze and gesture based interaction with graphical user interfaces can be used to achieve a touchscreen like environment in computer systems without a traditional touchscreen or in computer systems having a touchscreen arranged ergonomically unfavorable for the user or a touchscreen arranged such that it is more comfortable for the user to use gesture and gaze for the interaction than the touchscreen.
1 . A system for generating gesture based commands during user interaction with an information presentation area, the system comprising:
a processor; and
a memory storing computer-readable instructions that, upon execution by the processor, configure the system to:
receive gaze data from a gaze tracking module, the gaze data indicating a gaze point of a user on the information presentation area;
receive, from an input device, first user gesture data;
determine, based on the first user gesture data and the gaze data, a gaze point area on the information presentation area, the gaze point area including the gaze point;
receive, from the input device, second user gesture data, the second user gesture data received subsequently to receiving the first user gesture data and while the user gaze data are received; and
execute at least one user action manipulating the gaze point area based on the second user gesture data, the user action comprising resizing the gaze point area to generate an updated gaze point area, the updated gaze point area including the gaze point and overlapping with the gaze point area.