Computing device accessibility via eye tracking
A method is disclosed for providing increased accessibility for users of a computing device. The method may include analyzing content on a display device to identify a plurality of interactive elements most likely to be interacted with. The method may also include causing each of the plurality of interactive elements to be highlighted in a different manner. The method may additionally include causing a plurality of graphical elements to be displayed, where each of the plurality of graphical elements may be associated with a different interactive element and may visually correspond with highlighting of its associated interactive element. The method may moreover include determining a location of the user's gaze on the display device and causing a particular interactive element to be activated, based at least in part on the user gazing at its associated graphical element, where activation of the particular interactive element causes display of new content.
1. A method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device, the method comprising:
analyzing, with one or more processors, content displayed on a display device to identify a plurality of interactive elements most likely to be interacted with by a user, wherein a plurality of primary indicators is associated with the plurality of interactive elements, each of the primary indicators being associated with a different interactive element;
causing, with the one or more processors, each of the plurality of interactive elements to be highlighted in a different manner;
determining, with at least an eye tracking device, a location of the user's gaze on the display device,
causing, with the one or more processors, a gaze indicator shape to be displayed at the location of the user's gaze;
causing, with the one or more processors, a primary indicator to be displayed on the display device upon the user nearing an interactive element with the gaze indicator shape, and locating the gaze indicator shape at least partially over the interactable element, wherein: and
each of the primary indicators visually corresponds with highlighting of its associated interactive element;
causing, with the one or more processors, a secondary indicator to appear on the interactable element, wherein the secondary indicator informs the user that the interactive element will be activated if the location of the gaze remains on the interactive element.
2. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein causing the particular interactive element to be activated is further based at least in part on:
the user gazing at the interactive element for at least a predefined length of time.
3. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 2 , wherein:
the predefined time varies based at least in part on what action is caused by the particular interactive element.
4. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein causing the particular interactive element to be activated is further based at least in part on:
a non-gaze input being received at a non-gaze input device while the user is gazing at the particular interactive element.
5. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein a manner of highlighting of the particular interactive element is based at least in part on:
content of the particular interactive element.
6. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein a manner of highlighting of the particular interactive element is based at least in part on:
content displayed on the display device upon activation of the particular element.
7. A system for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device, the system comprising:
a display device configured to display content to a user;
an eye tracking device configured to determine a location of a user's gaze on a display device;
one or more processors configured to:
analyze content displayed on the display device to identify a plurality of interactive elements most likely to be interacted with by the user, wherein a plurality of primary indicators is associated with the plurality of interactive elements, each of the primary indicators being associated with a different interactive element;
cause each of the plurality of interactive elements to be highlighted in a different manner;
cause a gaze indicator shape to be displayed at the location of the user's gaze;
cause a primary indicator to be displayed upon the user nearing an interactive element with the gaze indicator shape, and locating the gaze indicator shape at least partially over the interactable element,
cause a secondary indicator to appear on the interactable element, wherein the secondary indicator informs the user that the interactive element will be activated if the location of the gaze remains on the interactive element.
8. The system for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 7 , wherein causing the particular interactive element to be activated is further based at least in part on:
the user gazing at the interactive element for at least a predefined length of time.
9. A non-transitory machine readable medium having instructions stored thereon for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device, wherein the instructions are executable by one or more processors to perform operations comprising:
analyzing content displayed on a display device to identify a plurality of interactive elements most likely to be interacted with by a user, wherein a plurality of primary indicators is associated with the plurality of interactive elements, each of the primary indicators being associated with a different interactive element;
causing each of the plurality of interactive elements to be highlighted in a different manner;
determining, using an eye tracking device, a location of the user's gaze on the display device;
causing a of a primary indicator to be displayed on the display device upon the user nearing an interactive element with the gaze indicator shape, and locating the gaze indicator shape at least partially over the interactable element, wherein:
causing, with the one or more processors, a secondary indicator to appear on the interactable element, wherein the secondary indicator informs the user that the interactive element will be activated if the location of the gaze remains on the interactive element.
10. The non-transitory machine readable medium having instructions stored thereon for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 9 , wherein causing the particular interactive element to be activated is further based at least in part on:
the user gazing at the interactive element for at least a predefined length of time.
11. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein the secondary indicator changes in size signaling to the user how much time is available to decide not to activate the interactable element by moving their gaze away from the interactable element.
12. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein the secondary indicator is a dynamic graphical bar which displays the total dwell time required upon a user's gaze first lying on an interactable element, and then slowly changes color from left to right based on the amount of elapsed dwell time necessary for the interactable element to be activated.
13. The method for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device of claim 1 , wherein the gaze indicator shape is zoom-able so that the size of the content within the snap-to indicator shape is more easily viewable to the user.
14. The system for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device according to claim 7 , wherein the secondary indicator changes in size signaling to the user how much time is available to decide not to activate the interactable element by moving their gaze away from the interactable element.
15. The system for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device according to claim 7 , wherein the secondary indicator is a dynamic graphical bar which displays the total dwell time required upon a user's gaze first lying on an interactable element, and then slowly changes color from left to right based on the amount of elapsed dwell time necessary for the interactable element to be activated.
16. The system for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device according to claim 7 , wherein the gaze indicator shape is zoom-able so that the size of the content within the snap-to indicator shape is more easily viewable to the user.
17. A non-transitory machine readable medium having instructions stored thereon for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device according to claim 9 , wherein the secondary indicator changes in size signaling to the user how much time is available to decide not to activate the interactable element by moving their gaze away from the interactable element.
18. A non-transitory machine readable medium having instructions stored thereon for providing increased accessibility for users of interactive displayed content on a computing device and executing commands from these users on the computing device according to claim 9 , wherein the secondary indicator is a dynamic graphical bar which displays the total dwell time required upon a user's gaze first lying on an interactable element, and then slowly changes color from left to right based on the amount of elapsed dwell time necessary for the interactable element to be activated.