System and method for intelligent accessible graphical user interfaces
A system and method for arranging computerized graphical elements on a user interface, including: detecting attributes of a user in visual data (e.g., using machine learning based object and/or movement detection techniques), and arranging graphical elements within a graphical user interface (GUI) based on the detected attributes. In some embodiments, arranging graphical elements may include determining a size and/or a location within the GUI for graphical elements in order to accommodate accessibility needs of the user, including, e.g., height, motor control, dominant hand, whether the user is in a wheelchair, and the like. In some embodiments, arranging graphical elements may be performed without displacing a display, screen, or display presenting the GUI.
1 . A method for arranging computerized graphical elements on a user interface comprising, using one or more computer processors:
detecting one or more attributes of a user in visual data, wherein the one or more attributes comprise: a dominant hand of the user, and whether the user is in a wheelchair; and
arranging a graphical user interface (GUI) comprising one or more graphical elements based on one or more of the detected attributes,
wherein the arranging of the GUI comprises determining, by a supervised machine learning algorithm, a placement for the one or more graphical elements, wherein the supervised machine learning algorithm comprises training a machine learning model using a dataset mapping user attributes to placement parameters, the placement parameters describing a placement within the GUI,
wherein the arranging of the GUI comprises determining a placement for the GUI as a whole, wherein the GUI is displayed on a vertically oriented monitor, the monitor being at least 60 centimeters long in a vertical dimension, and
wherein the arranging of the GUI is performed without displacing the vertically oriented monitor.
2 . The method of claim 1 , wherein the attributes describe an interaction of the user with the GUI.
3 . The method of claim 1 , wherein the one or more attributes comprise: a height of the user, and a motor ability of the user.
4 . The method of claim 1 , wherein the arranging of the GUI comprises determining one or more of: a size within the GUI for one or more of the graphical elements, and a location within the GUI for one or more of the graphical elements.
5 . The method of claim 1 , wherein one or more of: the detecting of the one or more attributes, and the arranging of the GUI is performed when the user approaches the GUI.
6 . The method of claim 1 , wherein the arranging of the GUI is performed without displacing a display element comprising the GUI.
7 . The method of claim 1 , wherein the arranging of the GUI comprises determining, by a supervised machine learning algorithm, an arrangement for the one or more graphical elements.
8 . A computerized system for arranging graphical elements on a user interface comprising:
a vertically oriented monitor, the monitor being at least 60 centimeters long in a vertical dimension;
a memory; and
one or more processors configured to:
detect one or more attributes of a user in visual data, wherein the one or more attributes comprise: a dominant hand of the user, and whether the user is in a wheelchair; and
arrange a graphical user interface (GUI) comprising one or more graphical elements based on one or more of the detected attributes,
wherein the arranging of the GUI comprises determining, by a supervised machine learning algorithm, a placement for the one or more graphical elements, wherein the supervised machine learning algorithm comprises training a machine learning model using a dataset mapping user attributes to placement parameters, the placement parameters describing a placement within the GUI,
wherein the arranging of the GUI comprises determining a placement for the GUI as a whole, wherein the GUI is displayed on the vertically oriented monitor, and
wherein the arranging of the GUI is performed without displacing the vertically oriented monitor.
9 . The system of claim 8 , wherein the attributes describe an interaction of the user with the GUI.
10 . The system of claim 8 , wherein the one or more attributes comprise: a height of the user, and a motor ability of the user.
11 . The system of claim 8 , wherein the arranging of the GUI comprises determining one or more of: a size within the GUI for one or more of the graphical elements, and a location within the GUI for one or more of the graphical elements.
12 . The system of claim 8 , wherein one or more of: the detecting of the one or more attributes, and the arranging of the GUI is performed when the user approaches the GUI.
13 . The system of claim 8 , wherein the arranging of the GUI is performed without displacing a display element comprising the GUI.
14 . The system of claim 8 , wherein the arranging of the GUI comprises determining, by a supervised machine learning algorithm, an arrangement for the one or more graphical elements.
15 . A method for arranging computerized graphical items on a display comprising, using one or more computer processors:
measuring one or more features of a user in image data, wherein the one or more features comprise: a dominant hand of the user, and whether the user is in a wheelchair; and
placing a graphical user interface (GUI) comprising one or more graphical items within a display based on one or more of the measured features,
wherein the placing of the GUI comprises determining, by a supervised machine learning algorithm, a placement for the one or more graphical elements, wherein the supervised machine learning algorithm comprises training a machine learning model using a dataset associating features with placement values, the placement values describing a placement within the GUI,
wherein the placing of the GUI comprises determining a placement for the GUI as a whole, wherein the display comprises a vertically oriented screen, the screen being at least 60 centimeters long in a vertical dimension, and wherein the placing of the GUI is performed without displacing the display.
16 . The method of claim 15 , wherein one or more of the features describe an interaction of the user with the display.
17 . The method of claim 15 , wherein the placing of the GUI comprises computing one or more of: a size within the display for one or more of the graphical items, and a location within the display for one or more of the graphical items.
18 . The method of claim 15 , wherein one or more of: the measuring of the one or more features, and the placing of the GUI is performed when the user approaches the display.
19 . The method of claim 15 , wherein the placing of the GUI is performed without displacing a display element comprising the GUI.
20 . The method of claim 15 , wherein the placing of the GUI comprises determining, by the machine learning model, the placement for the one or more graphical items.