Method and system for creating a free-form visual user interface element

1. A method of comprising:

facilitating a display, by a computing system, of a user interface including a free-form visual element and a plurality of graphical user interface (GUI) controls, wherein each GUI control of the plurality of GUI controls is associated with a GUI control type, and wherein each GUI control includes one or more GUI controller attributes that define a functional property that is implemented at runtime;

receiving, by the computing system, input indicative of a selection a GUI control of the plurality of GUI controls to associate with the free-form visual element;

generating, by the computing system, executable instructions from a generic code template, wherein the executable instructions define at least one of the one or more GUI controller attributes of the selected GUI control;

adapting, by the computing system, the executable instructions to a data structure representing the free-form visual element by replacing one or more tagged attributes of the executable instructions with generated code specific to the free-form visual element; and

attaching, by the computing system, the adapted executable instructions to the data structure representing the free-form visual element to create a user interface element,

wherein the user interface element has the same visual appearance as the free-form visual element associated with the selected GUI control, wherein the user interface element is configured to execute, at runtime, the adapted executable instructions to implement the functional property associated with the selected GUI control.

2. The method of claim 1 , further comprising defining at least one gesture that is indicative of the selection of the GUI control.

3. The method of claim 2 , wherein the at least one gesture includes a drag-and-drop gesture.

4. The method of claim 1 , wherein the one or more GUI controller attributes comprises accessibility functions supporting interaction with an accessibility framework as a control of the GUI control type.

5. The method of claim 1 , wherein the free-form visual element is associated with a node of a scene graph.

6. The method of claim 1 , wherein the one or more GUI controller attributes includes an accessible name, an accessible role, and accessible state information.

7. The method of claim 1 , wherein the GUI control includes one of a button control GUI control, a slider control GUI control, a tab control GUI control, a checkbox control GUI control, or a combo-box control GUI control.

8. The method of claim 1 , wherein the user interface is configured to generate a visual program, and wherein the free-form visual element is one of a bitmap image or a vector image.

9. A system comprising:

one or more processors; and

one or more non-transitory computer readable storage mediums containing instructions which when executed on the one or more processors, cause the one or more processors to perform operations including:

facilitating a display of a user interface including a free-form visual element and a plurality of graphical user interface (GUI) controls, wherein each GUI control of the plurality of GUI controls is associated with a GUI control type, and wherein each GUI control includes one or more GUI controller attributes that define a functional property that is implemented at runtime;

receiving input indicative of a selection a GUI control of the plurality of GUI controls to associate with the free-form visual element;

generating executable instructions from a generic code template, wherein the executable instructions define at least one of the one or more GUI controller attributes of the selected GUI control;

adapting the generated executable instructions to a data structure representing the free-form visual element by replacing one or more tagged attributes of the executable instructions with generated code specific to the free-form visual element; and

attaching the adapted executable instructions to the data structure representing the free-form visual element to create a free-form visual user interface element, wherein the free-form user interface element has the same visual appearance as the free-form visual element associated with the selected GUI control, wherein the free-form user interface element is configured to execute, at runtime, the adapted executable instructions to implement the functional property associated with the selected GUI control.

10. The system of claim 9 , wherein the operations further include:

defining at least one gesture that is indicative of the selection of the GUI control.

11. The system of claim 10 , wherein the at least one gesture includes a drag and drop gesture.

12. The system of claim 9 , wherein the one or more GUI controller attributes comprises an accessibility function supporting interaction with an accessibility framework as a control of the GUI control type.

13. The system of claim 9 , wherein the free-form visual element comprises a node in a scene graph.

14. A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause one or more processors to perform actions including:

facilitating a display, by a computing system, of a user interface including a free-form visual element and a plurality of graphical user interface (GUI) controls, wherein each GUI control includes one or more GUI controller attributes that define a functional property of the GUI control executes at runtime, wherein each GUI control of the plurality of GUI controls is associated with a user interface control type, and wherein the free-form visual element is represented as a node in a scene graph;

receiving, by the computing system, input indicative of a selection of a GUI control of the plurality of GUI controls;

generating, by the computing system, executable instructions from a generic code template, wherein the executable instructions define GUI controller attributes of the selected GUI control;

adapting, by the computing system, the executable instructions to a data structure representing the free-form visual element by replacing tagged attributes of the executable instructions with generated code specific to the free-form visual element; and

attaching, by the computing system, the adapted executable instructions to the data structure representing the free-form visual element to create a visual user interface element, wherein the free-form user interface element has the same visual appearance as the free-form visual element associated with the selected GUI control, wherein the free-form user interface element is configured to execute, at runtime, the adapted executable instructions to implement the functional property associated with the selected GUI control.

15. The computer-program product of claim 14 , wherein the actions further include defining at least one gesture that is indicative of the selection of the GUI control.

16. The computer-program product of claim 15 , wherein the gesture includes a drag and drop gesture.

17. The computer-program product of claim 14 , wherein a set of GUI controller attributes defining the GUI control comprises accessibility functions supporting interaction with an accessibility framework as a control of the user interface control type.

18. The computer-program product of claim 14 , wherein the scene graph comprises multiple nodes in a tree data structure, and wherein operations executed on a parent node of the scene graph are executed on child nodes of the parent node.