Auto-completion for user interface design
View Patent ↗Techniques for automatically completing a partially completed UI design created by a user are described. A UI query including attributes of UI components in the partially completed UI design is created. Design examples with similar UI components are identified. UI components of one such design example are displayed to automatically complete the partially completed UI design (also called an “auto-complete suggestion”). The user can systematically navigate the design examples and accept auto-completed suggestions to include into the partially complete UI design.
1. A computer-implemented method of providing suggestions for automatically completing an incomplete user interface (UI), comprising:
determining attributes of UI components in a plurality of design examples;
receiving a UI query for automatically generating a design for the incomplete UI, the UI query comprising information about a first set of UI components in the incomplete UI; and
in response to receiving the UI query, identifying, based at least in part on the determined attributes of UI components, a design example in the plurality of design examples, the design example comprising a second set of UI components similar to the first set of UI components and a proposed UI component for proposed inclusion in the incomplete UI design.
2. The method of claim 1 , wherein identifying the design example comprises:
for each of a subset of the plurality of design examples, comparing a transformation cost corresponding to the second set of UI components with a threshold value.
3. The method of claim 2 , wherein the transformation cost includes a cost associated with adding a UI component to the second set.
4. The method of claim 2 , wherein the transformation cost includes a cost associated with deleting a UI component from the second set.
5. The method of claim 2 , wherein the transformation cost includes a cost associated with geometrically transforming a UI component in the second set to make it substantially identical to a UI component in the first set.
6. The method of claim 5 , wherein the cost associated with geometrically transforming a UI component comprises as cost associated with translating the UI component and a cost associated with scaling the UI component.
7. The method of claim 1 , further comprising providing the design example for display in response to the UI query.
8. A non-transient computer readable storage medium containing computer executable instructions for automatically completing an incomplete user interface (UI), wherein execution of the instructions cause one or more computers to perform operations comprising:
determining attributes of UI components in a plurality of design examples;
receiving a UI query for automatically generating a design for the incomplete UI, the UI query comprising information about a first set of UI components in the incomplete UI; and
in response to receiving the UI query, identifying, based at least in part on the determined attributes of the UI components, a design example in the plurality of design examples, the design example comprising a second set of UI components similar to the first set of UI components and a proposed UI component for proposed inclusion in the incomplete UI design.
9. The computer readable storage medium of claim 8 , wherein identifying the design example comprises:
for each of a subset of the plurality of design examples, comparing a transformation cost corresponding to the second set of UI components with a threshold value.
10. The computer readable storage medium of claim 9 , wherein the transformation cost includes a cost associated with adding a UI component to the second set.
11. The computer readable storage medium of claim 9 , wherein the transformation cost includes a cost associated with deleting a UI component from the second set.
12. The computer readable storage medium of claim 9 , wherein the transformation cost includes a cost associated with geometrically transforming a UI component in the second set to make it substantially identical to a UI component in the first set.
13. The computer readable storage medium of claim 12 , wherein the cost associated with geometrically transforming a UI component comprises as cost associated with translating the UI component and a cost associated with scaling the UI component.
14. The computer readable storage medium of claim 8 , wherein the instructions cause one or more computers to perform operations further comprising providing the design example for display in response to the UI query.
15. A system for automatically completing an incomplete user interface (UI), comprising:
a data store storing instructions; and
one or more computers that interact with the data store and execute the instructions, wherein execution of the instructions cause the one or more computers to perform operations comprising:
determining attributes of UI components in a plurality of design examples;
receiving a UI query for automatically generating a design for the incomplete UI, the UI query comprising information about a first set of UI components in the incomplete UI; and
in response to receiving the UI query, identifying, based at least in part on the determined attributes of UI components, a design example in the plurality of design examples, the design example comprising a second set of UI components similar to the first set of UI components and a proposed UI component for proposed inclusion in the incomplete UI design.
16. The system of claim 15 , wherein identifying the design example comprises:
for each of a subset of the plurality of design examples, comparing a transformation cost corresponding to the second set of UI components with a threshold value.
17. The system of claim 16 , wherein the transformation cost includes a cost associated with adding a UI component to the second set.
18. The system of claim 16 , wherein the transformation cost includes a cost associated with deleting a UI component from the second set.
19. The system of claim 16 , wherein the transformation cost includes a cost associated with geometrically transforming a UI component in the second set to make it substantially identical to a UI component in the first set.
20. The system of claim 19 , wherein the cost associated with geometrically transforming a UI component comprises as cost associated with translating the UI component and a cost associated with scaling the UI component.