Generating and editing user interfaces via chat
Systems, methods and non-transitory computer readable media for generating and editing user interfaces via chat and/or sketches are provided. A first textual input and/or sketch associated with a desire to modify a design of a user interface may be received. The first textual input and/or sketch may be analyzed to determine at least one change to the first version of the design. The at least one change may be associated with a level. The determined at least one change may be implemented to generate a second version of the design. The second version may be associated with the level. A second textual input and/or sketch associated with a desire to adjust the level may be received. The second textual input and/or sketch may be analyzed to generate a third version of the design. The third version may be associated with an adjusted level.
1 . A non-transitory computer readable medium storing computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for generating and editing user interfaces via chat, the operations comprising:
receiving digital data associated with a first version of a design of a user interface;
using the digital data to cause a first presentation of the user interface to an individual, the first presentation is based on the first version of the design;
receiving from the individual a first input in a natural language, the first input is associated with a desire of the individual to modify the design of the user interface;
analyzing the first input to determine at least one change to the first version of the design of the user interface, wherein the at least one change is associated with a level of density of user interface elements of the user interface;
implementing the determined at least one change to generate a second version of the design of the user interface, the second version is associated with the level of density of the user interface elements;
causing a second presentation of the user interface to the individual, the second presentation is based on the generated second version of the design;
receiving from the individual a second input in the natural language, the second input is associated with a desire of the individual to adjust the level of density of the user interface elements;
analyzing the second input to generate a third version of the design of the user interface, the third version is associated with an adjusted level of density of the user interface elements, wherein a numerical value associated with the adjusted level of density is determined by calculating a function of a numerical value associated with the level of density and a mathematical object based on the second input; and
causing a third presentation of the user interface to the individual, the third presentation is based on the generated third version of the design.
2 . The non-transitory computer readable medium of claim 1 , wherein the level is further associated with an opacity of a background of the user interface.
3 . The non-transitory computer readable medium of claim 1 , wherein the second input includes an adjective, the mathematical object is based on the adjective, and the operations further comprise determining whether to increase or decrease the level based on the adjective.
4 . The non-transitory computer readable medium of claim 1 , wherein the second input includes a verb, the mathematical object is based on the verb, and the operations further comprise determining whether to increase or decrease the level based on the verb.
5 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
halting the second presentation of the user interface;
after halting the second presentation of the user interface and presenting the third presentation, receiving from the individual a third input in the natural language, the third input is associated with a desire of the individual to undo the adjustment; and
in response to the third input, halting the third presentation and resuming the presentation of the user interface based on the generated second version of the design to restore the level while maintaining the implemented at least one change.
6 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
receiving from the individual a third input in the natural language, the third input is associated with a desire of the individual to moderate the adjustment;
analyzing the third input to generate a fourth version of the design of the user interface, the fourth version is associated with an intermediate level of density of the user interface elements between the level of density of the user interface elements and the adjusted level of density of the user interface elements, wherein the intermediate level of density is a value distinct from the level of density and the adjusted level of density; and
causing a fourth presentation of the user interface to the individual, the fourth presentation is based on the generated fourth version of the design.
7 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise using a multimodal machine learning model to analyze the first input to determine the at least one change to the first version of the design of the user interface.
8 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
identifying a first mathematical object in a mathematical space, the first mathematical object corresponds to a first word of the first input;
identifying a second mathematical object in the mathematical space, the second mathematical object corresponds to a second word of the first input;
calculating a function of the first mathematical object and the second mathematical object to obtain a third mathematical object in the mathematical space; and
determining the numerical value associated with the level of density based on the third mathematical object.
9 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
identifying a first mathematical object in a mathematical space, the first mathematical object corresponds to a word of the first input;
identifying a second mathematical object in the mathematical space, the second mathematical object corresponds to a word of the second input;
calculating a function of the first mathematical object and the second mathematical object to obtain a third mathematical object in the mathematical space; and
determining the numerical value associated with the adjusted level of density based on the third mathematical object.
10 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise presenting a numerical indication of the level of density of the user interface elements with the second presentation, and presenting a numerical indication of the adjusted level of density of the user interface elements that is automatically determined by the analyzing of the second input with the third presentation.
11 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise;
analyzing the first input to determine the numerical value associated with the level of density;
identifying a first mathematical object in a mathematical space, the first mathematical object corresponds to a word of the second input;
calculating a function of the first mathematical object and the numerical value associated with the level of density to obtain a second mathematical object in the mathematical space; and
determining the numerical value associated with the adjusted level of density based on the second mathematical object.
12 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
receiving a third input in the natural language from the individual after the third presentation, the third input comprising an interjection;
analyzing the interjection to determine a degree of success of the adjusted level of density; and
in response to the degree of success indicating displeasure with the adjusted level of density, automatically generating a fourth version of the design of the user interface.
13 . The non-transitory computer readable medium of claim 1 , wherein the user interface includes a webpage.
14 . The non-transitory computer readable medium of claim 1 , wherein the user interface is a user interface of an app.
15 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:
receiving a sketch from the individual, the sketch is associated with the desire of the individual to modify the design of the user interface; and
analyzing the first input and the sketch to determine the numerical value associated with the level of density.
16 . The non-transitory computer readable medium of claim 15 , wherein the sketch includes a plurality of pixel values, and the operations further comprise:
calculating a convolution of at least part of the pixel values of the sketch to obtain a result value;
identifying a first mathematical object in the mathematical space, the first mathematical object corresponds to a word of the first input;
calculating a function of the result value and the first mathematical object to obtain a second mathematical object in the mathematical space; and
basing the determination of the numerical value associated with the level of density on the second mathematical object.
17 . The non-transitory computer readable medium of claim 1 , wherein the at least one change is associated with an additional level, and the operations further comprise:
analyzing the second input to determine whether to adjust the additional level; and
basing the generation of the third version of the design of the user interface on the determination of whether to adjust the additional level, wherein when the determination is to adjust the additional level, the third version is associated with the adjusted level and an adjusted additional level, and when the determination is not to adjust the additional level, the third version is associated with the adjusted level and the additional level, wherein the determination not to adjust the additional level is based on identifying that the second input specifically identifies an attribute associated with the level and does not identify an attribute associated with the additional level.
18 . The non-transitory computer readable medium of claim 17 , wherein the second input includes an adjective, the adjective identifies an attribute associated with the level, and the determination not to adjust the additional level is based on the adjective identifying an attribute associated with the level and not identifying an attribute associated with the additional level.
19 . The non-transitory computer readable medium of claim 17 , wherein the second input includes a noun, the noun identifies an attribute associated with the additional level, and the determination to adjust the additional level is based on the noun is based on the noun identifying the attribute associated with the additional level.
20 . A system for generating and editing user interfaces via chat, the system comprising: at least one processing unit configured to perform operations, the operations comprise:
receiving digital data associated with a first version of a design of a user interface;
using the digital data to cause a first presentation of the user interface to an individual, the first presentation is based on the first version of the design;
receiving from the individual a first input in a natural language, the first input is associated with a desire of the individual to modify the design of the user interface;
analyzing the first input to determine at least one change to the first version of the design of the user interface, wherein the at least one change is associated with a level of density of user interface elements of the user interface;
implementing the determined at least one change to generate a second version of the design of the user interface, the second version is associated with the level of density of the user interface elements;
causing a second presentation of the user interface to the individual, the second presentation is based on the generated second version of the design;
receiving from the individual a second input in the natural language, the second input is associated with a desire of the individual to adjust the level of density of the user interface elements;
analyzing the second input to generate a third version of the design of the user interface, the third version is associated with an adjusted level of density of the user interface elements, wherein a numerical value associated with the adjusted level of density is determined by calculating a function of a numerical value associated with the level of density and a mathematical object based on the second input; and
causing a third presentation of the user interface to the individual, the third presentation is based on the generated third version of the design.
21 . A method for generating and editing user interfaces via chat, the method comprising:
receiving digital data associated with a first version of a design of a user interface;
using the digital data to cause a first presentation of the user interface to an individual, the first presentation is based on the first version of the design;
receiving from the individual a first input in a natural language, the first input is associated with a desire of the individual to modify the design of the user interface;
analyzing the first input to determine at least one change to the first version of the design of the user interface, wherein the at least one change is associated with a level of density of user interface elements of the user interface;
implementing the determined at least one change to generate a second version of the design of the user interface, the second version is associated with the level of density of the user interface elements;
causing a second presentation of the user interface to the individual, the second presentation is based on the generated second version of the design;
receiving from the individual a second input in the natural language, the second input is associated with a desire of the individual to adjust the level of density of the user interface elements;
analyzing the second input to generate a third version of the design of the user interface, the third version is associated with an adjusted level of density of the user interface elements, wherein a numerical value associated with the adjusted level of density is determined by calculating a function of a numerical value associated with the level of density and a mathematical object based on the second input; and
causing a third presentation of the user interface to the individual, the third presentation is based on the generated third version of the design.