Systems and methods for editing designs
Described herein is a computer implemented method for automatically editing a digital design in a design application. The method includes receiving a natural language request to edit the digital design; and accessing a native format representation of the digital design. The native format representation includes one or more native design elements. The method further includes generating a descriptive format representation of the digital design by converting at least one of the one or more native design elements into a descriptive design element; generating at least one descriptive edit action based on the request and the descriptive format representation of the digital design; converting the at least one descriptive edit action into a native edit action; and implementing the native edit action, in the design application, to update the digital design.
1 . A computer implemented method for automatically editing a digital design in a design application, the digital design including one or more individual existing design elements, the method including:
receiving a natural language request to edit the digital design, wherein editing the digital design includes adding a design elements to the digital design, or deleting or modifying an existing design elements in the digital design;
accessing a native format representation of the digital design, the native format representation including a native design elements corresponding to the existing design elements;
generating a descriptive format representation of the digital design by converting the native design elements into a descriptive design element;
generating a descriptive edit action based on the request and the descriptive format representation of the digital design, wherein the descriptive edit action is a textual descriptive representation of an edit action natively supported by the design application and wherein the descriptive edit action includes:
a descriptive action component in respect of the descriptive design element or a new descriptive design element;
a descriptive element ID in respect of the descriptive design element or the new descriptive design element; and
a descriptive attribute component in respect of the descriptive design element or the new descriptive design element;
converting the descriptive edit action into a native edit action suitable for executing in the design application, wherein converting the descriptive edit action into the native edit action includes:
identifying the descriptive action component in the descriptive edit action and generating a native action component, in respect of a corresponding native design element, based on the descriptive action component;
identifying the descriptive element ID and generating a native element ID, in respect of the corresponding native design element, based on the descriptive element ID; and
identifying the descriptive attribute component and generating a native attribute component, in respect of the corresponding native design element, based on the descriptive attribute component; and
executing the native edit action, in the design application, to edit the digital design.
2 . The computer implemented method of claim 1 , wherein generating the descriptive edit action includes:
providing the descriptive format representation of the digital design to a large language model (LLM);
receiving, from the LLM, an edit description; and
storing the edit description as the descriptive edit action.
3 . The computer implemented method of claim 2 , further including providing configuration data to the LLM, wherein the configuration data includes instructions for the LLM to generate the descriptive edit action based on the request and the descriptive format representation of the digital design.
4 . The computer implemented method of claim 3 , wherein the configuration data includes:
a descriptive edit action format defining the format of descriptive edit actions; and
instructions for the LLM to generate the descriptive edit action based on the descriptive edit action format.
5 . The computer implemented method of claim 2 , further including generating multiple descriptive edit actions, wherein generating the multiple descriptive edit actions includes:
providing the descriptive format representation of the digital design to the LLM;
receiving, from the LLM, a multi edit description; and
expanding the multi edit description into the multiple descriptive edit actions.
6 . The computer implemented method of claim 5 , wherein expanding the multi edit description includes:
providing the multi edit description to a second LLM;
receiving, from the second LLM, a set of multiple edit descriptions; and
storing the set of multiple edit descriptions as the multiple descriptive edit actions.
7 . The computer implemented method of claim 6 , further including providing expansion configuration data to the second LLM, wherein the expansion configuration data includes:
a descriptive edit action format defining the format of descriptive edit actions; and
instructions for the second LLM to expand the multi edit description into the set of multiple edit descriptions based on the descriptive edit action format.
8 . The computer implemented method of claim 1 , wherein the native design elements includes a native attribute field containing a native attribute value; and converting the native design elements into the descriptive design element includes:
converting the native attribute value to a descriptive attribute value; and
storing the descriptive attribute value in a descriptive attribute field in association with a natural language label describing the descriptive attribute field.
9 . The computer implemented method of claim 8 , wherein the native attribute value is a text content value or a numerical value and wherein converting the native attribute value to the descriptive attribute value includes:
extracting the native attribute value from the native design element; and
storing the extracted native attribute value as the descriptive attribute value.
10 . The computer implemented method of claim 8 , wherein the native attribute value is an asset identifier and converting the native attribute value to the descriptive attribute value includes:
accessing a textual description of the asset identified by the asset identifier and
storing the textual description as the descriptive attribute value.
11 . The computer implemented method of claim 1 , wherein the native design elements includes a plurality of native attribute values; and wherein converting the native design elements into the descriptive design element includes converting two or more of the native attribute values into corresponding descriptive attribute values.
12 . The computer implemented method of claim 11 , wherein converting the native design elements into the descriptive design element further includes omitting one or more other native attribute values, of the plurality of native attribute values, from conversion into corresponding descriptive attribute values.
13 . The computer implemented method of claim 1 , wherein the native format representation of the digital design includes a plurality of native design elements; and wherein generating the descriptive format representation of the digital design includes converting two or more native design elements into corresponding descriptive design elements.
14 . The computer implemented method of claim 13 , wherein generating the descriptive format representation of the digital design further includes omitting one or more other native design elements, of the plurality of native design elements, from conversion into corresponding descriptive design elements.
15 . The computer implemented method of claim 1 , wherein the descriptive edit action is in respect of a descriptive attribute value; and wherein converting the descriptive edit action into the native edit action further includes:
generating a native value component based on the descriptive attribute value.
16 . The computer implemented method of claim 15 , wherein the descriptive attribute value includes a text content value or a numerical value; and wherein converting the descriptive edit action into the native edit action further includes:
extracting the descriptive attribute value from the descriptive edit action; and
storing the extracted descriptive attribute value as a corresponding native value component.
17 . The computer implemented method of claim 16 , wherein the descriptive attribute value includes a textual description for an asset; wherein converting the descriptive edit action into the native edit action further includes:
retrieving the asset based on the textual description; and
storing an asset identifier identifying the asset as a corresponding native value component.
18 . A computer processing system including:
a processing unit;
a communication interface; and
a non-transitory computer-readable storage medium storing instructions, which when executed by the processing unit, cause the processing unit to:
receive a natural language request to edit a digital design in a design application, the digital design including one or more individual existing design elements, wherein editing the digital design includes adding a design element to the digital design, or deleting or modifying an existing design element in the digital design;
access a native format representation of the digital design, the native format representation including a native design element corresponding to the existing design element;
generate a descriptive format representation of the digital design by converting the native design element into a descriptive design element;
generate a descriptive edit action based on the request and the descriptive format representation of the digital design, wherein the descriptive edit action is a textual descriptive representation of an edit action natively supported by the design application and wherein the descriptive edit action includes:
a descriptive action component in respect of the descriptive design element or a new descriptive design element;
a descriptive element ID in respect of the descriptive design element or the new descriptive design element; and
a descriptive attribute component in respect of the descriptive design element or the new descriptive design element;
convert the edit action into a native edit action suitable for executing in the design application, wherein converting the descriptive edit action into the native edit action includes:
identifying the descriptive action component in the descriptive edit action and generating a native action component, in respect of a corresponding native design element, based on the descriptive action component;
identifying the descriptive element ID and generating a native element ID, in respect of the corresponding native design element, based on the descriptive element ID; and
identifying the descriptive attribute component and generating a native attribute component, in respect of the corresponding native design element, based on the descriptive attribute component; and
execute the native edit action, in the design application, to edit the digital design.
19 . The computer processing system of claim 18 , wherein generating the descriptive edit action includes:
providing the descriptive format representation of the digital design to a large language model (LLM);
receiving, from the LLM, an edit description; and
storing the edit description as the descriptive edit action.
20 . A non-transitory storage medium storing instructions executable by a processing unit to cause the processing unit to:
receive a natural language request to edit a digital design in a design application, the digital design including one or more individual existing design elements, wherein editing the digital design includes adding a design elements to the digital design, or deleting or modifying an existing design elements in the digital design;
access a native format representation of the digital design, the native format representation including a native design elements corresponding to the existing design elements;
generate a descriptive format representation of the digital design by converting the native design elements into a descriptive design element;
generate a descriptive edit action based on the request and the descriptive format representation of the digital design, wherein the descriptive edit action is a textual descriptive representation of an edit action natively supported by the design application and wherein the descriptive edit action includes:
a descriptive action component in respect of the descriptive design element or a new descriptive design element;
a descriptive element ID in respect of the descriptive design element or the new descriptive design element; and
a descriptive attribute component in respect of the descriptive design element or the new descriptive design element;
convert the descriptive edit action into a native edit action suitable for executing in the design application, wherein converting the descriptive edit action into the native edit action includes:
identifying the descriptive action component in the descriptive edit action and generating a native action component, in respect of a corresponding native design element, based on the descriptive action component;
identifying the descriptive element ID and generating a native element ID, in respect of the corresponding native design element, based on the descriptive element ID; and
identifying the descriptive attribute component and generating a native attribute component, in respect of the corresponding native design element, based on the descriptive attribute component; and
execute the native edit action, in the design application, to edit the digital design.