User interface for editing of a composite document through intelligently zoomed previews
An illustrator system accesses a multi-element document including a plurality of elements. The illustrator system selects, from the plurality of elements, a selected element. The illustrator system generates a replacement multi-element document that includes a substitute element in place of the selected element in the multi-element document, wherein the substitute element is different from the selected element. The illustrator system displays, via a user interface with the multi-element document, a preview of the replacement multi-element document providing a view of the replacement multi-element document, wherein the view of the replacement multi-element document is focused to depict the substitute element.
1. A method, comprising:
accessing a multi-element document, the multi-element document including a plurality of elements depicted in the multi-element document;
determining a global intent for the multi-element document based on the plurality of elements depicted in the multi-element document, wherein determining the global intent for the multi-element document comprises:
determining, for each of the plurality of elements, an element-specific topic distribution comprising a ranked list of topics;
wherein at least one of the plurality of elements comprises a text element having less than a threshold length, and wherein determining the element-specific topic distribution for each text element having less than the threshold length comprises applying a machine learning model to text associated with the text element to generate the ranked list of topics specific to the text element; and
creating a first aggregated topic distribution from the determined element-specific topic distributions, wherein the global intent comprises one or more terms from the first aggregated topic distribution;
selecting, from the plurality of elements, a selected element;
generating, based on the determined global intent, a replacement multi-element document that includes a substitute element in place of the selected element in the multi-element document, wherein content of the substitute element comprises one or more features that are different from one or more corresponding features of content of the selected element; and
displaying, via a user interface with the multi-element document, a preview of the replacement multi-element document providing a view of the replacement multi-element document, wherein the view of the replacement multi-element document is focused to depict the substitute element.
2. The method of claim 1 , wherein focusing to depict the substitute element comprises zooming the preview to display an area including the substitute element.
3. The method of claim 2 , wherein the area including the substitute element does not include elements of the replacement multi-element document other than the substitute element.
4. The method of claim 1 , wherein selecting the selected element comprises receiving, via the user interface, a selection of the selected element in the multi-element document.
5. The method of claim 1 , wherein selecting the selected element comprises:
determining an edit history for the plurality of elements describing one or more edits previously applied to the plurality of elements; and
selecting, based on the edit history, a most-recently edited element from the plurality of elements as the selected element.
6. The method of claim 1 , wherein selecting the selected element comprises:
determining a displayed area of the multi-element document that is displayed via the user interface; and
selecting an element of the plurality of elements that is encompassed by a displayed area as the selected element.
7. The method of claim 1 , wherein the multi-element document comprises a layered canvas and wherein the plurality of elements comprise a plurality of layers.
8. The method of claim 1 , wherein the multi-element document comprises a video and wherein the plurality of elements comprise a plurality of keyframes of the video, wherein focusing to depict the substitute element comprises displaying, chronologically, a set of the plurality of keyframes including at least a replacement keyframe.
9. The method of claim 1 , wherein the multi-element document comprises an audio clip and wherein the plurality of elements comprise a plurality of portions of the audio clip, wherein focusing to depict the substitute element comprises displaying, chronologically, a set of the plurality of portions of the audio clip including at least a replacement audio portion.
10. The method of claim 1 , further comprising:
generating a second aggregated topic distribution from a subset of the determined element-specific topic distributions, the subset associated with elements in the multi-element document that have been selected or edited by a user; and
wherein the global intent further comprises one or more terms from the second aggregated topic distribution.
11. The method of claim 1 , wherein at least one of the plurality of elements comprises an image element and wherein determining, for each image element of the plurality of elements, the element-specific topic distribution comprising the list of topics comprises:
extracting, from the image element, one or more tags;
applying a second machine learning model to the one or more tags to generate a description;
querying a database using the generated description to retrieve documents, the documents including topic labels; and
wherein the ranked list of topics comprises a list of topics ranked according to a number of topic labels associated with each topic in the retrieved documents.
12. The method of claim 1 , wherein determining, for each text element of the plurality of elements, the element-specific topic distribution comprising the list of topics comprises:
querying a database using text of the text element to retrieve documents, the documents including topic labels; and
wherein the ranked list of topics comprises a list of topics ranked according to a number of topic labels associated with each topic in the retrieved documents.
13. The method of claim 1 , wherein generating the replacement multi-element document comprises querying a database using the global intent to retrieve the substitute element.
14. The method of claim 13 , further comprising:
displaying, via a user interface with the multi-element document, the determined global intent; and
receiving, via the user interface, a modification to the determined global intent, wherein querying the database using the global intent comprises querying the database using the modified global intent.
15. A system comprising:
a memory component; and
a processing device coupled to the memory component, the processing device to perform operations comprising:
accessing a multi-element document, the multi-element document including a plurality of elements depicted in the multi-element document;
determining a global intent for the multi-element document based on the plurality of elements depicted in the multi-element document, wherein determining the global intent for the multi-element document based on the plurality of elements comprises:
determining, for each of the plurality of elements, an element-specific topic distribution comprising a ranked list of topics;
wherein at least one of the plurality of elements comprises a text element having less than a threshold length, and wherein determining the element-specific topic distribution for each text element having less than the threshold length comprises applying a machine learning model to text associated with the text element to generate the ranked list of topics specific to the text element; and
creating a first aggregated topic distribution from the determined element-specific topic distributions, wherein the global intent comprises one or more terms from the first aggregated topic distribution;
selecting, from the plurality of elements, a selected element;
generating, based on the determined global intent, a replacement multi-element document that includes a substitute element in place of the selected element in the multi-element document, wherein content of the substitute element comprises one or more features that are different from one or more corresponding features of content of the selected element; and
displaying, via a user interface with the multi-element document, a preview of the replacement multi-element document providing a view of the replacement multi-element document, wherein the view of the replacement multi-element document is zoomed to comprise an area including the substitute element.
16. The system of claim 15 , wherein selecting the selected element comprises receiving, via the user interface, a selection of the selected element in the multi-element document.
17. The system of claim 15 , wherein selecting the selected element comprises:
determining an edit history for the plurality of elements describing one or more edits previously applied to the plurality of elements; and
selecting, based on the edit history, a most-recently edited element from the plurality of elements as the selected element.
18. A non-transitory computer-readable medium storing executable instructions, which when executed by a processing device, cause the processing device to perform operations comprising:
accessing a multi-element document, the multi-element document including a plurality of elements depicted in the multi-element document;
determining a global intent for the multi-element document based on the plurality of elements depicted in the multi-element document, wherein determining the global intent for the multi-element document based on the plurality of elements comprises:
determining, for each of the plurality of elements, an element-specific topic distribution comprising a ranked list of topics;
wherein at least one of the plurality of elements comprises a text element having less than a threshold length, and wherein determining the element-specific topic distribution for each text element having less than the threshold length comprises applying a machine learning model to text associated with the text element to generate the ranked list of topics specific to the text element; and
creating a first aggregated topic distribution from the determined element-specific topic distributions, wherein the global intent comprises one or more terms from the first aggregated topic distribution;
selecting, from the plurality of elements depicted in the multi-element document, a selected element;
generating a replacement multi-element document that includes a substitute element in place of the selected element in the multi-element document, wherein content of the substitute element comprises one or more features that are different from one or more corresponding features of content of the selected element; and
displaying, via a user interface with the multi-element document, a preview of the replacement multi-element document providing a view of the replacement multi-element document, wherein the view of the replacement multi-element document is zoomed to comprise an area including the substitute element.