IP Library Granted Patent US 12,386,643
Granted Patent B2
US 12,386,643 · App. 18/631,654 · Granted Aug 12, 2025

Conversational interface for content creation and editing using large language models

Inventors: Sylvanus Garnet Bent, III (Palo Alto, CA); Xiaolan Zhou (Santa Clara, CA); Mehmet Levent Koc (Redwood City, CA); Wei Luo (Jersey City, NJ)
Assignee: GOOGLE LLC
G06F9/453G06F40/166
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,386,643
App. No.
18/631,654
Granted
Aug 12, 2025
Kind
B2
Abstract

Example embodiments of the present disclosure provide for an example method. The example method includes generating an initial user interface including a content assistant component. The example method include obtaining user input data. The example method includes processing, by a machine learned model interfacing with the content assistant component, the data indicative of the input received from the user. The method includes obtaining output data, from the machine learned model interfacing with the content assistant component, indicative of one or more content item components. The method includes transmitting data which causes the content item components to be provided for display via an updated user interface. The method includes obtaining data indicative of user selection of approval of the content item components. The method includes generating, in response to obtaining the data indicative of the user selection of the approval of the content item components, content items.

Claims (57)

1. A computing system, comprising:

one or more processors; and

one or more non-transitory computer-readable media storing instructions that are executable to cause the one or more processors to perform operations, the operations comprising:

obtaining, via a conversational campaign assistant interface, by a custom trained machine-learned model, natural language input, wherein the natural language input comprises at least a website uniform resource locator (URL);

accessing, via the custom machine-learned model, data associated with a website associated with the website URL;

generating output comprising one or more suggested content item components based on the accessed data and natural language input;

responsive to generating the output comprising the one or more suggested content item components, automatically populating one or more input fields with the one or more suggested content item components; and

transmitting instructions that, when executed, cause a client device to provide the one or more suggested content item components for display via a user interface.

2. The computing system of claim 1 , the operations comprising:

generating an initial user interface comprising a content assistant component;

obtaining data indicative of user input;

processing, by the custom trained machine-learned model, the data indicative of user input;

obtaining output data, from the custom trained machine-learned model, indicative of one or more content item components;

transmitting data which causes the one or more content item components to be provided for display on a user interface;

obtaining data indicative of user selection of approval of the one or more content item components; and

generating, in response to obtaining the data indicative of the user selection of the approval of the one or more content item components, one or more content items comprising a plurality of the content item components.

3. The computing system of claim 2 , wherein the content assistant component comprises one or more input fields.

4. The computing system of claim 1 , wherein the custom trained machine-learned model has been trained using a knowledge distillation training method.

5. The computing system of claim 4 , wherein the custom trained machine-learned model has been trained based at least in part on output from a pre-trained second machine-learned model.

6. The computing system of claim 5 , wherein the pre-trained second machine-learned model is a large language model.

7. The computing system of claim 6 , wherein the pre-trained second machine-learned model is tuned using one or more prompts.

8. The computing system of claim 1 , wherein the input data comprises at least one of free-form input comprising natural language input.

9. The computing system of claim 1 , wherein the input data comprises landing page content.

10. The computing system of claim 1 , wherein the one or more content item components comprises a description.

11. A computer-implemented method, performed by one or more processors, comprising:

generating an initial user interface comprising a conversational campaign assistant interface;

obtaining, via the conversational campaign assistant interface, by a custom trained machine-learned model, natural language input, wherein the natural language input comprises at least a website uniform resource locator (URL);

accessing, via the custom machine-learned model, data associated with a website associated with the website URL;

generating output comprising one or more suggested content item components based on the accessed data and natural language input,

responsive to generating the output comprising the one or more suggested content item components, automatically populating one or more input fields with the one or more suggested content item components; and

transmitting instructions that, when executed, cause a client device to provide the one or more suggested content item components for display via a user interface.

12. The computer-implemented method of claim 11 , wherein the custom trained machine-learned model has been trained using a knowledge distillation training method.

13. The computer-implemented method of claim 11 , wherein the one or more suggested content items comprise at least one of images, videos, or taglines.

14. The computer-implemented method of claim 11 , wherein generating output comprising one or more suggested content item components comprises generating a suggested content item comprising the one or more suggested content item components.

15. The computer-implemented method of claim 11 , comprising:

obtaining input comprising selection of a first content item component of the one or more content item components; and

generating, responsive to obtaining the input comprising selection of the first content item component, a content item based at least in part on the first content item component.

16. The computer-implemented method of claim 11 , comprising:

generating, based on the natural language input data, one or more follow-up questions; and

providing for display the one or more follow-up questions.

17. The computer-implemented method of claim 11 , wherein the one or more input fields comprise at least one of headlines, descriptions, or keywords.

18. One or more non-transitory computer readable media storing instructions that are executable by one or more processors to perform operations comprising:

generating an initial user interface comprising a conversational campaign assistant interface;

obtaining, via the conversational campaign assistant interface, by a custom trained machine-learned model, natural language input, wherein the natural language input comprises at least a website uniform resource locator (URL);

accessing, via the custom machine-learned model, data associated with a website associated with the website URL;

generating output comprising one or more suggested content item components based on the accessed data and natural language input;

responsive to generating the output comprising the one or more suggested content item components, automatically populating one or more input fields with the one or more suggested content item components; and

transmitting instructions that, when executed, cause a client device to provide the one or more suggested content item components for display via a user interface.

19. The one or more non-transitory computer readable media of claim 18 , the operations comprising:

generating an initial user interface comprising a content assistant component;

obtaining data indicative of user input;

processing, by the custom trained machine-learned model, the data indicative of user input;

obtaining output data, from the custom trained machine-learned model, indicative of one or more content item components;

transmitting data which causes the one or more content item components to be provided for display on a user interface;

obtaining data indicative of user selection of approval of the one or more content item components; and

generating, in response to obtaining the data indicative of the user selection of the approval of the one or more content item components, one or more content items comprising a plurality of the content item components.

20. The one or more non-transitory computer readable media of claim 18 , wherein the custom trained machine-learned model has been trained using a knowledge distillation training method.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2024
From: BENT, SYLVANUS GARNET, III; ZHOU, XIAOLAN; KOC, MEHMET LEVENT; LUO, WEI
To: GOOGLE LLC
Reel/Frame 067423/0500 →
Continuity (2)
Continuation 17968472 · Oct 18, 2022
Related Publication 20240256311A1 · Aug 1, 2024
References Cited (19)
US 11367447B2 · Pair · 2022 [cited by applicant]
US 11604965B2 · Sun · 2023 [cited by applicant]
US 20210316105A1 · Godara et al. · 2021 [cited by applicant]
US 20210327413A1 · Widya et al. · 2021 [cited by applicant]
US 20220029937A1 · Atallah et al. · 2022 [cited by examiner]
US 20220061746A1 · Lyman et al. · 2022 [cited by applicant]
US 20230117235A1 · Muse et al. · 2023 [cited by applicant]
US 20230316105A1 · Nguyen et al. · 2023 [cited by applicant]
Abid et al., “Artificial intelligence (AI) applications for marketing: A literature-based study.” International Journal of Intelligent Networks (2022), 14 pages. [cited by applicant]
Aureus Analytics Blog, “5 Natural Language Processing Techniques for Extracting Information”, 2020, https://blog.aureusanalytics.com/blog/5-natural-language-processing-techniques-for-extracting-information , retrieved o… [cited by applicant]
Google AI Blog, “Exploring Transfer Learning with T5: the Text-To-Text Transfer Transformer”, Feb. 24, 2020, https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html, retrieved on Nov. 2, 2022, 5 pages. [cited by applicant]
Google AI Blog, “LaMDA: Our Breakthrough Conversation Technology”, May 18, 2021, https://blog.google/technology/ai/lamda/ retrieved on Nov. 2, 2022, 3 pages. [cited by applicant]
Google Products Blog, “MUM: A New AI Milestone for Understanding Information”, May 18, 2021, https://blog.google/products/search/introducing-mum/, retrieved on Nov. 2, 2022, 5 pages. [cited by applicant]
International Search Report and Written Opinion for Application No. PCT/US2023/035397, mailed Dec. 13, 2023, 17 pages. [cited by applicant]
Linguamatics, “What is Text Mining, Text Analytics and Natural Language Processing?”, 2022, https://www.linguamatics.com/what-text-mining-text-analytics-and-natural-language-processing, retrieved on Nov. 2, 2022, 6 page… [cited by applicant]
Nim, “Knowledge Distillation of Language Models”, Oct. 31, 2021, https://alexnim.com/coding-projects-knowledge-distillation.html, retrieved on Jan. 2, 2024, 8 pages. [cited by applicant]
Open AI, “DALL-E: Creating Images from Text”, https://openai.com/blog/dall-e/, Jan. 5, 2021, retrieved on Nov. 2, 2022, 10 pages. [cited by applicant]
Youngmann, “Algorithmic Copywriting: Automated Generation of Health-Related Advertisements to Improver Their Performance”, Information Retrieval Journal 24.3 (2021), pp. 205-239. [cited by applicant]
Zhang, “Automatic Product Copywriting for E-commerce”, arXiv:2112.11915v1, dated Dec. 15, 2021, 10 pages. [cited by applicant]