IP Library Granted Patent US 12,608,552
Granted Patent B2
US 12,608,552 · App. 18/493,732 · Granted Apr 21, 2026

Prompt chaining system for generative artificial intelligence systems

Inventors: Matthew Kyung-Soo Hong (Mountain View, CA); Yin-Ying Chen (San Jose, CA); Yanxia Zhang (Foster City, CA)
Assignees: TOYOTA RESEARCH INSTITUTE, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
G06F40/30G06F40/279G06N5/022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,608,552
App. No.
18/493,732
Granted
Apr 21, 2026
Kind
B2
Abstract

A method for processing text prompts includes identifying a set of elements in a text prompt that form a basis for a generative output. The method also includes identifying an element of the set of elements that satisfy a refinement condition. The method further includes updating the element based on the element satisfying the refinement condition. The method still further includes generating the generative output in accordance with updating the element.

Claims (44)

1 . A method for processing text prompts, comprising:

receiving a prompt at a user interface for detecting an input that forms a basis for a generative output from a generative AI model that is trained to perform one or more tasks associated with refining the input provided for the generative AI model;

detecting the received prompt and processing the receive prompt by:

identifying a first element in the received prompt associated with a visual representation,

identifying a second element that is understated or lacks detail,

using semantics to identify an ambiguous word or phrase, and/or

identifying a pattern that deviates from an expected norm in a given scene description;

receiving, from the generative AI model, a prioritized list of keywords or phrases for refining the received prompt in response to processing the received prompt;

automatically prompting a user to select one or more keywords and/or one or more phrases from the prioritized list of keywords and phrases;

synthesizing a new prompt from the received prompt in response to the user selecting the one or more keywords and/or the one or more phrases; and

repeating prompt synthesis until the user is satisfied with the generative output from the generative AI model.

2 . The method of claim 1 , wherein the generative output is a visualization.

3 . The method of claim 1 , wherein the ambiguous word or phrase is based on historical data.

4 . The method of claim 1 , wherein the method further comprises receiving additional prompts until the user is satisfied with the generative output.

5 . An apparatus for processing text prompts, comprising:

a processor; and

a memory coupled with the processor and storing instructions operable, when executed by the processor, to cause the apparatus to:

receive a prompt at a user interface for detecting an input that forms a basis for a generative output from a generative AI model that is trained to perform one or more tasks associated with refining the input provided for the generative AI model;

detect the received prompt and processing the receive prompt by:

identifying a first element in the received prompt associated with a visual representation,

identifying a second element that is understated or lacks detail,

using semantics to identify an ambiguous word or phrase, and/or

identifying a pattern that deviates from an expected norm in a given scene description;

receive, from the generative AI model, a prioritized list of keywords or phrases for refining the received prompt in response to processing the received prompt;

automatically prompt a user to select one or more keywords and/or one or more phrases from the prioritized list of keywords and phrases;

synthesize a new prompt from the received prompt in response to the user selecting the one or more keywords and/or the one or more phrases; and

repeat prompt synthesis until the user is satisfied with the generative output from the generative AI model.

6 . The apparatus of claim 5 , wherein the generative output is a visualization.

7 . The apparatus of claim 5 , wherein the ambiguous word or phrase is based on historical data.

8 . The apparatus of claim 5 , wherein execution of the instructions further cause the apparatus to receive additional prompts until the user is satisfied with the generative output.

9 . A non-transitory computer-readable medium having program code recorded thereon for processing text prompts, the program code executed by a processor and comprising:

program code to receive a prompt at a user interface for detecting an input that forms a basis for a generative output from a generative AI model that is trained to perform one or more tasks associated with refining the input provided for the generative AI model;

detect the received prompt and processing the receive prompt by:

identifying a first element in the received prompt associated with a visual representation,

identifying a second element that is understated or lacks detail,

using semantics to identify an ambiguous word or phrase, and/or

identifying a pattern that deviates from an expected norm in a given scene description;

program code to receive, from the generative AI model, a prioritized list of keywords or phrases for refining the received prompt in response to processing the received prompt;

program code to automatically prompt a user to select one or more keywords and/or one or more phrases from the prioritized list of keywords and phrases;

program code to synthesize a new prompt from the received prompt in response to the user selecting the one or more keywords and/or the one or more phrases; and

program code to repeat prompt synthesis until the user is satisfied with the generative output from the generative AI model.

10 . The non-transitory computer-readable medium of claim 9 , wherein the generative output is a visualization.

11 . The non-transitory computer-readable medium of claim 9 , wherein the ambiguous word or phrase is based on historical data.

12 . The non-transitory computer-readable medium of claim 9 , wherein the program code further comprises program code to receive additional prompts until the user is satisfied with the generative output.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2026
From: TOYOTA RESEARCH INSTITUTE, INC.
To: TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 074900/0507 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2023
From: HONG, MATTHEW KYUNG-SOO; CHEN, YIN-YING; ZHANG, YANXIA
To: TOYOTA RESEARCH INSTITUTE, INC.; TOYOTA JIDOSHA KABUSHIKI KAISHA
Reel/Frame 065330/0246 →
Continuity (2)
Provisional Application 63460977 · Apr 21, 2023
Related Publication 20240354513A1 · Oct 24, 2024
References Cited (12)
US 9528847B2 · Albrecht · 2016 [cited by applicant]
US 11126798B1 · Lewis Meza · 2021 [cited by examiner]
US 11182556B1 · Lewis Meza · 2021 [cited by examiner]
US 11562028B2 · Appel · 2023 [cited by examiner]
US 11797610B1 · Ferrucci · 2023 [cited by examiner]
US 11816435B1 · Lewis Meza · 2023 [cited by examiner]
US 20210342380A1 · Luus · 2021 [cited by examiner]
US 20220405487A1 · Bhandari · 2022 [cited by examiner]
Leonie Monigatti, “A Beginner's Guide to Prompt Design for Text-to-Image Generative Models”, Website article, https://towardsdatascience.com/a-beginners-guide-to-prompt-design-for-text-to-image-generative models-8242e13… [cited by applicant]
Jonas Oppenlaender, “A Taxonomy of Prompt Modifiers for Text-To-Image Generation”, arXiv:2204.13988 [cs.MM]; Jul. 31, 2022. [cited by applicant]
Yunlong Wang, “RePrompt: Automatic Prompt Editing to Refine AI-Generative Art Towards Precise Expressions”, arXiv:2302.09466 [cs.HC], Apr. 23-28, 2023. [cited by applicant]
Vivian Liu, “Opal: Multimodal Image Generation for News Illustration”, arXiv:2204.09007 [cs.HC], Aug. 16, 2022. [cited by applicant]