IP Library › Granted Patent US 12,737,370
Granted Patent B1
US 12,737,370 · App. 18/888,945 · Granted Sep 15, 2026

Visually structured responses with action controls

Inventors: Vinayshekhar Bannihatti Kumar (San Jose, CA); Rashmi Gangadharaiah (San Jose, CA); Manoj Ghuhan Arivazhagan (Sunnyvale, CA); Sandesh Swamy (Seattle, WA); Sopan Khosla (Sunnyvale, CA); Siddharth Satish Goyal (Ashburn, VA); Narjessadat Seyeditabari (Daly City, CA); Deepak Seetharam Nadig (San Jose, CA); Pranjul Dubey (Lynnwood, WA); James W. Horsley (Carnation, WA)
Assignee: Amazon Technologies, Inc.
G06F16/248G06F16/2365
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,737,370
App. No.
18/888,945
Granted
Sep 15, 2026
Kind
B1
Abstract

Disclosed are systems and methods to intelligently present user interfaces that are dynamically generated based on the determined intent or needs of the user. For example, based on user requests or actions, the disclosed implementations may dynamically generate and present to a user one or more components that are relevant to the user. Such components may be generated and presented anywhere in a provider network environment, from within a console or home page to guide a user to a service and/or to respond to a user query, to within a software development service to provide a developer with code or other requested content.

Claims (84)

1 . A computer-implemented method, comprising:

receiving, a user query with respect to a computing resource of a provider network;

determining a plurality of organizational structure options for presenting content responsive to the user query;

generating an artificial intelligence (“AI”) prompt that includes the user query, a session context, the plurality of organizational structure options, and an instruction that an AI system provide a response to the user query that includes a visual structure selected from the plurality of organizational structure options for presenting the content included in the response and an action control that may be presented to a user such that the user may select the action control and cause an action to be performed with respect to the computing resource;

receiving, from the AI system, a visually structured response in accordance with the instruction; and

causing a presentation of:

the content of the visually structured response according to the visual structure specified in the visually structured response; and

a first action control corresponding to the computing resource referenced in the content.

2 . The computer-implemented method of claim 1 , wherein generating the AI prompt, includes:

generating a structure AI prompt with instructions that the AI system provide a visual structure for presentation of the content;

generating an actions AI prompt with instructions that the AI system provide a visual action for presentation of an action specified in the content; and

combining the visual structure presentation and the visual action presentation to generate the presentation.

3 . The computer-implemented method of claim 1 , further comprising:

determining a plurality of visual action options that may be used to present the action; and

including at least some of the visual action options in the AI prompt.

4 . The computer-implemented method of claim 1 , further comprising:

comparing a first embedding vector that semantically represents a first segment of a first document of a corpus of documents with a second embedding vector that semantically represents a second segment of a second document of the corpus to determine that the first embedding vector and the second embedding vector form a cluster that includes at least the first embedding vector and the second embedding vector;

in response to determining that the first embedding vector and the second embedding vector form the cluster:

processing, with the AI system, a first content of the first segment and a second content of the second segment to determine that the first content conflicts with the second content;

determining, with the AI system, a suggested revision to at least one of the first content or the second content so that the first content and the second content are aligned and do not conflict;

generating a canonical cluster segment that includes the suggested revision; and

presenting at least a portion of the suggested revision as responsive to the user query.

5 . The computer-implemented method of claim 1 , further comprising:

determining, based at least in part on the visually structured response, an action that may be performed with respect to the computing resource indicated in the content of the visually structured response; and

causing the presentation of the first action control that corresponds to the determined action, such that, when the first action control is selected, the action is performed with respect to the computing resource.

6 . The computer-implemented method of claim 5 , wherein the action modifies a state of the computing resource.

7 . A system, comprising:

one or more processors; and

a memory storing program instructions that, when executed by the one or more processors, cause the one or more processors to at least:

determine a plurality of organizational structure options for presenting content;

generate an artificial intelligence (“AI”) prompt with the plurality of organizational structure options and instructions that an AI system provide a visually structured response indicating an organizational structure selected from the plurality of organizational structure options as to how the content of the visually structured response is to be presented;

receive, from the AI system, the visually structured response that includes the content and the organizational structure indicating how the content is to be presented;

determine, based at least in part on the visually structured response, an action that may be performed with respect to a resource indicated in the content; and

cause, concurrent with a first presentation of the content according to the organizational structure, a second presentation of an action control such that, when the action control is selected, the action is performed with respect to the resource.

8 . The system of claim 7 , wherein the organizational structure is at least one of a table, a bullet list structure, a checklist structure, a graph structure, or a programming layout structure.

9 . The system of claim 7 , wherein the program instructions that, when executed by the one or more processors, further cause the one or more processors to at least:

determine a first segment of a first document of a document corpus that conflicts with a second segment of a second document of the document corpus;

send a consolidation AI prompt to an AI system that includes a first content of the first segment, a second content of the second segment, and an instruction that the AI system generate a suggested content that accurately describes the first content and the second content such that the first content and the second content are aligned;

update the first content and the second content to include the suggested content; and

cause, concurrent with the first presentation, a third presentation of at least a portion of the suggested content.

10 . The system of claim 9 , wherein the program instructions that, when executed by the one or more processors, further cause the one or more processors to at least:

generate a first embedding vector that semantically represents the first content of the first segment;

generate a second embedding vector that semantically represents the second content of the second segment; and

determine, based at least in part on a distance between the first embedding vector and the second embedding vector, that the first embedding vector and the second embedding vector form a cluster.

11 . The system of claim 7 , wherein the program instructions that, when executed by the one or more processors, cause the one or more processors to at least:

receive, a query with respect to an activity that may be performed during a session;

determine a session summary of the session; and

generate the AI prompt based at least in part on the query and the session summary.

12 . The system of claim 7 , wherein the program instructions that, when executed by the one or more processors, further cause the one or more processors to at least:

determine, based on two or more activities of a session, a session trajectory of the session;

generate a next best activity AI prompt that includes an indication of the session trajectory, a session summary of the session, and an instruction that a next best recommended activity be determined for the session;

receive, from the AI system and responsive to the next best activity AI prompt, a predicted next best action for the session; and

present the predicted next best action.

13 . The system of claim 7 , wherein the program instructions that, when executed by the one or more processors, further cause the one or more processors to at least:

determine a start activity and a destination activity for a flow;

determine that the start activity has been completed during a session;

update a session flow to include an indication of activities performed after the start activity;

determine that the destination activity has been completed as part of the session; and

in response to determination that the destination activity has been completed, generate at least one friction score for the flow.

14 . The system of claim 13 , wherein the friction score is at least one of an error rate, a page latency, a time to complete the flow, a number of page changes during the flow, or a number of activities of the flow.

15 . The system of claim 13 , wherein the program instructions that, when executed by the one or more processors, further cause the one or more processors to at least:

generate a complexity score indicative of a complexity of the session flow between the start activity and the destination activity.

16 . The system of claim 13 , wherein the program instructions that, when executed by the one or more processors, further cause the one or more processors to at least:

determine, based at least in part on the session flow and a plurality of other session flows between the start activity and the destination activity, a most efficient flow of activities between the start activity and the destination activity.

17 . A computer-implemented method, comprising:

determining a plurality of organizational structure options for presenting content;

generating an artificial intelligence (“AI”) system prompt with the plurality of organizational structure options and instructions that the AI system provide a response with the content and an organizational structure selected from the plurality of organizational structure options for presenting the content;

receiving, from the AI system, a response that includes the content and the organizational structure;

determining an action that may be performed with respect to at least one resource indicated in the content;

generating an action control representative of the action such that selection of the action control causes the action to be performed with respect to the at least one resource; and

causing a concurrent presentation of the content according to the organizational structure and the action control.

18 . The computer-implemented method of claim 17 , further comprising:

determining that the action control has been selected;

causing the action to be performed with respect to the at least one resource;

determining, based at least in part on performance of the action, a session trajectory of a session; and

determining, based at least in part on the session trajectory, a predicted next best action for the session.

19 . The computer-implemented method of claim 18 , wherein determining the predicted next best action is further determined based at least in part on one or more of the performance of the action, a session summary of the session, a user context, or a best practices determined for a flow that corresponds with the session trajectory.

20 . The computer-implemented method of claim 17 , further comprising:

generating, for a session, a session flow that includes an indication of activities performed during the session; and

determining, from the session flow, a friction score indicative of at least a number of activities between a start activity and a destination activity of the session flow.

21 . The computer-implemented method of claim 17 , further comprising:

receiving a query corresponding to the session; and

wherein generating the AI system prompt further includes:

generating the AI system prompt with instructions that the AI system provide a response to the query with content and the organizational structure for presenting the content.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT THE SPELLING OF THE NAME OF 5TH INVENTOR PREVIOUSLY RECORDED AT REEL: 68627 FRAME: 1. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 2, 2024
From: BANNIHATTI KUMAR, VINAYSHEKHAR; GANGADHARAIAH, RASHMI; ARIVAZHAGAN, MANOJ GHUHAN; SWAMY, SANDESH; KHOSLA, SOPAN; GOYAL, SIDDHARTH SATISH; SEYEDITABARI, NARJESSADAT; NADIG, DEEPAK SEETHARAM; DUBEY, PRANJUL; HORSLEY, JAMES W
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 069101/0963 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2024
From: BANNIHATTI KUMAR, VINAYSHEKHAR; GANGADHARAIAH, RASHMI; ARIVAZHAGAN, MANOJ GHUHAN; SWAMY, SANDESH; KHOSLA, SOPHAN; GOYAL, SIDDHARTH SATISH; SEYEDITABARI, NARJESSADAT; NADIG, DEEPAK SEETHARAM; DUBEY, PRANJUL; HORSLEY, JAMES W
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 068627/0001 →
References Cited (42)
US 11314563B1 · Singh et al. · 2022 [cited by applicant]
US 12499111B1 · Paul · 2025 [cited by examiner]
US 12541558B1 · Thanvantri Vasudevan · 2026 [cited by examiner]
US 12572614B2 · Gelli · 2026 [cited by examiner]
US 12572867B2 · Rashkevitch · 2026 [cited by examiner]
US 12651128B1 · Levy · 2026 [cited by examiner]
US 12681945B2 · Lin · 2026 [cited by examiner]
US 12681957B2 · Grantham · 2026 [cited by examiner]
US 20090024944A1 · Louch et al. · 2009 [cited by applicant]
US 20150188977A1 · Berry et al. · 2015 [cited by applicant]
US 20180330248A1 · Burhanuddin et al. · 2018 [cited by applicant]
US 20210064675A1 · Chugh et al. · 2021 [cited by applicant]
US 20210248205A1 · Tank et al. · 2021 [cited by applicant]
US 20210349757A1 · Qiao et al. · 2021 [cited by applicant]
US 20220300353A1 · Singh et al. · 2022 [cited by applicant]
US 20220311822A1 · Nord et al. · 2022 [cited by applicant]
US 20240394404A1 · O'Neal · 2024 [cited by examiner]
US 20250028747A1 · Hagler · 2025 [cited by examiner]
US 20250088946A1 · Grida Ben Yahya · 2025 [cited by examiner]
US 20250252376A1 · Singh · 2025 [cited by examiner]
US 20250298970A1 · Khosla · 2025 [cited by examiner]
US 20250315429A1 · Kawai · 2025 [cited by examiner]
US 20250342323A1 · Spiteri · 2025 [cited by examiner]
US 20250371260A1 · Yao et al. · 2025 [cited by applicant]
US 20250384380A1 · Inampudi · 2025 [cited by examiner]
US 20250384495A1 · Mahal · 2025 [cited by applicant]
US 20260003928A1 · Tabb et al. · 2026 [cited by applicant]
US 20260017285A1 · Grantham · 2026 [cited by examiner]
US 20260056932A1 · Bathula · 2026 [cited by examiner]
US 20260056945A1 · Ghosh · 2026 [cited by examiner]
US 20260056958A1 · Zhou · 2026 [cited by examiner]
US 20260064379A1 · Briant · 2026 [cited by examiner]
US 20260064380A1 · Briant · 2026 [cited by examiner]
US 20260064400A1 · Briant · 2026 [cited by examiner]
US 20260072928A1 · Das · 2026 [cited by examiner]
US 20260127386A1 · Tomasini · 2026 [cited by examiner]
US 20260161899A1 · Reed · 2026 [cited by examiner]
US 20260178571A1 · Hamzeh · 2026 [cited by examiner]
US 20260195617A1 · Lee · 2026 [cited by examiner]
WO 2019113550A1 · 2019 [cited by applicant]
Prompting is Programming: A Query Language for Large Language Models (Year: 2023). [cited by examiner]
Contextual Dynamic Prompting for Response Generation in Task-oriented Dialog Systems (Year: 2023). [cited by examiner]