Directive generative thread-based user assistance system
Embodiments of the disclosed technologies include generating a first thread classification prompt based on a first thread portion of an online dialog involving a user of a computing device, sending the first thread classification prompt to a first large language model, receiving a first thread classification generated and output by the first large language model based on the first thread classification prompt, formulating a plan execution prompt based on the first thread classification, sending the plan execution prompt to a second large language model, receiving a second thread portion generated and output by the second large language model based on the plan execution prompt and the online dialog, and generating a label for a third thread portion of the online dialog.
1 . A method comprising:
generating a first thread classification prompt based on a first thread portion of an online dialog presented via an interface;
sending the first thread classification prompt to a first large language model;
receiving a first thread classification, wherein the first thread classification is generated and output by the first large language model based on the first thread classification prompt;
formulating a plan execution prompt based on the first thread classification, wherein in response to determining that at least one stored thread matches the first thread classification, the plan execution prompt is formulated based on the first thread portion and the at least one stored thread that matches the first thread classification;
sending the plan execution prompt to a second large language model;
receiving a second thread portion, wherein the second thread portion is generated and output by the second large language model based on the plan execution prompt and the online dialog, and wherein the second thread portion comprises an assessment of a target entity that is summarized and output by the second large language model based on the plan execution prompt;
generating a label for a third thread portion of the online dialog, wherein the label is based on the first thread classification and the third thread portion comprises the first thread portion and the second thread portion; and
providing the label to the interface.
2 . The method of claim 1 , further comprising:
labeling a fourth thread portion of the online dialog based on a second thread classification generated and output by the first large language model, wherein the online dialog comprises a plurality of natural language threads.
3 . The method of claim 1 , wherein generating the first thread classification prompt comprises:
sending the first thread portion to the first large language model; and
receiving a tagged version of the first thread portion, wherein the tagged version of the first thread portion comprises entity data associated with the first thread portion and the entity data is generated and output by the first large language model based on data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
4 . The method of claim 3 , wherein generating the first thread classification prompt comprises:
based on the tagged version of the first thread portion, retrieving a stored classification template, wherein the retrieved classification template comprises at least one instruction to be executed by the first large language model; and
including the retrieved classification template and the retrieved data in the first thread classification prompt.
5 . The method of claim 1 , wherein generating the first thread classification prompt comprises:
sending the online dialog to the first large language model; and
receiving a threaded version of the online dialog, wherein the threaded version of the online dialog comprises the first thread portion and the threaded version is generated and output by the first large language model.
6 . The method of claim 1 , wherein formulating the plan execution prompt comprises:
based on the first thread classification, retrieving data associated with a user from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion; and
including the retrieved data in the plan execution prompt.
7 . The method of claim 6 , wherein formulating the plan execution prompt comprises:
based on the first thread classification, retrieving a stored plan template, wherein the retrieved stored plan template comprises a plurality of instructions to be executed by the second large language model; and
including the retrieved plan template and the retrieved data in the plan execution prompt.
8 . The method of claim 1 , wherein the second thread portion comprises a plurality of tasks selected, prioritized, and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
9 . The method of claim 1 , wherein the assessment of a job is summarized and output by the second large language model based on the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
10 . The method of claim 1 , wherein the second thread portion comprises a recommendation that is generated and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
11 . A system comprising:
at least one processor; and
at least one memory device coupled to the at least one processor, wherein the at least one memory device comprises instructions that, when executed by the at least one processor, cause the at least one processor to perform at least one operation comprising:
generating a first thread classification prompt based on a first thread portion of an online dialog presented via an interface;
sending the first thread classification prompt to a first large language model;
receiving a first thread classification, wherein the first thread classification is generated and output by the first large language model based on the first thread classification prompt;
formulating a plan execution prompt based on the first thread classification, wherein in response to determining that at least one stored thread matches the first thread classification, the plan execution prompt is formulated based on the first thread portion and the at least one stored thread that matches the first thread classification;
sending the plan execution prompt to a second large language model;
receiving a second thread portion, wherein the second thread portion is generated and output by the second large language model based on the plan execution prompt and the online dialog, and wherein the second thread portion comprises an assessment of a target entity that is summarized and output by the second large language model based on the plan execution prompt;
generating a label for a third thread portion of the online dialog, wherein the label is based on the first thread classification and the third thread portion comprises the first thread portion and the second thread portion; and
providing the label to the interface.
12 . The system of claim 11 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to perform at least one operation further comprising:
sending the first thread portion to the first large language model;
receiving a tagged version of the first thread portion, wherein the tagged version of the first thread portion comprises entity data associated with the first thread portion and the entity data is generated and output by the first large language model based on data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion;
based on the tagged version of the first thread portion, retrieving a stored classification template, wherein the retrieved classification template comprises at least one instruction to be executed by the first large language model; and
including the retrieved classification template and the retrieved data in the first thread classification prompt.
13 . The system of claim 11 , wherein the instructions, when executed by the at least one processor, cause the at least one processor to perform at least one operation further comprising:
based on the first thread classification, retrieving data associated with a user from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion;
including the retrieved data in the plan execution prompt;
based on the first thread classification, retrieving a stored plan template, wherein the retrieved stored plan template comprises a plurality of instructions to be executed by the second large language model; and
including the retrieved plan template and the retrieved data in the plan execution prompt.
14 . The system of claim 11 , wherein the second thread portion comprises a plurality of tasks selected, prioritized, and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
15 . The system of claim 11 , wherein the assessment of a job is summarized and output by the second large language model based on the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
16 . The system of claim 11 , wherein the second thread portion comprises a recommendation that is generated and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
17 . At least one non-transitory machine readable storage medium comprising instructions that, when executed by the at least one processor, cause the at least one processor to perform at least one operation comprising:
generating a first thread classification prompt based on a first thread portion of an online dialog presented via an interface;
sending the first thread classification prompt to a first large language model;
receiving a first thread classification, wherein the first thread classification is generated and output by the first large language model based on the first thread classification prompt;
formulating a plan execution prompt based on the first thread classification, wherein in response to determining that at least one stored thread matches the first thread classification, the plan execution prompt is formulated based on the first thread portion and the at least one stored thread that matches the first thread classification;
sending the plan execution prompt to a second large language model;
receiving a second thread portion, wherein the second thread portion is generated and output by the second large language model based on the plan execution prompt and the online dialog, and wherein the second thread portion comprises an assessment of a target entity that is summarized and output by the second large language model based on the plan execution prompt;
generating a label for a third thread portion of the online dialog, wherein the label is based on the first thread classification and the third thread portion comprises the first thread portion and the second thread portion; and
providing the label to the interface.
18 . The at least one non-transitory machine readable storage medium of claim 17 , wherein the second thread portion comprises a plurality of tasks selected, prioritized, and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
19 . The at least one non-transitory machine readable storage medium of claim 17 , wherein the assessment of a job is summarized and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.
20 . The at least one non-transitory machine readable storage medium of claim 17 , wherein the second thread portion comprises a recommendation that is generated and output by the second large language model based on the plan execution prompt, the online dialog, and data associated with a user retrieved from at least one of a stored thread, a data source, an entity connection graph, a domain application, or a recommendation system in response to receipt of the first thread portion.