METHODS OF INTELLIGENTLY ROUTING PORTIONS OF A TASK THROUGH MULTIPLE CUSTOMIZED AGENTS, AND SYSTEMS AND DEVICES THEREFOR
This application describes, amongst other things, methods and systems for building and deploying agents. An example method includes obtaining orchestration data about a set of task-specific components, where each respective task-specific components in the set of task-specific components is configured to assist with a respective task of a plurality of tasks. The method also includes receiving a prompt related to one or more tasks of the plurality of tasks and selecting a subset of task-specific components based on the prompt and the orchestration data. The method further includes coordinating, via a routing agent, interactions between the task-specific components, including providing data related to the prompt to the task-specific components and receiving responses from the task-specific components, and generating a complete response to the prompt that addresses the one or more tasks using the responses from the task-specific components.
1 . A method, comprising:
obtaining orchestration data about a set of task-specific components, wherein each respective task-specific components in the set of task-specific components is configured to assist with a respective task of a plurality of tasks;
receiving a prompt related to one or more tasks of the plurality of tasks;
selecting a subset of task-specific components from the set of task-specific components based on the prompt and the orchestration data;
coordinating, via a routing agent, interactions between the subset of task-specific components, including providing data related to the prompt to the subset of task-specific components and receiving responses from the subset of task-specific components; and
generating a complete response to the prompt that addresses the one or more tasks using the responses from the subset of task-specific components.
2 . The method of claim 1 , wherein the responses from the subset of task-specific components comprise:
a first response that indicates a patient cohort, and
a second response that indicates an elevated level of risk of a disease for one or more members of the patient cohort.
3 . The method of claim 1 , wherein medical data is provided with the prompt related to the one or more tasks.
4 . The method of claim 1 , further comprising:
in accordance with receiving the prompt, presenting a workflow representation to a user, the workflow representation comprising a plurality of interconnected nodes, wherein each respective node of the plurality of interconnected nodes is associated with a respective task-specific machine-learning model of the set of task-specific machine-learning models; and
providing query data associated with the prompt to a first node of the workflow representation.
5 . The method of claim 1 , wherein the orchestration data includes one or more of:
a set of input parameters for the set of task-specific components, wherein the set of input parameters includes respective data types for each respective input parameter of the set of input parameters;
a set of output parameters for the set of task-specific components, wherein the set of output parameters includes respective data types for each respective output parameter of the set of output parameters; and
a respective domain of a plurality of domains of an input space corresponding to query data associated with prompt.
6 . The method of claim 1 , further comprising determining, via the routing agent, an order in which each respective task-specific component of the subset of task-specific components is to be utilized to prepare the complete response.
7 . The method of claim 1 , wherein the set of task-specific components comprises a set of task-specific machine-learning models and a set of tools.
8 . A computing system, comprising:
control circuitry;
memory; and
one or more sets of instructions stored in the memory and configured for execution by the control circuitry, the one or more sets of instructions comprising instructions for:
obtaining orchestration data about a set of task-specific components, wherein each respective task-specific components in the set of task-specific components is configured to assist with a respective task of a plurality of tasks;
receiving a prompt related to one or more tasks of the plurality of tasks;
selecting a subset of task-specific components from the set of task-specific components based on the prompt and the orchestration data;
coordinating, via a routing agent, interactions between the subset of task-specific components, including providing data related to the prompt to the subset of task-specific components and receiving responses from the subset of task-specific components; and
generating a complete response to the prompt that addresses the one or more tasks using the responses from the subset of task-specific components.
9 . The computing system of claim 8 , wherein the responses from the subset of task-specific components comprise:
a first response that indicates a patient cohort, and
a second response that indicates an elevated level of risk of a disease for one or more members of the patient cohort.
10 . The computing system of claim 8 , wherein medical data is provided with the prompt related to the one or more tasks.
11 . The computing system of claim 8 , wherein the orchestration data includes one or more of:
a set of input parameters for the set of task-specific components, wherein the set of input parameters includes respective data types for each respective input parameter of the set of input parameters;
a set of output parameters for the set of task-specific components, wherein the set of output parameters includes respective data types for each respective output parameter of the set of output parameters; and
a respective domain of a plurality of domains of an input space corresponding to query data associated with prompt.
12 . The computing system of claim 8 , wherein the one or more sets of instructions further comprise instructions for determining, via the routing agent, an order in which each respective task-specific component of the subset of task-specific components is to be utilized to prepare the complete response.
13 . The computing system of claim 8 , wherein the set of task-specific components comprises a set of task-specific machine-learning models and a set of tools.
14 . The computing system of claim 8 , wherein the one or more sets of instructions further comprise instructions for:
in accordance with receiving the prompt, presenting a workflow representation to a user, the workflow representation comprising a plurality of interconnected nodes, wherein each respective node of the plurality of interconnected nodes is associated with a respective task-specific machine-learning model of the set of task-specific machine-learning models; and
providing query data associated with the prompt to a first node of the workflow representation.
15 . A non-transitory computer-readable storage medium storing one or more sets of instructions configured for execution by a computing device having control circuitry and memory, the one or more sets of instructions comprising instructions for:
obtaining orchestration data about a set of task-specific components, wherein each respective task-specific components in the set of task-specific components is configured to assist with a respective task of a plurality of tasks;
receiving a prompt related to one or more tasks of the plurality of tasks;
selecting a subset of task-specific components from the set of task-specific components based on the prompt and the orchestration data;
coordinating, via a routing agent, interactions between the subset of task-specific components, including providing data related to the prompt to the subset of task-specific components and receiving responses from the subset of task-specific components; and
generating a complete response to the prompt that addresses the one or more tasks using the responses from the subset of task-specific components.
16 . The non-transitory computer-readable storage medium of claim 15 , wherein the responses from the subset of task-specific components comprise:
a first response that indicates a patient cohort, and
a second response that indicates an elevated level of risk of a disease for one or more members of the patient cohort.
17 . The non-transitory computer-readable storage medium of claim 15 , wherein medical data is provided with the prompt related to the one or more tasks.
18 . The non-transitory computer-readable storage medium of claim 15 , wherein the orchestration data includes one or more of:
a set of input parameters for the set of task-specific components, wherein the set of input parameters includes respective data types for each respective input parameter of the set of input parameters;
a set of output parameters for the set of task-specific components, wherein the set of output parameters includes respective data types for each respective output parameter of the set of output parameters; and
a respective domain of a plurality of domains of an input space corresponding to query data associated with prompt.
19 . The non-transitory computer-readable storage medium of claim 15 , wherein the one or more sets of instructions further comprise instructions for determining, via the routing agent, an order in which each respective task-specific component of the subset of task-specific components is to be utilized to prepare the complete response.
20 . The non-transitory computer-readable storage medium of claim 15 , wherein the set of task-specific components comprises a set of task-specific machine-learning models and a set of tools.