Digital delegate computer system architecture for improved multi-agent large language model (LLM) implementations

1. A multi-Large Language Model (LLM), multi-agent, digital delegate computer system, comprising:

an identity server comprising at least one electronic processing device;

a non-transitory access entitlement data store device in communication with the identity server, the access entitlement data store device storing access entitlement data in relation to user identification data;

a multi-agent LLM server comprising a plurality of electronic processing devices and being in communication with the identity server; and

a non-transitory LLM data store device in communication with the multi-agent LLM server, the LLM data store device storing (i) instructions defining a primary LLM agent, (ii) instructions defining a primary LLM; (iii) data descriptive of a plurality of LLM tools, (iv) instructions defining, for each LLM tool of the plurality of LLM tools, a secondary LLM agent, and (v) operating instructions, that when executed by the plurality of electronic processing devices, result in:

receiving, by the multi-agent LLM server and from a user device, a user request comprising a prompt and an indication of an identifier of a user of the user device;

identifying, by the identity server and utilizing the identifier of the user to query the access entitlement data store, at least one access entitlement assigned to the user;

identifying, by an execution of the primary LLM agent by the multi-agent LLM server, and based on the at least one access entitlement assigned to the user, and by querying the data descriptive of the plurality of LLM tools, a subset of LLM tools from the plurality of LLM tools that the user is entitled access to;

generating, by the primary LLM and utilizing both the prompt and the identified subset of LLM tools from the plurality of LLM tools that the user is entitled access to, and after the identification of the subset of LLM tools from the plurality of LLM tools that the user is entitled access to, a multi-tier plan for responding to the user request, wherein the multi-tier plan defines a plurality of actions, with each action being assigned to one of the LLM tools from the identified subset of LLM tools;

executing, by the primary LLM agent, the multi-tier plan, by:

(i) calling a secondary LLM agent assigned to each respective one of the LLM tools from the identified subset of tools for the plurality of actions of the multi-tier plan; and

(ii) receiving, from each secondary LLM agent and in response to the calling, a response for each of the actions of the multi-tier plan;

constructing, by the primary LLM agent and utilizing the responses for the actions of the multi-tier plan, a user response; and

transmitting, by the primary LLM agent and to the user device, the user response.

2. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein the execution by the plurality of electronic processing devices further results in:

transmitting, by the multi-agent LLM server and to the identity server, the identifier of the user; and

wherein the identifying of the at least one access entitlement assigned to the user is conducted in response to the transmitting of the identifier of the user by the multi-agent LLM server.

3. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein the at least one access entitlement assigned to the user comprises a suite of access entitlements defined by a role assigned to the user.

4. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein each LLM tool from the subset of tools from the plurality of LLM tools that the user is entitled access to comprises a different secondary LLM.

5. The multi-LLM, multi-agent, digital delegate computer system of claim 4 , wherein the execution by the plurality of electronic processing devices further results in:

executing, in response to the calling and by each of the called secondary LLM agents, a respective secondary LLM.

6. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein the multi-tier plan is generated as a text file.

7. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein the generating of the multi-tier plan is based on a subset of the data descriptive of the plurality of LLM tools that corresponds to the identified subset of LLM tools from the plurality of LLM tools that the user is entitled access to.

8. The multi-LLM, multi-agent, digital delegate computer system of claim 7 , wherein the subset of the data that corresponds to the identified subset of LLM tools from the plurality of LLM tools that the user is entitled access to comprises at least one of: (i) a cost of each LLM tool, (ii) a bandwidth of each LLM tool, (iii) a rating of each LLM tool, and (iv) a historic performance metric of each LLM tool.

9. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein each action of the plurality of actions of the multi-tier plan is defined by the primary LLM based on a different goal derived by the primary LLM from the prompt.

10. The multi-LLM, multi-agent, digital delegate computer system of claim 9 , wherein each LLM tool assigned to each action of the plurality of actions of the multi-tier plan is selected by the primary LLM based on a stored indication of an ability of each LLM tool to handle the respective assigned action.

11. The multi-LLM, multi-agent, digital delegate computer system of claim 10 , wherein the stored indication of the ability of each LLM tool to handle the respective assigned action is derived from previous performance data for the respective LLM tool.

12. The multi-LLM, multi-agent, digital delegate computer system of claim 10 , wherein the stored indication of the ability of each LLM tool to handle the respective assigned action comprises at least one of a score and a ranking.

13. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein the user response is utilized to update at least a portion of the data descriptive of a plurality of LLM tools stored in the non-transitory LLM data store device.

14. The multi-LLM, multi-agent, digital delegate computer system of claim 1 , wherein the responses for the actions of the multi-tier plan are utilized to update at least a portion of the data descriptive of a plurality of LLM tools stored in the non-transitory LLM data store device.