Methods and systems for verifying a worker agent
A method for verifying a worker agent includes receiving, by a core node, from a worker agent, a capability description describing a plurality of tasks and, for each of the plurality of tasks, (i) at least one parameter of the task and (ii) an outcome expected to be produced by performing the task. The method includes generating, based on the capability description, a plurality of request-output pairs, each representing a particular request and a corresponding baseline output expected to be produced upon processing the request. The core node receives, from the worker agent, a plurality of outputs, each of the plurality of outputs generated by the worker agent and corresponding to one of the plurality of request-output pairs. The core node compares the plurality of baseline outputs to the plurality of actual outputs to produce comparison output and determines whether to approve the worker agent based on the comparison output.
1. A method, performed by at least one computer processor executing computer program instructions stored on at least one non-transitory computer-readable medium, for verifying a worker agent, the method comprising:
(A) receiving, by a core node, from a worker agent, a capability description describing a plurality of tasks and, for each of the plurality of tasks, (i) at least one parameter of the task and (ii) an outcome expected to be produced by performing the task;
(B) generating, based on the capability description, a plurality of request-output pairs, each representing a particular request and a corresponding baseline output expected to be produced when the request is processed;
(C) receiving, by the core node, from the worker agent, a plurality of outputs, each of the plurality of outputs generated by the worker agent and corresponding to one of the plurality of request-output pairs;
(D) comparing, by the core node, the plurality of baseline outputs to the plurality of actual outputs to produce comparison output; and
(E) determining whether to approve the worker agent based on the comparison output.
2. The method of claim 1 , wherein (A) further comprises transmitting the predefined set of user requests subsequent to verifying, by the core node, from the worker agent, a response to a cryptographic challenge.
3. The method of claim 1 , wherein (D) further comprises executing a check of accuracy to determine whether the received plurality of outputs satisfies a threshold level of accuracy identified in the received capability description.
4. The method of claim 1 , wherein (D) further comprises executing a check of consistency to determine that the worker agent generates a second plurality of outputs that is substantially consistent with the plurality of outputs received in (C).
5. The method of claim 1 , wherein (D) further comprises executing a response time assessment to determine whether an amount of time lapsed between generating the plurality of request-output pairs and receiving the plurality of outputs satisfies a threshold amount of time identified in the received capability description.
6. The method of claim 1 , wherein (D) further comprises executing a response time assessment to determine whether an amount of utilization of a resource by the worker agent between generating the plurality of request-output pairs and receiving the plurality of outputs satisfies a threshold amount of resource utilization identified in the received capability description.
7. The method of claim 1 further comprising modifying a directory of approved agents to include a worker agent identifier associated with the worker agent.
8. The method of claim 1 further comprising modifying a directory of approved agents to include a cryptographic public key associated with the worker agent.
9. The method of claim 1 further comprises determining, by the core node, to provisionally approve the worker agent.
10. The method of claim 9 further comprises transmitting, by the core node, to the worker agent, an identification of a period of time for which the worker agent is provisionally approved.
11. A system comprising at least one non-transitory computer-readable medium having computer program instructions stored thereon, the computer program instructions being executable by at least one computer processor to perform a method for verifying a worker agent, the method comprising:
(A) receiving, by a core node, from a worker agent, a capability description describing a plurality of tasks and, for each of the plurality of tasks, (i) at least one parameter of the task and (ii) an outcome expected to be produced by performing the task;
(B) generating, based on the capability description, a plurality of request-output pairs, each representing a particular request and a corresponding baseline output expected to be produced when the request is processed;
(C) receiving, by the core node, from the worker agent, a plurality of outputs, each of the plurality of outputs generated by the worker agent and corresponding to one of the plurality of request-output pairs;
(D) comparing, by the core node, the plurality of baseline outputs to the plurality of actual outputs to produce comparison output; and
(E) determining whether to approve the worker agent based on the comparison output.
12. The system of claim 11 , wherein (A) further comprises transmitting the predefined set of user requests subsequent to verifying, by the core node, from the worker agent, a response to a cryptographic challenge.
13. The system of claim 1 , wherein (D) further comprises executing a check of accuracy to determine whether the received plurality of outputs satisfies a threshold level of accuracy identified in the received capability description.
14. The system of claim 11 , wherein (D) further comprises executing a check of consistency to determine that the worker agent generates a second plurality of outputs that is substantially consistent with the plurality of outputs received in (C).
15. The system of claim 11 , wherein (D) further comprises executing a response time assessment to determine whether an amount of time lapsed between generating the plurality of request-output pairs and receiving the plurality of outputs satisfies a threshold amount of time identified in the received capability description.
16. The system of claim 11 , wherein (D) further comprises executing a response time assessment to determine whether an amount of utilization of a resource by the worker agent between generating the plurality of request-output pairs and receiving the plurality of outputs satisfies a threshold amount of resource utilization identified in the received capability description.
17. The system of claim 11 further comprising modifying a directory of approved agents to include a worker agent identifier associated with the worker agent.
18. The system of claim 11 further comprising modifying a directory of approved agents to include a cryptographic public key associated with the worker agent.
19. The system of claim 11 further comprises determining, by the core node, to provisionally approve the worker agent.
20. The system of claim 19 further comprises transmitting, by the core node, to the worker agent, an identification of a period of time for which the worker agent is provisionally approved.