Decentralized validation of AI-generated responses via blockchain-based consensus
A system configured to generate, based on signaling received from an artificial intelligence (AI) system, a truth token comprising a query received by the AI system and an answer to the query generated by the AI system, wherein the query and the answer are recorded on a blockchain of the truth token, distribute the truth token to one or more AI validation nodes, process, based on signaling received from each of the one or more AI validation nodes, validation answers to the query, wherein each of the one or more AI validation nodes generates an individual validation answer, determine, based on the validation answers, the answer is a validated answer and generate a new block for the truth token comprising an indication the answer is validated, wherein the indication is recorded on the blockchain of the truth token.
1 . A system, comprising:
a processor coupled to memory, the processor configured to:
encrypt a query received by an artificial intelligence (AI) system and an answer to the query generated by the AI system;
generate a truth token comprising the encrypted query and answer, wherein the encrypted query and answer are recorded on a blockchain of the truth token;
distribute the truth token to one or more AI validation nodes;
receive, from each of the one or more AI validation nodes, validation answers to the query, wherein each of the one or more AI validation nodes generates an individual validation answer and wherein each of the validation answers is encrypted with a reveal time;
decrypt each of the validation answers when a corresponding reveal time expires;
determine, based on the validation answers, an answer is a validated answer, wherein the answer is a validated answer when a consensus parameter for the answer satisfies a predetermined threshold, wherein the consensus parameter is based on agreement among the one or more validation nodes on the answer;
generate a new block for the truth token comprising an indication the answer is validated, wherein the indication is recorded on the blockchain of the truth token;
determine a reward for each of the one or more validation nodes;
determine a performance score for each of the one or more AI validation nodes;
determine an overall performance score for all of the one or more AI validation nodes; and
distribute the reward among the one or more AI validation nodes based on a comparison of the performance score of each of the one or more AI validation nodes and the overall performance score.
2 . The system of claim 1 , wherein the one or more validation nodes comprise a federated environment, wherein each of the one or more validation nodes execute on a separate computing infrastructure.
3 . The system of claim 1 , wherein, to determine the answer is a validated answer, the processor is further configured to:
determine a similarity metric between each validation answer and the answer; and
determine a validation answer matches the answer when the similarity metric exceeds a threshold.
4 . The system of claim 3 , wherein determining the similarity metric comprises the processor being configured to:
convert the answer and the validation answer into a list of alpha numeric characters.
5 . The system of claim 3 , wherein the threshold is based on one of the query or the AI validation node.
6 . The system of claim 1 , wherein determining the answer is a validated answer comprises the processor being configured to:
cluster the validation answers into clusters comprising a first cluster than includes a number of validation answers that match the answer and a second cluster that includes a number of validation answers that do not match the answer; and
determine the number of validation answers in the first cluster satisfies a threshold compared to a sum of the number of validation answers in the first cluster and the number of validation answers in the second cluster.
7 . The system of claim 6 , wherein the threshold is based on a number of the one or more validation nodes, a type of the query, a category of the query, a difficulty of the validation or a historical accuracy of the one or more validation nodes.
8 . The system of claim 1 , wherein the indication that the answer is validated further comprises details of validation, wherein the details of validation are recorded on the blockchain of the truth token.
9 . The system of claim 8 , wherein the details of validation include one or more of (a) a number of AI validation nodes the answer was sent to, (b) a number of AI validation nodes that agreed with the answer, (c) a number of AI validation nodes that disagreed with the answer, (d) an identification of the one or more AI validation nodes, or (e) a historical accuracy of the one or more AI validation nodes.
10 . The system of claim 1 , wherein the indication that the answer is validated further comprises a timestamp of when the answer was validated, wherein the timestamp is recorded on the blockchain of the truth token.
11 . The system of claim 1 , wherein the performance score for each of the one or more AI validation nodes is based on a speed with which an AI validation node generated a validation answer or an accuracy of the validation answer generated by the AI validation node.
12 . The system of claim 11 , wherein the speed or accuracy is weighted with respect to the performance score for the AI validation node.
13 . The system of claim 1 , wherein the reward comprises cryptocurrency.
14 . The system of claim 1 , wherein the processor is further configured to:
determine a similarity between the validated answer and a previously stored validated answer;
when the similarity is less than a threshold, store the validated answer; and
when the similarity exceeds a threshold, storing a pointer to the previously stored validated answer and differences between the validated answer and the previously stored validated answer.
15 . A method, comprising:
encrypting a query received by an artificial intelligence (AI) system and an answer to the query generated by the AI system;
generating a truth token comprising the encrypted query and answer, wherein the encrypted query and answer are recorded on a blockchain of the truth token, wherein the encrypted query and answer are independently hashed or compressed on the blockchain;
distributing the truth token to one or more AI validation nodes;
receiving, from each of the one or more AI validation nodes, validation answers to the query, wherein each of the one or more AI validation nodes generates an individual validation answer and wherein each of the validation answers is encrypted with a reveal time;
decrypting each of the validation answers when a corresponding reveal time expires;
determining, based on the validation answers, an answer is a validated answer, wherein the answer is a validated answer when a consensus parameter for the answer satisfies a predetermined threshold, wherein the consensus parameter is based on agreement among the one or more validation nodes on the answer;
generating a new block for the truth token comprising an indication the answer is validated, wherein the indication is recorded on the blockchain of the truth token;
determining a similarity between the validated answer and a previously stored validated answer;
when the similarity is less than a threshold, storing the validated answer; and
when the similarity exceeds a threshold, storing a pointer to the previously stored validated answer and differences between the validated answer and the previously stored validated answer.
16 . A non-transitory computer readable storage medium comprising a set of instructions, wherein, when executed, cause a processor to:
encrypt a query received by an artificial intelligence (AI) system and an answer to the query generated by the AI system;
generate a truth token comprising the encrypted query and answer, wherein the encrypted query and the answer are recorded on a blockchain of the truth token;
distribute the truth token to one or more AI validation nodes;
receive, from each of the one or more AI validation nodes, validation answers to the query, wherein each of the one or more AI validation nodes generates an individual validation answer and wherein each of the validation answers is encrypted with a reveal time;
decrypt each of the validation answers when a corresponding reveal time expires;
determine, based on the validation answers, an answer is a validated answer, wherein the answer is a validated answer when a consensus parameter for the answer satisfies a predetermined threshold, wherein the consensus parameter is based on agreement among the one or more validation nodes on the answer;
generate a new block for the truth token comprising an indication the answer is validated, wherein the indication is recorded on the blockchain of the truth token;
determine a similarity between the validated answer and a previously stored validated answer;
when the similarity is less than a threshold, store the validated answer; and
when the similarity exceeds a threshold, store a pointer to the previously stored validated answer and differences between the validated answer and the previously stored validated answer.