Secure retrieval of off-network data by trusted network entities
View Patent ↗Methods and systems for carrying out secure retrieval of off-network data are disclosed. A computing system configured for operating as a validator node of a network of nodes operating a decentralized network may be selected to securely retrieve off-network data for the decentralized network responsive to successfully validating a new data block of the decentralized network. The computing system may then retrieve a queue entry from a queue, and determine from the queue entry a data source of the off-network data. The computing system may then retrieve the off-network data from the data source, generate a cryptographic verification that it carried out the retrieval of the off-network data, and store the cryptographic verification in a verification data structure configured for providing authorization for data entries to be included in future data blocks of the decentralized network.
1 . A method carried out by a computing system configured for operating as a validator node of a network of nodes operating a decentralized network, wherein the network of nodes includes a data-entry pool of pending data entries awaiting inclusion in data blocks of the decentralized network, the method comprising:
responsive to successfully writing a data block of the decentralized network, being eligible to perform a secure data retrieval task for the decentralized network;
responsive to being eligible to perform the secure data retrieval task, retrieving, from a queue, a queue entry;
determining, from the queue entry, a data source of off-network data, wherein the data source is external to the network of nodes, and wherein the queue entry includes an indication that the off-network data comprises target content that has already been delivered to the data-entry pool from the data source;
retrieving the off-network data from the data source, wherein retrieving the off-network data from the data source comprises determining that a destination hash value associated with the target content in the data-entry pool agrees with a source hash value associated with the target content at the data source;
generating a cryptographic verification that the validator node carried out the retrieval of the off-network data, wherein generating the cryptographic verification comprises verifying that the validator node confirmed that the source hash value and destination hash value are the same; and
storing the off-network data and the cryptographic verification on the decentralized network.
2 . The method of claim 1 , further comprising:
receiving conveyance data indicating assignment of a conveyance to the validator node for having retrieved, verified, and stored the off-network data.
3 . The method of claim 2 , wherein the assignment of the conveyance to the validator node is contingent upon the validator node having retrieved, verified, and stored the off-network data.
4 . The method of claim 1 , wherein the queue is at least one of: the data-entry pool, or a data queue implemented externally to the network of nodes.
5 . The method of claim 1 , wherein determining that the destination hash value associated with the target content in the data-entry pool agrees with the source hash value associated with the target content at the data source comprises:
applying a hash function to the target content at the data source to derive the source hash value;
applying the hash function to the target content in the data-entry pool to derive the destination hash value; and
comparing the source hash value with the destination hash value.
6 . The method of claim 1 , wherein retrieving the off-network data from the data source comprises retrieving from the data source a first hash value associated with the target content at the data source,
wherein storing the off-network data and the cryptographic verification on the decentralized network comprises storing the off-network data and the cryptographic verification in a verification data structure configured for providing authorization for further data entries to be included in future data blocks of the decentralized network,
wherein generating the cryptographic verification comprises applying a first hash function to the target content in the data-entry pool to derive a second hash value, and
wherein storing the cryptographic verification in the verification data structure comprises storing the first hash value together with the second hash value in the verification data structure.
7 . The method of claim 6 , wherein the verification data structure comprises a smart contract.
8 . The method of claim 1 , further comprising:
each of one or more additional validator nodes of the network of nodes, responsive to successfully writing the data block of the decentralized network, being eligible to perform a respective secure data retrieval task for the network;
each of the one or more additional validator nodes, responsive to being respectively eligible to perform the secure data retrieval task, retrieving, from the queue, the queue entry;
each of the one or more additional validator nodes determining, from the queue entry, the data source of the off-network data;
each of the one or more additional validator nodes respectively retrieving the off-network data from the data source;
each respective validator node of the one or more additional validator nodes generating a respective cryptographic verification that the respective validator node carried out the retrieval of the off-network data; and
each of the one or more additional validator nodes respectively storing the off-network data and the cryptographic verification on the decentralized network.
9 . The method of claim 8 , further comprising:
making a determination that a threshold number of the validator node and the one or more additional validator nodes have stored the same data; and
responsive to the determination, causing one copy of the off-network data to be included in a subsequent new data block of the decentralized network.
10 . The method of claim 1 , wherein the data source is a status database comprising status records written to the status database by one or more nodes of the decentralized network, wherein each status record includes information indicative of activity of the node on the network, and wherein retrieving the off-network data from the data source comprises:
retrieving one or more of the status records from the status database; and
delivering the one or more of the status records as retrieved directly or indirectly to at least one of the nodes of the network.
11 . The method of claim 1 , wherein the decentralized network comprises a blockchain,
wherein data blocks of the of the decentralized network comprise blocks of the blockchain,
wherein the validator node is a miner node,
and wherein the off-network data comprises off-chain data.
12 . A computing system configured for operating as a validator node of a network of nodes operating a decentralized network, wherein the network of nodes includes a data-entry pool of pending data entries awaiting inclusion in data blocks of the decentralized network, the computing system comprising:
at least one processor; and
memory storing instructions that, when executed by the at least one processor, cause the validator node to carry out operations comprising:
responsive to successfully writing a data block of the decentralized network, being eligible to perform a secure data retrieval task for the decentralized network;
responsive to being eligible to perform the secure data retrieval task, retrieving, from a queue, a queue entry;
determining, from the queue entry, a data source of off-network data, wherein the data source is external to the network of nodes, and wherein the queue entry includes an indication that the off-network data comprises target content that has already been delivered to the data-entry pool from the data source;
retrieving the off-network data from the data source, wherein retrieving the off-network data from the data source comprises determining that a destination hash value associated with the target content in the data-entry pool agrees with a source hash value associated with the target content at the data source;
generating a cryptographic verification that the validator node carried out the retrieval of the off-network data, wherein generating the cryptographic verification comprises verifying that the validator node confirmed that the source hash value and destination hash value are the same; and
storing the off-network data and the cryptographic verification on the decentralized network.
13 . An article of manufacture including a non-transitory computer-readable medium, having stored thereon program instructions that, upon execution by a computing system configured for operating as a validator node of a network of nodes operating a decentralized network, wherein the network of nodes includes a data-entry pool of pending data entries awaiting inclusion in data blocks of the decentralized network, cause the validator node to carry out operations comprising:
responsive to successfully writing a data block of the decentralized network, being eligible to perform a secure data retrieval task for the decentralized network;
responsive to being eligible to perform the secure data retrieval task, retrieving, from a queue, a queue entry;
determining, from the queue entry, a data source of off-network data, wherein the data source is external to the network of nodes, and wherein the queue entry includes an indication that the off-network data comprises target content that has already been delivered to the data-entry pool from the data source;
retrieving the off-network data from the data source, wherein retrieving the off-network data from the data source comprises determining that a destination hash value associated with the target content in the data-entry pool agrees with a source hash value associated with the target content at the data source;
generating a cryptographic verification that the validator node carried out the retrieval of the off-network data, wherein generating the cryptographic verification comprises verifying that the validator node confirmed that the source hash value and destination hash value are the same; and
storing the off-network data and the cryptographic verification on the decentralized network.
14 . The method of claim 1 , wherein the data source and the off-network data at the data source are both external to the decentralized network.
15 . The method of claim 1 , wherein storing the off-network data and the cryptographic verification on the decentralized network comprises storing the off-network data and the cryptographic verification in a verification data structure configured for providing authorization for further data entries to be included in future data blocks of the decentralized network.
16 . The method of claim 1 , wherein being eligible to perform the secure data retrieval task comprises receiving an indication of being selected to perform the secure data retrieval task.