System and method for verifying data integrity using a blockchain network
View Patent ↗A system and method provided for verifying data integrity for large volumes of critical data using blockchain technology. An exemplary method includes storing data files in electronic storage; creating a hash values for of each of the files; and transmitting the hash values to a blockchain network in which one or more nodes in the blockchain network adds the first hash values as blocks to the blockchain. Moreover, an API is provided to monitor data operations performed on the data files and transmit metadata of any operations performed to a transaction log. In turn, hash values relating to the data operations are also created and transmitted to the blockchain network to be added as additional blocks in the blockchain, such that the blockchain can be used to verify the accuracy of the data files stored on the electronic storage.
1. A method for reliability storing data, the method comprising:
storing a plurality of data files to an electronic data storage;
creating a first hash value of each of the plurality of data files stored in the electronic data storage;
transmitting the first hash values of each of the plurality of data files to a blockchain network in which at least one node in the blockchain network adds each of the first hash values as one or more blocks in an existing blockchain;
monitoring, by a computer processor, the plurality of data files to detect data operations performed on at least one of the plurality of data files;
creating a second hash value of the metadata relating to the at least one data operation;
transmitting the second hash value to the blockchain network in which at least one node in the blockchain network adds the second hash value as one or more additional blocks in the blockchain, wherein the blockchain is configured to be used to verify the accuracy of the plurality of data files stored on the electronic data storage;
continuously monitoring, by the computer processor, the plurality of data files to identify additional data operations performed on at least one of the data files; and
concurrently creating and transmitting to the blockchain network the first hash value of at least one additional file stored in the electronic data storage and the second hash value of a timestamp of when the at least one additional file was stored in the electronic data storage.
2. The method according to claim 1 , wherein the monitoring of the plurality of data files comprises periodically scanning, by the computer processor, the plurality of data files to detect data operations performed on at least one of the plurality of data files.
3. The method according to claim 1 , wherein the transmitting of the first hash values comprises transmitting the first hash values as part of transaction data that includes file name, file size and storage transaction number of each of the plurality of data files.
4. The method according to claim 1 , further comprising:
upon detecting at least one data operation, adding metadata relating to the at least one data operation to a transaction log.
5. The method according to claim 4 , wherein the adding of metadata relating to the at least one data operation to the transaction log comprises adding a timestamp indicating a date and time of when the at least one data operation was performed on the at least one of the plurality of data files.
6. The method according to claim 5 , wherein the timestamp indicates a time and date when at least one additional file was stored in the electronic data storage.
7. The method according to claim 6 , further comprising concurrently creating and transmitting the first hash value of the at least one additional file and the second hash value of the timestamp.
8. The method according to claim 4 , wherein the adding of metadata relating to the at least one data operation to the transaction log comprises transmitting the metadata to the transaction log, which is stored on a separate computing device from the electronic data storage and the computer processor.
9. A system for reliability storing data, the system comprising:
electronic data storage configured to:
store a plurality of data files,
create a first hash value of each of the plurality of data files,
transmit the first hash values of each of the plurality of data files to a blockchain network in which at least one node in the blockchain network adds each of the first hash values as one or more blocks in an existing blockchain; and
at least one processor configured to:
monitor the plurality of data files stored in the electronic data storage to detect data operations performed on at least one of the plurality of data files,
create a second hash value of the metadata relating to the at least one data operation,
transmit the second hash value to the blockchain network in which at least one node in the blockchain network adds the second hash value as one or more additional blocks in the blockchain, wherein the blockchain is configured to be used to verify the accuracy of the plurality of data files stored on the electronic data storage, and
continuously monitor the plurality of data files to identify additional data operations performed on at least one of the data files; and
wherein the electronic data storage is further configured to concurrently create and transmit to the blockchain network the first hash value of at least one additional file stored in the electronic data storage when the at least one processor creates and transmits the second hash value of a timestamp of when the at least one additional file was stored in the electronic data storage.
10. The system according to claim 9 , wherein the at least one processor is further configured to monitor the plurality of data files by periodically scanning the plurality of data files to detect data operations performed on at least one of the plurality of data files.
11. The system according to claim 9 , wherein the electronic data storage is configured to transmit the first hash values as part of transaction data that includes file name, file size and storage transaction number of each of the plurality of data files.
12. The system according to claim 9 , wherein the at least one processor is further configured to:
upon detecting at least one data operation, add metadata relating to the at least one data operation to a transaction log.
13. The system according to claim 12 , wherein the at least one processor is further configured to add the metadata relating to the at least one data operation to the transaction log by adding a timestamp indicating a date and time of when the at least one data operation was performed on the at least one of the plurality of data files.
14. The system according to claim 13 , wherein the timestamp indicates a time and date when at least one additional file was stored in the electronic data storage.
15. The system according to claim 14 , wherein the electronic data storage creates and transmits the first hash value of the at least one additional file concurrently when the at least one processor creates and transmits the second hash value of the timestamp.
16. The system according to claim 12 , wherein the at least one processor is further configured to add the metadata relating to the at least one data operation to the transaction log by transmitting the metadata to the transaction log, which is stored on a separate computing device from the electronic data storage and the computer processor.
17. A non-transitory computer readable medium storing computer executable instructions for reliability storing data, including instructions for:
storing a plurality of data files to an electronic data storage;
creating a first hash value of each of the plurality of data files stored in the electronic data storage;
transmitting the first hash values of each of the plurality of data files to a blockchain network in which at least one node in the blockchain network adds each of the first hash values as one or more blocks in an existing blockchain;
monitoring the plurality of data files to detect data operations performed on at least one of the plurality of data files;
creating a second hash value of the metadata relating to the at least one data operation;
transmitting the second hash value to the blockchain network in which at least one node in the blockchain network adds the second hash value as one or more additional blocks in the blockchain, wherein the blockchain is configured to be used to verify the accuracy of the plurality of data files stored on the electronic data storage; and
continuously monitoring the plurality of data files to identify additional data operations performed on at least one of the data files; and
concurrently creating and transmitting to the blockchain network the first hash value of at least one additional file stored in the electronic data storage and the second hash value of a timestamp of when the at least one additional file was stored in the electronic data storage.
18. The non-transitory computer readable medium according to claim 17 , further comprising instructions for:
upon detecting at least one data operation, adding metadata relating to the at least one data operation to a transaction log.
19. The non-transitory computer readable medium according to claim 18 , further including instructions for adding of metadata relating to the at least one data operation to the transaction log by adding a timestamp indicating a date and time of when the at least one data operation was performed on the at least one of the plurality of data files.
20. The non-transitory computer readable medium according to claim 19 , wherein the timestamp indicates a time and date when at least one additional file was stored in the electronic data storage.