Blockchain-enabled storage array
The present disclosure relates to establishing a tightly coupled integration between a decentralized blockchain network and a centralized storage array. In embodiments, a first set of storage operations on a snapshot of a storage array are performed. Further, data blocks generated from the snapshot are broadcast to at least one computing network for the at least one computing network's nodes to perform a second set of storage operations.
1. A method comprising:
performing a first set of storage operations on a snapshot of a storage array;
forming a dedicated communications tunnel between the storage array and a primary chain link node of at least one computing network, including a computing node chain, wherein the dedicated communications tunnel is formed by logically grouping a set of direct communications channels established between the storage array and the primary chain link node; and
broadcasting data blocks generated from the snapshot to the primary chain link node for the computing chain node to perform a second set of storage operations via the dedicated communications tunnel, wherein the second set of storage operations includes verifying and storing metadata hashes of the data blocks in a blockchain maintained by the computing node chain.
2. The method of claim 1 , wherein the storage array is a centralized storage array and the at least one computing network is a private decentralized network of computing nodes.
3. The method of claim 1 , further comprising qualifying the storage array as a full node of the computing network, wherein qualifying the storage array as the full node includes provisioning at least a first threshold amount of the storage array's resources for performing the first set of storage operations.
4. The method of claim 1 , further comprising:
provisioning the computing network's nodes with light node resources to perform the second set of storage operations, wherein an amount of computing resources corresponding to the light node resources are less than an amount of computing resources required to perform the first set of storage operations.
5. The method of claim 1 , wherein performing the first set of storage operations, includes pre-processing the data blocks.
6. The method of claim 5 , wherein pre-processing the snapshot includes generating a first data block of the snapshot's data blocks having at least a header and a payload.
7. The method of claim 6 , further comprising:
generating a first hash using the snapshot's corresponding metadata;
inserting the first hash in the first data block's header; and
filling the first data block's payload with the metadata.
8. The method of claim 7 , further comprising:
generating a second data block of the snapshot's data blocks, wherein generating the second data block includes:
generating a second hash from the first hash,
inserting the second hash into the second data block's header, and
filling the second data block's payload with the first hash.
9. The method of claim 8 , further comprising:
enabling each of the computing network's nodes to verify at least the first and second data blocks; and
authorizing each of the computing network's nodes to store at least the first and second data blocks in response to a positive verification.
10. The method of claim 1 , further comprising:
monitoring one or more input/output (IO) workloads received by the storage array;
identifying one or more IO write patterns related to each IO workload;
generating at least one predictive array snapshot based on the identified IO write patterns; and
in response to a current IO workload including at least one IO write operation, generating the snapshot within a threshold response time.
11. An apparatus configured to a memory and processor configured to:
perform a first set of storage operations on a snapshot of a storage array;
form a dedicated communications tunnel between the storage array and a primary chain link node of at least one computing network, including a computing node chain, wherein the dedicated communications tunnel is formed by logically grouping a set of direct communications channels established between the storage array and the primary chain link node; and
broadcast data blocks generated from the snapshot to the primary chain link node for the computing chain node to perform a second set of storage operations via the dedicated communications tunnel, wherein the second set of storage operations includes verifying and storing metadata hashes of the data blocks in a blockchain maintained by the computing node chain.
12. The apparatus of claim 11 , wherein the storage array is a centralized storage array and the at least one computing network is a private decentralized network of computing nodes.
13. The apparatus of claim 11 , further configured to qualify the storage array as a full node of the computing network, wherein qualifying the storage array as the full node includes provisioning at least a first threshold amount of the storage array's resources for performing the first set of storage operations.
14. The apparatus of claim 11 , further configured to:
provision the computing network's nodes with light node resources to perform the second set of storage operations, wherein an amount of computing resources corresponding to the light node resources are less than an amount of computing resources required to perform the first set of storage operations.
15. The apparatus of claim 11 , wherein the first set of storage operations includes pre-processing the data blocks.
16. The apparatus of claim 15 , wherein pre-processing the snapshot includes generating a first data block of the snapshot's data blocks having at least a header and a payload.
17. The apparatus of claim 16 , further configured to:
generate a first hash using the snapshot's corresponding metadata;
insert the first hash in the first data block's header; and
fill the first data block's payload with the metadata.
18. The apparatus of claim 17 , further configured to:
generate a second data block of the snapshot's data blocks, wherein to generate the second data block, processor and memory are further configured to:
generate a second hash from the first hash,
insert the second hash into the second data block's header, and
fill the second data block's payload with the first hash.
19. The apparatus of claim 18 , further configured to:
enable each of the computing network's nodes to verify at least the first and second data blocks; and
authorize each of the computing network's nodes to store at least the first and second data blocks in response to a positive verification.
20. The apparatus of claim 11 , further configured to:
monitor one or more input/output (IO) workloads received by the storage array;
identify one or more IO write patterns related to each IO workload;
generate at least one predictive array snapshot based on the identified IO write patterns; and
in response to a current IO workload including at least one IO write operation, generate the snapshot within a threshold response time.