Scalable distributed storage system infrastructure

1. A computer-executable method for managing metadata within a distributed data storage system, including a compute node in communication with a data storage array, the computer-executable method comprising:

receiving a data I/O from an application executing within the distributed data storage system; and

creating a first storage system within the compute node, wherein the first storage system is enabled to manage metadata related to the data I/O, wherein the first storage system is enabled to create one or more storage systems within the first storage system to manage the metadata;

dynamically creating and managing a first level of sub storage systems to manage portions of the metadata associated with the data I/O, wherein each of the first level sub storage systems are enabled to create and manage a second level of sub storage systems wherein each of the second level of sub storage systems are enabled to manage portions of the portions of metadata managed by the first level sub storage system associated with each of the second level sub storage systems; and

processing the data I/O using the first storage system, wherein the processing comprises creating a first portion of metadata related to the data I/O; analyzing the first portion of metadata to make a determination based on one or more characteristics of the first portion of metadata; upon a positive determination, creating a second storage system within the compute node, wherein the second storage system is enabled to manage metadata created by the first storage system; creating a second portion of metadata based on the first portion of metadata; and storing the second portion of metadata on the data storage array.

2. The computer-executable method of claim 1 , wherein a first characteristic of the one or more characteristic of the metadata is an amount of the metadata.

3. A system, comprising:

a distributed data storage system including a compute node in communication with a data storage array; and

computer-executable program logic encoded in memory of one or more computers in communication with the distributed data storage system to enable management of metadata within the distributed data storage system, wherein the computer-executable program logic is configured for the execution of:

receiving a data I/O from an application executing within the distributed data storage system; and

creating a first storage system within the compute node, wherein the first storage system is enabled to manage metadata related to the data I/O, wherein the first storage system is enabled to create one or more storage systems within the first storage system to manage the metadata;

dynamically creating and managing a first level of sub storage systems to manage portions of the metadata associated with the data I/O, wherein each of the first level sub storage systems are enabled to create and manage a second level of sub storage systems wherein each of the second level of sub storage systems are enabled to manage portions of the portions of metadata managed by the first level sub storage system associated with each of the second level sub storage systems; and

processing the data I/O using the first storage system 22 , wherein the processing comprises creating a first portion of metadata related to the data I/O; analyzing the first portion of metadata to make a determination based on one or more characteristics of the first portion of metadata; upon a positive determination, creating a second storage system within the compute node, wherein the second storage system is enabled to manage metadata created by the first storage system; creating a second portion of metadata based on the first portion of metadata; and storing the second portion of metadata on the data storage array.

4. The system of claim 3 , wherein a first characteristic of the one or more characteristic of the metadata is an amount of the metadata.

5. A computer program product for managing metadata within a distributed data storage system, including a compute node in communication with a data storage array, the computer program product comprising:

a non-transitory computer readable medium encoded with computer-executable program code for using read signatures in replication, the code configured to enable the execution of:

receiving a data I/O from an application executing within the distributed data storage system; and

creating a first storage system within the compute node, wherein the first storage system is enabled to manage metadata related to the data I/O, wherein the first storage system is enabled to create one or more storage systems within the first storage system to manage the metadata;

dynamically creating and managing a first level of sub storage systems to manage portions of the metadata associated with the data I/O, wherein each of the first level sub storage systems are enabled to create and manage a second level of sub storage systems wherein each of the second level of sub storage systems are enabled to manage portions of the portions of metadata managed by the first level sub storage system associated with each of the second level sub storage systems; and

processing the data I/O using the first storage system 21 , wherein the processing comprises creating a first portion of metadata related to the data I/O; analyzing the first portion of metadata to make a determination based on one or more characteristics of the first portion of metadata; upon a positive determination, creating a second storage system within the compute node, wherein the second storage system is enabled to manage metadata created by the first storage system; creating a second portion of metadata based on the first portion of metadata; and storing the second portion of metadata on the data storage array.

6. The computer program product of claim 5 , wherein a first characteristic of the one or more characteristic of the metadata is an amount of the metadata.