Deduplication of data on distributed storage system involving receiving and modifying metadata from local object store

1. A method for performance optimization in a storage system, the method comprising:

providing a metadata structure that defines a storage space of the storage system;

for each of a plurality of storage objects in the storage system:

monitoring input/output (IO) patterns for IO operations conducted at the storage system;

monitoring deduplication characteristics of the storage object; and

configuring local mapping layer parameters; and

modifying local object metadata in the metadata structure based on results of the monitoring and the configuring, wherein the metadata structure includes a tree structure, and modifying the local object metadata includes reducing a count of pointers in one or more leaves of the tree structure.

2. The method of claim 1 , wherein the metadata structure includes nodes that point to respective virtual logical address nodes, and the virtual logical address nodes point to physical storage nodes for the storage objects residing in the storage system.

3. The method of claim 1 , wherein the IO patterns for the IO operations include at least one of read operations, write operations, block sizes, data duplication sizes and alignments.

4. The method of claim 1 , wherein the local mapping layer parameters include at least one of an optimal block size, an object alignment at a selected granularity, and a dedupe operation at a selected granularity.

5. The method of claim 1 , wherein the configuring is performed in the background with respect to activities conducted at the storage system.

6. The method of claim 1 , wherein the configuring includes reducing a size of the metadata structure.

7. The method of claim 1 , wherein the metadata structure is a multi-level data structure including a top-level node and mid-level nodes, wherein the nodes pointing to respective virtual logical address nodes are leaf nodes, and the mid-level nodes point to the leaf nodes.

8. The method of claim 7 , wherein the configuring includes reducing a number of the leaf nodes in the multi-level metadata structure.

9. A system for performance optimization in a storage system, the system comprising:

a memory comprising computer-executable instructions; and

a processor executing the computer-executable instructions, the computer-executable instructions when executed by the processor cause the processor to perform operations comprising:

providing a metadata structure that defines a storage space of the storage system;

for each of a plurality of storage objects in the storage system:

monitoring input/output (IO) patterns for IO operations conducted at the storage system;

monitoring deduplication characteristics of the storage object; and

configuring local mapping layer parameters; and

modifying local object metadata in the metadata structure based on results of the monitoring and the configuring, wherein the metadata structure includes a tree structure, and modifying the local object metadata includes reducing a count of pointers in one or more leaves of the tree structure.

10. The system of claim 9 , wherein the metadata structure includes nodes that point to respective virtual logical address nodes, and the virtual logical address nodes point to physical storage nodes for the storage objects residing in the storage system.

11. The system of claim 9 , wherein the IO patterns for the IO operations include at least one of read operations, write operations, block sizes, data deduplication sizes, and alignments.

12. The system of claim 9 , wherein the local mapping layer parameters include at least one of an optimal block size, an object alignment at a selected granularity, and a dedupe operation at a selected granularity.

13. The system of claim 9 , wherein the configuring is performed in the background with respect to activities conducted at the storage system.

14. The system of claim 9 , wherein the configuring includes reducing a size of the metadata structure.

15. The system of claim 9 , wherein the metadata structure is a multi-level data structure including a top-level node and mid-level nodes, wherein the nodes pointing to respective virtual logical address nodes are leaf nodes, and the mid-level nodes point to the leaf nodes.

16. The system of claim 15 , wherein the configuring includes reducing a number of the leaf nodes in the multi-level metadata structure.

17. A computer program product for performance optimization in a storage system, the computer program product embodied on a non-transitory computer readable medium, and the computer program product including instructions that, when executed by a computer, causes the computer to perform operations. The operations include:

providing a metadata structure that defines a storage space of the storage system;

for each of a plurality of storage objects in the storage system:

monitoring input/output (IO) patterns for IO operations conducted at the storage system;

monitoring deduplication characteristics of the storage object; and

configuring local mapping layer parameters; and

modifying local object metadata in the metadata structure based on results of the monitoring and the configuring, wherein the metadata structure includes a tree structure, and modifying the local object metadata includes reducing a count of pointers in one or more leaves of the tree structure.

18. The computer program product of claim 17 , wherein the metadata structure includes nodes that point to respective virtual logical address nodes, and the virtual logical address nodes point to physical storage nodes for the storage objects residing in the storage system.

19. The computer program product of claim 17 , wherein the IO patterns for the IO operations include at least one of read operations, write operations, block sizes, and alignments.

20. The computer program product of claim 17 , wherein the local mapping layer parameters include at least one of an optimal block size, an object alignment at a selected granularity, and a dedupe operation at a selected granularity.