Efficient name space organization in a global name space cluster
Described is a system for reclaiming unused storage space when distributing backup data to storage performance-based tiers within a clustered storage environment. The clustered storage environment may organize nodes into storage performance tiers, and each node within a tier may be tuned for a particular type of workload. Accordingly, the system implements a file system that provides the ability to reclaim unused storage space (e.g. perform garbage collection) for specific nodes or tiers independently despite implementing a global namespace. The global namespace may group (or co-locate) aspects of file information with the backup files. For example, file information may be stored on the same node that stores the associated backup files. Accordingly, the system may reclaim unused storage space for each node, or set of nodes forming a storage performance tier, independently and efficiently.
1. A system comprising:
one or more processors; and
a non-transitory computer readable medium storing a plurality of instructions, which when executed, cause the one or more processors to:
receive, at a clustered storage environment, backup data and a tier identifier associated with the backup data, the clustered storage environment including a set of nodes organized into a set of storage performance tiers, each of the nodes storing a storage allocation map for backup files stored by the node;
store the backup data as part of a first backup file within a first node of a first storage performance tier, in response to determining the first storage performance tier is identified by the tier identifier;
update the storage allocation map of the first node, in response to storing the backup data as part of the first backup file;
receive an indication to reclaim unused storage space within the clustered storage environment, the indication specifying unused storage space only within the first storage performance tier;
identify, for at least the first node independently, the unused storage space associated with the backup files stored within the first node by accessing the storage allocation map; and
reclaim the unused storage space associated with the first backup file, in response to identifying at least the first backup file is associated with the unused storage space.
2. The system of claim 1 , wherein the plurality of instructions, when executed, further cause the one or more processors to:
store first file information created for the first backup file within a global namespace stored by a specialized node; and
store the received tier identifier as part of the first file information for the first backup file.
3. The system of claim 2 , wherein identifying the unused storage space within the first node by accessing the storage allocation map is performed without accessing the specialized node.
4. The system of claim 1 , wherein the first storage performance tier includes the first node and a second node.
5. The system of claim 4 , wherein the plurality of instructions, when executed, further cause the one or more processors to:
identify, for at least the second node independently and in parallel with the first node, unused storage space associated with the backup files stored within the second node by accessing a storage allocation map of the second node.
6. The system of claim 1 , wherein the file information for backup files stored within the nodes of each storage performance tier are stored as an independent component of the global namespace, the global namespace is represented as a B+ tree data structure, and the independent component of the global namespace includes a branch of the B+ tree.
7. The system of claim 1 , wherein the set of storage performance tiers includes at least a storage performance tier storing deduplicated data, and a storage performance tier storing non-deduplicated data.
8. The system of claim 7 , wherein storing the backup data as part of the first backup file within the first node of the first storage performance tier includes storing the backup data directly to the first backup file without performing a deduplication processing, in response to determining the storage performance tier storing non-deduplicated data is identified by the tier identifier as the first storage performance tier.
9. A method comprising:
receiving, at a clustered storage environment, backup data and a tier identifier associated with the backup data, the clustered storage environment including a set of nodes organized into a set of storage performance tiers, each of the nodes storing a storage allocation map for backup files stored by the node;
storing, by the clustered storage environment, the backup data as part of a first backup file within a first node of a first storage performance tier, in response to determining the first storage performance tier is identified by the tier identifier;
updating the storage allocation map of the first node, in response to storing the backup data as part of the first backup file;
receiving an indication to reclaim unused storage space within the clustered storage environment, the indication specifying unused storage space only within the first storage performance tier;
identifying, for at least the first node independently, the unused storage space associated with the backup files stored within the first node by accessing the storage allocation map; and
reclaiming the unused storage space associated with the first backup file, in response to identifying at least the first backup file is associated with the unused storage space.
10. The method of claim 9 , further comprising:
storing first file information created for the first backup file within a global namespace stored by a specialized node; and
storing the received tier identifier as part of the first file information for the first backup file.
11. The method of claim 10 , wherein identifying the unused storage space within the first node by accessing the storage allocation map is performed without accessing the specialized node.
12. The method of claim 9 , wherein the first storage performance tier includes the first node and a second node.
13. The method of claim 12 , further comprising:
identifying, for at least the second node independently and in parallel with the first node, unused storage space associated with the backup files stored within the second node by accessing a storage allocation map of the second node.
14. The method of claim 9 , wherein the file information for backup files stored within the nodes of each storage performance tier are stored as an independent component of the global namespace, the global namespace is represented as a B+ tree data structure, and the independent component of the global namespace includes a branch of the B+ tree.
15. A computer program product comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein to be executed by one or more processors, the program code including instructions to:
receive, at a clustered storage environment, backup data and a tier identifier associated with the backup data, the clustered storage environment including a set of nodes organized into a set of storage performance tiers, each of the nodes storing a storage allocation map for backup files stored by the node;
store the backup data as part of a first backup file within a first node of a first storage performance tier, in response to determining the first storage performance tier is identified by the tier identifier;
update the storage allocation map of the first node, in response to storing the backup data as part of the first backup file;
receive an indication to reclaim unused storage space within the clustered storage environment, the indication specifying reclaiming unused storage space only within the first storage performance tier;
identify, for at least the first node independently, the unused storage space associated with the backup files stored within the first node by accessing the storage allocation map; and
reclaim the unused storage space associated with the first backup file, in response to identifying at least the first backup file is associated with the unused storage space.
16. The computer program product of claim 15 , wherein the program code includes further instructions to:
store first file information created for the first backup file within a global namespace stored by a specialized node; and
store the received tier identifier as part of the first file information for the first backup file.
17. The computer program product of claim 16 , wherein identifying the unused storage space within the first node by accessing the storage allocation map is performed without accessing the specialized node.
18. The computer program product of claim 15 , wherein the first storage performance tier includes the first node and a second node.
19. The computer program product of claim 18 , wherein the program code includes further instructions to:
identify, for at least the second node independently and in parallel with the first node, unused storage space associated with the backup files stored within the second node by accessing a storage allocation map of the second node.
20. The computer program product of claim 15 , wherein the file information for backup files stored within the nodes of each storage performance tier are stored as an independent component of the global namespace, the global namespace is represented as a B+ tree data structure, and the independent component of the global namespace includes a branch of the B+ tree.