Method and apparatus to have snapshots for the files in a tier in a de-duplication file system
Embodiments are described for performing a storage tier-specific file system operation in a file system that comprises a namespace that spans multiple tiers of storage. A file system command can be a tier-specific deletion of files in a multi-tier file system, or a move data operation from a first tier of storage to a second tier of storage, affecting both the first and second tier of storage. The file system command can generate a copy of the namespace for the first tier of storage and a snapshot of the data of the first tier of storage referenced in the file system operation. Functionality may be performed using one or more storage appliances, each of which can have its open processing system, memory and storage device(s). Storage tiers can include active tier, cloud tier, and remote or archive storage tier.
1. A computer-implemented method comprising:
receiving, by a file system storage device that comprises a namespace that spans multiple file system tiers, a request to perform a tier-specific file system operation that affects a plurality of file system tiers;
in response to receiving the request:
generating from the namespace that spans multiple file system tiers a tier-specific namespace that corresponds to the tier-specific file system operation and contains directory and file entries only for a tier specified in the tier-specific file system operation;
generating, using the tier-specific namespace, a tier-specific snapshot of data associated with the tier-specific namespace; and
executing the tier-specific file system operation;
wherein generating the tier-specific namespace comprises:
traversing the namespace that spans multiple tiers to identify namespace entries that are associated with the specified tier and the specified file system operation;
adding the identified namespace entries to the tier-specific namespace;
and wherein generating the tier-specific data comprises using the tier-specific namespace entries to identify, and adding to the tier-specific snapshot, tier-specific data associated with the tier-specific file system operation.
2. The method of claim 1 , wherein a storage tier of the multiple file system tiers comprises one of: active storage, cloud storage, and archive storage.
3. The method of claim 1 , wherein the file system operation comprises one of:
performing a tier-specific file system deletion of files, or moving data from a first storage tier to a second storage tier, and the storage tier specified in the tier-specific file system operation comprises the first tier of storage.
4. The method of claim 1 , practiced on a storage device that comprises an active storage tier.
5. The method of claim 4 , wherein the storage tier specified in the tier-specific file operation is other than the active storage tier.
6. The method of claim 1 , further comprising:
prior to performing the file system operation, locking a portion of the namespace that spans multiple tiers, the locked portion corresponding to at least a portion of the tier-specific namespace.
7. A non-transitory computer-readable medium programmed with executable instructions that, when executed by a processing system having at least one hardware processor, perform operations comprising:
receiving, by a file system storage device that comprises a namespace that spans multiple file system tiers, a request to perform a tier-specific file system operation that affects a plurality of file system tiers;
in response to receiving the request:
generating from the namespace that spans multiple file system tiers a tier-specific namespace that corresponds to the tier-specific file system operation and contains directory and file entries only for a tier specified in the tier-specific file system operation;
generating, using the tier-specific namespace, a tier-specific snapshot of data associated with the tier-specific namespace; and
executing the tier-specific file system operation;
wherein generating the tier-specific namespace comprises:
traversing the namespace that spans multiple tiers to identify namespace entries that are associated with the specified tier and the specified file system operation;
adding the identified namespace entries to the tier-specific namespace;
and wherein generating the tier-specific data comprises using the tier-specific namespace entries to identify, and adding to the tier-specific snapshot, tier-specific data associated with the tier-specific file system operation.
8. The medium of claim 7 , wherein a storage tier of the multiple file system tiers comprises one of: active storage, cloud storage, and archive storage.
9. The medium of claim 7 , wherein the file system operation comprises one of:
performing a tier-specific file system deletion of files, or moving data from a first storage tier to a second storage tier, and the tier specified in the tier-specific file system operation comprises the first tier of storage.
10. The medium of claim 7 , wherein the operations are practiced on a storage device that comprises an active storage tier.
11. The medium of claim 10 , wherein the storage tier specified in the tier-specific file operation is other than the active storage tier.
12. The medium of claim 7 , the operations further comprising:
prior to performing the file system operation, locking a portion of the namespace that spans multiple tiers, the locked portion corresponding to at least a portion of the tier-specific namespace.
13. A system comprising:
a processing system having at least one hardware processor, the processing system coupled to a memory programmed with executable instructions that, when executed by the processing system, perform operations comprising:
receiving, by a file system storage device that comprises a namespace that spans multiple file system tiers, a request to perform a tier-specific file system operation that affects a plurality of file system tiers;
in response to receiving the request:
generating from the namespace that spans multiple file system tiers a tier-specific namespace that corresponds to the tier-specific file system operation and contains directory and file entries only for a tier specified in the tier-specific file system operation;
generating, using the tier-specific namespace, a tier-specific snapshot of data associated with the tier-specific namespace; and
executing the tier-specific file system operation,
wherein generating the tier-specific namespace comprises:
traversing the namespace that spans multiple tiers to identify namespace entries that are associated with the specified tier and the specified file system operation;
adding the identified namespace entries to the tier-specific namespace;
and wherein generating the tier-specific data comprises using the tier-specific namespace entries to identify, and adding to the tier-specific snapshot, tier-specific data associated with the tier-specific file system operation.
14. The system of claim 13 , wherein a storage tier of the multiple file system tiers comprises one of: active storage, cloud storage, and archive storage.
15. The system of claim 13 , wherein the file system operation comprises one of:
performing a tier-specific file system deletion of files, or moving data from a first storage tier to a second storage tier, and the tier specified in the tier-specific file system operation comprises the first tier of storage.
16. The system of claim 13 , wherein the operations are practiced on a storage device that comprises an active storage tier.
17. The system of claim 16 , wherein the storage tier specified in the tier-specific file operation is other than the active storage tier.
18. The system of claim 13 , the operations further comprising:
prior to performing the file system operation, locking a portion of the namespace that spans multiple tiers, the locked portion corresponding to at least a portion of the tier-specific namespace.