Deleting orphan archived files from storage array using a time-based decision algorithm
Methods, apparatus, and processor-readable storage media for deleting orphan archived files from a storage array using a time-based decision algorithm are provided herein. An example computer-implemented method includes traversing a database of a local storage system to identify a record associated with a stub file, wherein the record is indicative of a time of a client operation, involving the stub file, on a file system of the local storage system; identifying a particular snapshot in a set of available snapshots of the file system; and providing an indication to a cloud storage platform to delete a cloud object corresponding to the stub file in response to determining that the time of the client operation occurred earlier than a snapshot time associated with the particular snapshot in the set.
1. A computer-implemented method comprising:
traversing a database of a local storage system to identify a record associated with a stub file, wherein the record is indicative of a time of a client operation, involving the stub file, on a file system of the local storage system;
identifying a particular snapshot in a set of available snapshots of the file system of the local storage system, wherein the particular snapshot comprises the oldest snapshot in the set; and
providing an indication to a cloud storage platform to delete a cloud object corresponding to the stub file in response to determining that the time of the client operation occurred earlier than a snapshot time associated with the particular snapshot in the set, wherein the cloud object comprises a file from the file system that was previously sent from the local storage system to the cloud storage platform;
wherein the method is performed by at least one processing device comprising a processor coupled to a memory.
2. The computer-implemented method of claim 1 , wherein the stub file comprises a pointer to a location of the cloud object within the cloud storage platform.
3. The computer-implemented method of claim 1 , wherein the client operation comprises at least one of:
a request to delete the stub file from the local storage system; and
a request to rehydrate the stub file using data from the cloud object.
4. The computer-implemented method of claim 1 , further comprising:
generating the record associated with the stub file in response to the client operation by moving the stub file from a user space of the local storage system to the database.
5. The computer-implemented method of claim 1 , wherein the traversing the database of the local storage system is performed periodically.
6. The computer-implemented method of claim 1 , further comprising:
in response to determining that the time of the client operation occurred later than the snapshot time associated with the particular snapshot in the set, preventing the cloud object from being deleted from the cloud storage platform.
7. The computer-implemented method of claim 1 , wherein the providing the indication to the cloud storage platform further comprises deleting the record in the database.
8. The computer-implemented method of claim 1 , further comprising:
maintaining the record in the database in response to determining that the time of the client operation occurred later than a snapshot time associated with the particular snapshot in the set.
9. A non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device:
to traverse a database of a local storage system to identify a record associated with a stub file, wherein the record is indicative of a time of a client operation, involving the stub file, on a file system of the local storage system;
to identify a particular snapshot in a set of available snapshots of the file system of the local storage system, wherein the particular snapshot comprises the oldest snapshot in the set; and
to provide an indication to a cloud storage platform to delete a cloud object corresponding to the stub file in response to determining that the time of the client operation occurred earlier than a snapshot time associated with the particular snapshot in the set, wherein the cloud object comprises a file from the file system that was previously sent from the local storage system to the cloud storage platform.
10. The non-transitory processor-readable storage medium of claim 9 , wherein the stub file comprises a pointer to a location of the cloud object within the cloud storage platform.
11. The non-transitory processor-readable storage medium of claim 9 , wherein the client operation comprises at least one of:
a request to delete the stub file from the local storage system; and
a request to rehydrate the stub file using data from the cloud object.
12. The non-transitory processor-readable storage medium of claim 9 , wherein the at least one processing device is further caused:
to generate the record associated with the stub file in response to the client operation by moving the stub file from a user space of the local storage system to the database.
13. The non-transitory processor-readable storage medium of claim 9 , wherein the traversing the database of the local storage system is performed periodically.
14. The non-transitory processor-readable storage medium of claim 9 , wherein the at least one processing device is further caused:
in response to determining that the time of the client operation occurred later than the snapshot time associated with the particular snapshot in the set, prevent the cloud object from being deleted from the cloud storage platform.
15. The non-transitory processor-readable storage medium of claim 9 , wherein the providing the indication to the cloud storage platform further comprises deleting the record in the database.
16. The non-transitory processor-readable storage medium of claim 9 , wherein the at least one processing device is further caused:
to maintain the record in the database in response to determining that the time of the client operation occurred later than a snapshot time associated with the particular snapshot in the set.
17. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured:
to traverse a database of a local storage system to identify a record associated with a stub file, wherein the record is indicative of a time of a client operation, involving the stub file, on a file system of the local storage system;
to identify a particular snapshot in a set of available snapshots of the file system of the local storage system, wherein the particular snapshot comprises the oldest snapshot in the set; and
to provide an indication to a cloud storage platform to delete a cloud object corresponding to the stub file in response to determining that the time of the client operation occurred earlier than a snapshot time associated with the particular snapshot in the set, wherein the cloud object comprises a file from the file system that was previously sent from the local storage system to the cloud storage platform.
18. The apparatus of claim 17 , wherein the stub file comprises a pointer to a location of the cloud object within the cloud storage platform.
19. The apparatus of claim 17 , wherein the client operation comprises at least one of:
a request to delete the stub file from the local storage system; and
a request to rehydrate the stub file using data from the cloud object.
20. The apparatus of claim 17 , wherein the at least one processing device is further configured:
to generate the record associated with the stub file in response to the client operation by moving the stub file from a user space of the local storage system to the database.