Managing files according to categories
According to various embodiments, with respect to a target set of files being managed (e.g., protected by data snapshots), each file in the target set of files is classified into one of two or more filesets (discontiguous filesets), where each of these filesets comprises one or more files that are related to each other by one or more factors, such as frequency of file change or purpose of existence (e.g., used by a software application). Once classified, files within the target set of files can be uniquely processed by a data management operation (e.g., incremental data snapshot process) according to their association to a discontiguous fileset.
1. A method, comprising:
classifying a target set of files by associating each file in the target set of files with a respective fileset class of a plurality of fileset classes based on a respective file rank for the file, each fileset class of the plurality of fileset classes being associated with a different set of file ranks, and each fileset class of the plurality of fileset classes being associated with a different time interval of a plurality of snapshot generation time intervals;
generating a first incremental data snapshot for the target set of files based on the plurality of fileset classes and according to the plurality of snapshot generation time intervals associated with the plurality of fileset classes; and
generating a second incremental data snapshot for the target set of files based on the plurality of fileset classes and according to the plurality of snapshot generation time intervals associated with the plurality of fileset classes.
2. The method of claim 1 , wherein generating the first incremental data snapshot comprises:
storing first delta data for each file in the target set of files that has experienced a first data block change or a first file metadata change since a prior snapshot for the file.
3. The method of claim 1 , further comprising:
reclassifying, after generating the first incremental data snapshot, the target set of files by associating each file in the target set of files with a respective new fileset class of the plurality of fileset classes based on a respective new file rank for the file.
4. The method of claim 3 , wherein the second incremental data snapshot is generated after reclassifying the target set of files.
5. The method of claim 3 , further comprising:
updating, based at least in part on generating the first incremental data snapshot, a respective change count associated with one or more files of the target set of files, wherein the reclassifying of the target set of files uses the respective change count associated with the one or more files.
6. The method of claim 1 , wherein generating the second incremental data snapshot comprises:
storing second delta data for each file in the target set of files that has experienced a second data block change or a second file metadata change since the first incremental data snapshot for the file.
7. The method of claim 1 , further comprising:
generating, for each file of the target set of files, the respective file rank for the file based at least in part on an association of the file with a respective software application of a plurality of software applications.
8. The method of claim 7 , further comprising:
obtaining respective significance ranks for the plurality of software applications, wherein, for each file of the target set of files, the respective file rank for the file is based at least in part on the respective significance rank for the respective software application that is associated with the file.
9. The method of claim 1 , further comprising:
generating, for each file of the target set of files, the respective file rank for the file based at least in part on a frequency of file data change across one or more prior data snapshots for the file.
10. A computer system, comprising:
one or more memories storing processor-executable instructions; and
one or more processors coupled with the one or more memories and operable to execute the instructions to cause the computer system to:
classify a target set of files by associating each file in the target set of files with a respective fileset class of a plurality of fileset classes based on a respective file rank for the file, each fileset class of the plurality of fileset classes being associated with a different set of file ranks, and each fileset class of the plurality of fileset classes being associated with a different time interval of a plurality of snapshot generation time intervals;
generate a first incremental data snapshot for the target set of files based on the plurality of fileset classes and according to the plurality of snapshot generation time intervals associated with the plurality of fileset classes; and
generate a second incremental data snapshot for the target set of files based on the plurality of fileset classes and according to the plurality of snapshot generation time intervals associated with the plurality of fileset classes.
11. The computer system of claim 10 , wherein, to generate the first incremental data snapshot, the one or more processors are operable to execute the instructions to cause the computer system to:
store first delta data for each file in the target set of files that has experienced a first data block change or a first file metadata change since a prior snapshot for the file.
12. The computer system of claim 10 , wherein the one or more processors are operable to execute the instructions to cause the computer system to:
reclassify, after generating the first incremental data snapshot, the target set of files by associating each file in the target set of files with a respective new fileset class of the plurality of fileset classes based on a respective new file rank for the file.
13. The computer system of claim 12 , wherein the one or more processors are operable to execute the instructions to cause the computer system to generate the second incremental data snapshot after reclassifying the target set of files.
14. The computer system of claim 12 , wherein the one or more processors are further operable to execute the instructions to cause the computer system to:
update, based at least in part on generating the first incremental data snapshot, a respective change count associated with one or more files of the target set of files, wherein the one or more processors are operable to execute the instructions to cause the computer system to reclassify the target set of files using the respective change count associated with the one or more files.
15. The computer system of claim 10 , wherein, to generate the second incremental data snapshot, the one or more processors are operable to execute the instructions to cause the computer system to:
store second delta data for each file in the target set of files that has experienced a second data block change or a second file metadata change since the first incremental data snapshot for the file.
16. A non-transitory computer-readable medium storing instructions executable by one or more processors to:
classify a target set of files by associating each file in the target set of files with a respective fileset class of a plurality of fileset classes based on a respective file rank for the file, each fileset class of the plurality of fileset classes being associated with a different set of file ranks, and each fileset class of the plurality of fileset classes being associated with a different time interval of a plurality of snapshot generation time intervals;
generate a first incremental data snapshot for the target set of files based on the plurality of fileset classes and according to the plurality of snapshot generation time intervals associated with the plurality of fileset classes; and
generate a second incremental data snapshot for the target set of files based on the plurality of fileset classes and according to the plurality of snapshot generation time intervals associated with the plurality of fileset classes.
17. The non-transitory computer-readable medium of claim 16 , wherein, to generate the first incremental data snapshot, the instructions are executable by the one or more processors to:
store first delta data for each file in the target set of files that has experienced a first data block change or a first file metadata change since a prior snapshot for the file.
18. The non-transitory computer-readable medium of claim 16 , wherein the instructions are further executable by the one or more processors to:
reclassify, after generating the first incremental data snapshot, the target set of files by associating each file in the target set of files with a respective new fileset class of the plurality of fileset classes based on a respective new file rank for the file.
19. The non-transitory computer-readable medium of claim 18 , wherein the instructions are executable by the one or more processors to generate the second incremental data snapshot after reclassifying the target set of files.
20. The non-transitory computer-readable medium of claim 18 , wherein the instructions are further executable by the one or more processors to:
update, based at least in part on generating the first incremental data snapshot, a respective change count associated with one or more files of the target set of files, wherein the instructions are executable by the one or more processors to reclassify the target set of files using the respective change count associated with the one or more files.