Selection of files for archival or deduplication
Various systems and methods for selection of files for archival or deduplication operations are disclosed. For example, one method involves analyzing a plurality of files, where the analyzing is based on one or more archiving policies. The method involves determining whether a first file of the plurality of files is to be archived or deduplicated, where the determining is based at least on the analysis. The method also involves, in response to a determination to archive the first file, generating a request to archive the first file.
1. A method comprising:
analyzing a plurality of files, wherein
the analyzing is based on one or more archiving policies,
the analyzing comprises
determining a percentage of free space on a volume, and
determining whether the percentage of free space is greater than a threshold, and
the plurality of files is stored on the volume;
determining, based on the analyzing, whether a first file of the plurality of files is to be archived;
in response to the analyzing indicating that the percentage of free space is greater than the threshold, selecting the first file for archiving;
determining, based on the analyzing, whether a first file of the plurality of files is to be deduplicated; and
in response to a determination to archive the first file,
generating a request to archive the first file.
2. The method of claim 1 , further comprising
determining whether a second file of the plurality of files is to be archived or deduplicated, wherein
the determining whether the second file is to be archived or deduplicated is based at least on the analysis; and
in response to a determination to deduplicate the second file,
selecting the second file for deduplication.
3. The method of claim 1 , wherein
in response to the determination to archive the first file,
determining whether to deduplicate remaining files of the plurality of files, wherein
the remaining files do not comprise the first file.
4. The method of claim 1 , further comprising
determining whether one or more additional files out of the remaining files are to be archived or deduplicated, wherein
the plurality of files are stored using a plurality of blocks, and
the determining whether the one or more additional files are to be archived or deduplicated comprises determining the additional file(s) that each share at least one respective block of the plurality of blocks with the first file.
5. The method of claim 1 , wherein
the analyzing the plurality of files comprises:
determining a percentage of unique blocks of the each file of the plurality of files, wherein
the plurality of files are stored using a plurality of blocks, and
each of the unique blocks is only used by a respective one of the plurality of files.
6. The method of claim 5 , wherein
at least two of the plurality of files share a first block of the plurality of blocks.
7. The method of claim 5 , wherein
the analyzing the plurality of files further comprises
determining whether the percentage of unique blocks for the first file is greater than a threshold,
in response to a determination that the percentage of unique blocks for the first file is greater than the threshold,
selecting the first file for archiving.
8. The method of claim 1 , wherein
in response to generating the request to archive the first file, detecting a reparse point conflict, wherein
the first file is associated with a first reparse point, and
archiving of the first file includes generation of another reparse point;
detection of the reparse point conflict indicates a conflict between the first reparse point and the another reparse point.
9. The method of claim 1 , further comprising:
in response to a determination not to archive a second file,
generating a request to deduplicate the second file.
10. A system comprising:
one or more processors; and
a control module, wherein the control module is configured to
analyze a plurality of files, wherein
analyzing the plurality of files is based on one or more archiving policies,
the analyzing comprises
determining a percentage of free space on a volume, and
determining whether the percentage of free space is greater than a threshold, and
the plurality of files is stored on the volume,
determine, based on the analyzing, whether a first file of the plurality of files is to be archived,
in response to the analyzing indicating that the percentage of free space is greater than the threshold, select the first file for archiving,
determine, based on the analyzing, whether a first file of the plurality of files is to be deduplicated, and
in response to a determination to archive the first file, generate a request to archive the first file, and
wherein the control module is configured to be executed using the one or more processors.
11. The system of claim 10 , wherein
the control module is further configured to, in response to the determination to archive the first file,
determine whether to deduplicate remaining files of the plurality of files, wherein
the remaining files do not comprise the first file.
12. The system of claim 10 , wherein
the control module being configured to determine whether to deduplicate remaining files of the plurality of files comprises
the control module being further configured to
determine whether one or more additional files out of the remaining files are to be archived or deduplicated, wherein
the plurality of files are stored using a plurality of blocks, and
the control module being configured to determine whether the one or more additional files are to be archived or deduplicated comprises
the control module being configured to determine the additional file(s) that each share at least one respective block of the plurality of blocks with the first file.
13. The system of claim 10 , wherein
the control module being configured to analyze the plurality of files comprises
the control module being further configured to
determine a percentage of unique blocks of the each file of the plurality of files, wherein
the plurality of files are stored using a plurality of blocks, and
each of the unique blocks is only used by a respective one of the plurality of files.
14. The system of claim 10 , wherein
the control module being configured to analyze the plurality of files comprises
the control module being further configured to
determine whether the percentage of unique blocks for the first file is greater than a threshold, and
in response to a determination that the percentage of unique blocks for the first file is greater than the threshold, select the first file for archiving.
15. A non-transitory computer-readable storage medium comprising:
a first set of instructions, executable on a computer system, configured to analyze a plurality of files, wherein
the analyzing is based on one or more archiving policies,
the analyzing comprises
determining a percentage of free space on a volume, and
determining whether the percentage of free space is greater than a threshold, and
the plurality of files is stored on the volume,
a second set of instructions, executable on the computer system, configured to
determine, based on the analyzing, whether a first file of the plurality of files is to be archived,
in response to the analyzing indicating that the percentage of free space is greater than the threshold, select the first file for archiving, and
determine, based on the analyzing, whether a first file of the plurality of files is to be deduplicated, and
a third set of instructions, executable on the computer system, configured to, in response to a determination to archive the first file, generate a request to archive the first file.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the first set of instructions configured to analyze the plurality of files are further configured to
determine a percentage of unique blocks of the each file of the plurality of files, wherein
the plurality of files are stored using a plurality of blocks,
each of the unique blocks is only used by a respective one of the plurality of files.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the first set of instructions configured to analyze the plurality of files are further configured to
determine a percentage of free space on a volume, wherein
the volume is used to store the plurality of files.