Archiving using data obtained during backup of primary storage
A data storage system can scan one or more information stores of primary storage and analyze the metadata of files stored in the one or more information stores of primary storage to identify multiple, possibly relevant, secondary copy operations that can be performed on the files. The storage system can also identify primary storage usage information of each file during the scan and use that information to generate reports regarding the usage of the primary storage.
1. A method, comprising:
copying, during a backup of one or more non-volatile information stores of primary storage, metadata of a plurality of files stored in the one or more non-volatile information stores to an index, the metadata copied to the index including at least modification date data of each file of the plurality of files, wherein the backup comprises:
identifying a first set of one or more files of the plurality of files for a backup operation based at least in part on a determination that the first set of one or more files were modified since a previous backup date, and
performing the backup operation on the first set of one or more files of the plurality of files, wherein the previous backup date indicates a date when modifications to files in the one or more non-volatile information stores were most recently copied to secondary storage;
following the backup operation of the one or more non-volatile information stores, reviewing the metadata copied to the index during the backup to identify a second set of one or more files of the plurality of files that were last modified prior to a system archival date; and
performing an archive operation on the second set of one or more files of the plurality of files, wherein the archive operation includes replacing a particular file of the second set of one or more files with an identifier indicating a location of one or more copies of the particular file in the secondary storage.
2. The method of claim 1 , wherein the system archival date is based at least in part on at least one of a creation date, last access date, and last modify date of each file.
3. The method of claim 1 , wherein the system archival date is based at least in part on an identity of at least one of a user of each file and a creator of each file.
4. The method of claim 1 , wherein the system archival date is based at least in part on a rating of each file.
5. The method of claim 1 , further comprising verifying the one or more copies of the second set of one or more files are located in the secondary storage prior to performing the archive operation.
6. The method of claim 1 , further comprising identifying primary storage usage data of each file of the plurality of files using the metadata copied to the index.
7. The method of claim 6 , wherein the primary storage usage data of each file comprises at least file size data, disk type data, and volume type data.
8. The method of claim 6 , further comprising generating a report of the primary storage usage data.
9. The method of claim 8 , wherein the report comprises usage trending of the primary storage, fault trending in the primary storage, number of mount points, number of volumes, types of disks in the primary storage, and disk trending.
10. A system, comprising:
one or more processors configured to:
copy, during a backup of one or more non-volatile information stores of primary storage, metadata of a plurality of files stored in the one or more non-volatile information stores to an index, the metadata copied to the index including at least modification date data of each file of the plurality of files, wherein to perform the backup, the one or more processors are configured to:
identify a first set of one or more files of the plurality of files for a backup operation based at least in part on a determination that the first set of one or more files were modified since a previous backup date, and
perform the backup operation on the first set of one or more files of the plurality of files, wherein the previous backup date indicates a date when modifications to files in the one or more non-volatile information stores were most recently copied to secondary storage;
following the backup operation of the one or more non-volatile information stores, review the metadata copied to the index during the backup to identify a second set of one or more files of the plurality of files that were last modified prior to a system archival date; and
perform an archive operation on the second set of one or more files of the plurality of files, wherein the archive operation includes replacing a particular file of the second set of one or more files with an identifier indicating a location of one or more copies of the particular file in the secondary storage.
11. The system of claim 10 , wherein the system archival date is based at least in part on at least one of a creation date, last access date, and last modify date of each file.
12. The system of claim 10 , wherein the system archival date is based at least in part on an identity of at least one of a user of each file and a creator of each file.
13. The system of claim 10 , wherein the system archival date is based at least in part on a rating of each file.
14. The system of claim 10 , wherein the one or more processors are further configured to verify the one or more copies of the second set of one or more files are located in the secondary storage prior to performing the archive operation.
15. The system of claim 10 , wherein the one or more processors are further configured to identify primary storage usage data of each file of the plurality of files using the metadata copied to the index.
16. The system of claim 15 , wherein the primary storage usage data of each file comprises at least file size data, disk type data, and volume type data.
17. The system of claim 15 , wherein the one or more processors are further configured to generate a report of the primary storage usage data.
18. The system of claim 17 , wherein the report comprises usage trending of the primary storage, fault trending in the primary storage, number of mount points, number of volumes, types of disks in the primary storage, and disk trending.
19. Non-transitory computer readable media comprising computer-executable instructions that, when executed by a computing system, cause the computing system to:
copy, during a backup of one or more non-volatile information stores of primary storage, metadata of a plurality of files stored in the one or more non-volatile information stores to an index, the metadata copied to the index including at least modification date data of each file of the plurality of files, wherein the backup comprises:
identifying a first set of one or more files of the plurality of files for a backup operation based at least in part on a determination that the first set of one or more files were modified since a previous backup date, and
performing the backup operation on the first set of one or more files of the plurality of files, wherein the previous backup date indicates a date when modifications to files in the one or more non-volatile information stores were most recently copied to secondary storage;
following the backup operation of the one or more non-volatile information stores, review the metadata copied to the index during the backup to identify a second set of one or more files of the plurality of files that were last modified prior to a system archival date; and
perform an archive operation on the second set of one or more files of the plurality of files, wherein the archive operation includes replacing a particular file of the second set of one or more files with an identifier indicating a location of one or more copies of the particular file in the secondary storage.
20. The non-transitory computer readable media of claim 19 , wherein the non-transitory computer readable media further cause the computing system to verify the one or more copies of the second set of one or more files are located in the secondary storage prior to performing the archive operation.