Data labeling awareness for backup systems
Embodiments for a method performing data migration such as backups and restores in a network by identifying characteristics of data in a data saveset to separate the data into defined types based on respective characteristics, assigning a data label to each defined type, defining migration rules for each data label, discovering assigned labels during a migration operation; and applying respective migration rules to labeled data in the data saveset. The migration rules can dictate storage location, access rights, replication periods, retention periods, and similar parameters.
1. A computer-implemented method of migrating data in a network, comprising:
identifying characteristics of data in a data saveset to separate the data into defined types based on respective characteristics;
assigning a data label to each defined type;
identifying patterns in each defined type, wherein the patterns comprise personal identification information (PII) including name, address, social security number, and phone number;
defining the identified patterns as regular expressions for storage in a database;
define migration rules for each data label, wherein the migration rules dictate storage location, access rights, replication periods, retention periods, and similar parameters;
discovering assigned data labels during a migration operation;
applying respective migration rules to labeled data in the data saveset.
2. The method of claim 1 wherein the patterns are known patterns defined by an industry or customary usage, or are user defined patterns.
3. The method of claim 1 wherein the data identifying step comprises performing full content indexing of the dataset using one of an inline or post-process indexing operation.
4. The method of claim 1 wherein the data identifying step comprises using a current name or file extension of each file of the data saveset.
5. The method of claim 1 further comprising:
determining whether the data saveset is already labeled;
using, if so, an existing label instead of an assigned label; and
saving the existing label as part of a backup catalog.
6. The method of claim 5 further comprising storing the existing label in a location selected from: an extended attributes region of a filesystem of the saveset, within each individual file of the saveset, or in a separate database.
7. The method of claim 6 further comprising, discovering, by the migration operation, the existing data label to add it to its own backup catalog that identifies each file with a corresponding data label.
8. The method of claim 1 wherein the characteristics comprise factors including: file type, access, source, age, application, importance, and size.
9. The method of claim 1 wherein the migration operation comprises one of: backing up data from a data source to a storage target, replicating data in the network, restoring data from the storage target, and performing disaster recovery operations in the network.
10. A system migrating data in a network between data sources and target storage, comprising:
a processor;
the processor is configured to:
initiate a data migration operation;
identify characteristics of data in a data saveset to separate the data into defined types based on respective characteristics;
assign a data label to each defined type;
identify patterns in each defined type, wherein the patterns comprise personal identification information (PII) including name, address, social security number, and phone number;
define the identified patterns as regular expressions for storage in a database;
define migration rules for each data label, wherein the migration rules dictate storage location, access rights, replication periods, and similar parameters;
discover assigned data labels during a migration operation;
apply respective migration rules to labeled data in the data saveset.
11. The system of claim 10 wherein the characteristics comprise factors including: file type, access, source, age, application, importance, and size.
12. The system of claim 11 wherein the processor is further configured to perform full content indexing of the dataset using one of an inline or post-process indexing operation.
13. The system of claim 12 wherein the patterns are known patterns defined by an industry or customary usage, or are user defined patterns.
14. The system of claim 12 wherein the processor is further configured to determine whether the data saveset is already labeled, and if so, uses an existing label instead of an assigned label; and saves the existing label as part of a backup catalog.
15. The system of claim 14 further wherein the existing label is stored in a location selected from: an extended attributes region of a filesystem of the saveset, within each individual file of the saveset, or in a separate database.
16. The system of claim 15 wherein the backup component, processor is further configured to discover the existing data label to add it to its own backup catalog that identifies each file with a corresponding data label, and wherein the data migration operation comprises one of: backing up data from a data source to a storage target, replicating data in the network, restoring data from the storage target, and performing disaster recovery operations in the network.