Systems and methods for classifying and transferring information in a storage network
View Patent ↗Systems and methods for data classification to facilitate and improve data management within an enterprise are described. The disclosed systems and methods evaluate and define data management operations based on data characteristics rather than data location, among other things. Also provided are methods for generating a data structure of metadata that describes system data and storage operations. This data structure may be consulted to determine changes in system data rather than scanning the data files themselves.
1. A computer-implemented method for accessing data through a distributed metabase, comprising:
receiving a request to access data stored on a storage device;
selecting at least one of multiple distributed metabases containing metadata related to the data stored on the storage device, wherein the metadata includes metadata other than file system metadata and other than metadata identifying logical locations of the data, and wherein the multiple metabases store metadata related to the data stored on the storage device, and wherein the selecting includes—
determining characteristics of the multiple distributed metabases,
evaluating the characteristics against one or more criteria, and
selecting the at least one metabase based on the evaluation;
analyzing the metadata stored at the at least one metabase to identify a set of data, wherein the set of data is less than the data stored on the storage device;
based on the analysis of the metadata, associating one or more data classifications with a subset of data, wherein—
the subset of data is less than the set of data, and
the one or more data classifications describe characteristics of at least some of the data stored on the storage device; and,
accessing the subset of data based on the metadata contained by the at least one selected metabase and the associated one or more data classifications.
2. The computer-implemented method of claim 1 wherein selecting comprises selecting one of the multiple metabases based on a level of activity of each metabase, wherein the level is past, current, or projected.
3. The computer-implemented method of claim 1 wherein selecting comprises determining a content type of the data and selecting a metabase based on the content type.
4. The computer-implemented method of claim 1 wherein selecting further comprises:
selecting a first metabase;
determining whether the first metabase is available; and
selecting a second metabase when the first metabase is not available.
5. The computer-implemented method of claim 1 wherein selecting comprises determining which of the multiple metabases contains the most recent metadata related to the data.
6. The computer-implemented method of claim 1 wherein selecting comprises determining which of the multiple metabases contains metadata associated with a most recent copy of the data.
7. The computer-implemented method of claim 1 wherein selecting at least one of multiple metabases comprises consulting a metabase index to identify a set of data without accessing the data storage device.
8. The computer-implemented method of claim 1 wherein the request comprises a query to find identified data, and the selected metabase performs the query without accessing the data storage device.
9. The computer-implemented method of claim 1 wherein the selecting includes monitoring the metabases.
10. The computer-implemented method of claim 1 wherein the selecting includes evaluating the characteristics against one or more criteria relating to availability of the metabases.
11. The computer-implemented method of claim 1 , further comprising:
receiving a data management request, wherein the data management request includes one or more criteria and comprises a request to—
identify the subset of data based on the one or more data classifications, and
perform a data storage operation on the subset of data; and,
identifying the subset of data that is associated with one or more data classifications that satisfy the one or more criteria; and
performing the data storage operation requested by the data management request on the subset of data.
12. The computer-implemented method of claim 1 , wherein the metadata of at least one of the multiple metabases is a copy of metadata in another of the multiple metabases.
13. A computer-implemented method for accessing data through a distributed metabase, the method comprising:
receiving a request to access data stored on a storage device;
selecting at least one of multiple distributed metabases based on at least one characteristic of the multiple metabases,
wherein the metabases contain metadata associated with the data stored on the storage device,
wherein the metadata includes metadata other than file system metadata and other than metadata identifying logical locations of the data,
wherein the metadata facilitates performance of data storage operations on the data, and
wherein the characteristic of each of the multiple metabases includes a past, current, or projected level of activity associated with each of the metabases;
analyzing the metadata stored at the at least one metabase to identify a set of data, wherein the set of data is less than the data stored on the storage device;
based on the analysis of the metadata, associating one or more data classifications with a subset of data, wherein—
the subset of data is less than the set of data, and
the one or more data classifications describe characteristics of at least some of the data stored on the storage device; and,
accessing the subset of data based on the metadata contained by the at least one selected metabase and the associated one or more data classifications.
14. The computer-implemented method of claim 13 wherein the selecting includes:
determining the characteristics of the metabases; and
evaluating the characteristics against one or more criteria.
15. The computer-implemented method of claim 13 wherein the selecting further comprises determining which of the multiple metabases contains the most recent metadata related to the data.
16. The computer-implemented method of claim 13 wherein the selecting further comprises determining which of the multiple metabases contains metadata associated with a most recent copy of the data.
17. The computer-implemented method of claim 13 , wherein the metadata of at least one of the multiple metabases is a copy of metadata in another of the multiple metabases.
18. A method for accessing data based on metadata stored in a network, the method comprising:
receiving multiple requests to access data stored on at least one of multiple storage devices accessible via the network;
selecting at least one of multiple distributed metabases containing metadata related to data stored on the multiple storage devices,
wherein the metadata includes metadata other than file system metadata and other than metadata identifying logical locations of the data, and
wherein the classifications include information used to facilitate performance of a data storage operation on the data;
sending at least one of the multiple requests to the at least one selected metabase,
wherein sending the at least one request includes not sending at least some of the multiple requests to the multiple storage devices; and
analyzing the metadata stored at the at least one selected metabase to identify a set of data, wherein the set of data is less than the data stored on the storage device;
based on the analysis of the metadata, associating one or more data classifications with a subset of data, wherein—
the subset of data is less than the set of data, and
the one or more data classifications describe characteristics of at least some of the data stored on the storage device; and,
accessing the subset of data based on the metadata contained by the at least one selected metabase and the associated one or more data classifications.
19. A non-transitory computer-readable medium storing instruction, which when performed by a data processing device, perform a method for accessing data based on metadata stored in a network, the method comprising:
receiving multiple requests to access data stored on one or more storage devices accessible via the network;
selecting at least one of multiple distributed metabases containing metadata related to the data stored on the one or more storage devices,
wherein the metadata includes metadata other than file system metadata and other than metadata identifying logical locations of the data, and
wherein the classifications include information used to facilitate performance of a data storage operation on the data;
sending at least one of the multiple requests to the at least one selected metabase; and
processing the metadata stored at the at least one selected metabase to identify a set of data, wherein the set of data is less than the data stored on the storage device;
based on the processing of the metadata, associating one or more data classifications with a subset of data, wherein—
the subset of data is less than the set of data, and
the one or more data classifications describe characteristics of at least some of the data stored on the storage device; and,
accessing the subset of data based on the metadata contained by the at least one selected metabase and the associated one or more data classifications.
20. The computer-readable medium of claim 19 wherein the selecting includes:
determining the characteristics of the multiple metabases; and
evaluating the characteristics against one or more criteria.
21. The computer-readable medium of claim 19 wherein the selecting further comprises determining which of the multiple metabases contains the most recent metadata related to the data.
22. The computer-readable medium of claim 19 wherein the selecting further comprises determining which of the multiple metabases contains metadata associated with a most recent copy of the data.