Systems and methods for using metadata to enhance data identification operations
Systems and methods for managing electronic data are disclosed. Various data management operations can be performed based on a metabase formed from metadata. Such metadata can be identified from an index of data interactions generated by a journaling module, and obtained from their associated data objects stored in one or more storage devices. In various embodiments, such processing of the index and storing of the metadata can facilitate, for example, enhanced data management operations, enhanced data identification operations, enhanced storage operations, data classification for organizing and storing the metadata, cataloging of metadata for the stored metadata, and/or user interfaces for managing data. In various embodiments, the metabase can be configured in different ways. For example, the metabase can be stored separately from the data objects so as to allow obtaining of information about the data objects without accessing the data objects or a data structure used by a file system.
1. A method for identifying data interactions performed within a computer network, the method comprising:
obtaining information associated with data interactions made by at least one application to one or more data objects stored on one or more primary storage devices in a first format that is native to the at least one application;
copying the one or more data objects with one or more secondary computing devices to create secondary data stored in a second format that is different than the first format;
creating, with the one or more secondary computing devices, at least one metabase comprising metadata associated with data interactions made by the at least one application to the one or more data objects stored on one or more primary storage devices;
displaying with one or more computer processors a user interface that allows a user to input selection criteria; and
using the one or more secondary computing devices to search the metabase to identify the one or more of the data objects on the one or more primary storage devices which meet the selection criteria without accessing the one or more data objects stored on the one or more primary storage devices.
2. The method of claim 1 further comprising storing secondary metadata in the metabase associated with primary data copied to the one or more secondary storage devices.
3. The method of claim 1 further comprising adding metadata to the metabase when the one or more data objects is copied to the secondary storage.
4. The method of claim 1 wherein updating the metabase comprises:
determining whether a selected entry in an index of data interactions has an existing record in the metabase;
if no record exists corresponding to the selected entry, creating a new record in the metabase; and
updating the existing record or the new record in the metabase with at least a part of the information obtained from the selected entry.
5. The method of claim 1 wherein the selection criteria comprises a permission level.
6. The method of claim 1 wherein the metadata further comprises at least one of: a last modified time, a last accessed time, a data object size and an application type.
7. The method of claim 1 wherein the metadata is associated with email and information about the one or more data objects in primary memory is generated by a journaling program.
8. The method of claim 1 wherein the metadata comprises at least one of the group consisting of: to/from information for email, creation date, last accessed time, and application type.
9. The method of claim 1 wherein the one or more data objects copied to secondary storage are deleted from the metabase and copied to another metabase.
10. The method of claim 1 wherein the one or more secondary storage devices are selected to store the one or more data objects copied from the one or more primary storage devices based on the metadata in the metabase.
11. A system for identifying data interactions performed within a computer network, the system comprising:
at least one monitor agent comprising at least computer hardware, the monitor agent obtains information associated with data interactions made by at least one application to one or more data objects stored on one or more primary storage devices in a native format;
one or more secondary computing devices comprising computer hardware that direct the copying of the one or more data objects to the one or more secondary storage devices to create secondary data stored in a second format that is different that the first format;
the one or more secondary computing devices further configured to create at least one metabase comprising metadata associated with interactions made by the at least one application to the one or more data objects stored on the one or more primary storage devices;
the one or more secondary computing devices displaying a user interface that allows a user to input selection criteria; and
the one or more secondary computing devices further configured to search the metabase to identify the one or more data objects on the one or more primary storage devices which meet the selection criteria without accessing the one or more data objects stored on the one or more primary storage devices.
12. The system of claim 11 wherein the metabase is stored separately from the one or more data objects stored in primary memory.
13. The system of claim 11 wherein the one or more secondary computing devices directs addition of metadata to the metabase associated with the one or more data objects copied to the secondary storage.
14. The system of claim 11 wherein the one or more secondary computing devices updates the metadata by:
determining whether a selected entry in an index of data interactions has an existing record in the metabase;
if no record exists corresponding to the selected entry, creating a new record in the metabase; and
updating the existing record or the new record with at least a part of the information obtained from the selected entry.
15. The system of claim 11 wherein the selection criteria comprises a permission level.
16. The system of claim 11 wherein the metadata further comprises at least one of: a last modified time, a last accessed time, a data object size and an application type.
17. The system of claim 11 wherein the metadata is associated with email and the information about the one or more data objects in primary memory is generated by a journaling program.
18. The system of claim 11 wherein the first metadata comprises at least one of the group consisting of: to/from information for email, creation date, last accessed time, and application type.
19. The system of claim 11 wherein the one or more data objects copied to secondary storage are deleted from the metabase and copied to another metabase.
20. The system of claim 11 wherein the one or more secondary storage devices are selected to store the one or more data objects copied from the one or more primary storage devices based on the metadata in the metabase.