Application discovery using access pattern history
Application discovery from access patterns is disclosed. Access histories from multiple servers are collected and stored at a warehouse, which may be part of a data protection system. A time series analysis is performed on the access history to identify consistency groups and applications from the perspective of devices and storage arrays. Data protection operations such as backup operations can then be performed on the basis of devices or storage in storage arrays or other arrangements that pertain to specific consistency groups or to specific applications.
1. A method, comprising:
generating an aggregated access history for servers, wherein the aggregated access history includes a local access history from each of the servers, wherein the aggregated access history tracks IO (Input/Output) operations between the servers and storage devices, wherein the servers are associated with applications;
determining which of the storage devices were accessed by each of the servers based on an analysis of the aggregated access history to identify consistency groups for each of the applications, wherein the analysis determines which of the applications access which of the storage devices, wherein each of the consistency groups includes storage devices accessed by a corresponding application, wherein each application includes a consistency group, wherein the consistency group of an application includes the storage devices accessed by the application; and
performing a data protection operation on each of the applications, wherein the data protection operation is applied to all of the storage devices in the corresponding consistency group of the application, the data protection operation including a backup operation.
2. The method of claim 1 , further comprising generating, by each server, the local access history, wherein at least one application is a distributed application that executes on more than one of the servers.
3. The method of claim 2 , further comprising transmitting a local access history, by each of the servers, to a corresponding storage array, and aggregating the local access histories at the corresponding storage array, wherein each storage array is associated with an aggregated local history.
4. The method of claim 3 , further comprising sending the aggregated local history of each storage array to a data warehouse associated with a data protection system, wherein the aggregated access history at the data warehouse includes the aggregated local histories from each of the storage arrays.
5. The method of claim 1 , further comprising performing a time series analysis on the access history.
6. The method of claim 5 , further comprising identifying patterns across storage arrays to identify the consistency groups, wherein each of the consistency groups associates one or more of the storage devices with a server, and to identify the applications, wherein each of the applications is associated with one or more of the storage devices.
7. The method of claim 1 , further comprising tuning the analysis with a tuning factor.
8. The method of claim 1 , further comprising performing a backup operation based on the consistency groups or the applications.
9. The method of claim 1 , further comprising identifying fingerprints within the access history, wherein the fingerprints include a delta logical block address and a delta operation type.
10. The method of claim 9 , further comprising creating a ranked list of a cumulative frequency distribution, which corresponds to a total percentage of IO per delta operation type.
11. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to perform operations comprising:
generating an aggregated access history for servers, wherein the aggregated access history includes a local access history from each of the servers, wherein the aggregated access history tracks IO (Input/Output) operations between the servers and storage devices, wherein the servers are associated with applications;
determining which of the storage devices were accessed by each of the servers based on an analysis of the aggregated access history to identify consistency groups for each of the applications, wherein the analysis determines which of the applications access which of the storage devices, wherein each of the consistency groups includes storage devices accessed by a corresponding application, wherein each application includes a consistency group, wherein the consistency group of an application includes the storage devices accessed by the application; and
performing a data protection operation on each of the applications, wherein the data protection operation is applied to all of the storage devices in the corresponding consistency group of the application, the data protection operation including a backup operation.
12. The non-transitory storage medium of claim 11 , the operations further comprising generating, by each server, the local access history, wherein at least one application is a distributed application that executes on more than one of the servers.
13. The non-transitory storage medium of claim 12 , the operations further comprising transmitting a local access history, by each of the servers, to a corresponding storage array, and aggregating the local access histories at the corresponding storage array, wherein each storage array is associated with an aggregated local history.
14. The non-transitory storage medium of claim 13 , the operations further comprising sending the aggregated local history of each storage array to a data warehouse associated with a data protection system, wherein the aggregated access history at the data warehouse includes the aggregated local histories from each of the storage arrays.
15. The non-transitory storage medium of claim 11 , the operations further comprising performing a time series analysis on the access history.
16. The non-transitory storage medium of claim 15 , the operations further comprising identifying patterns across storage arrays to identify the consistency groups, wherein each of the consistency groups associates one or more of the storage devices with a server, and to identify the applications, wherein each of the applications is associated with one or more of the storage devices.
17. The non-transitory storage medium of claim 11 , the operations further comprising tuning the analysis with a tuning factor.
18. The non-transitory storage medium of claim 11 , the operations further comprising performing a backup operation based on the consistency groups or the applications.
19. The non-transitory storage medium of claim 11 , the operations further comprising identifying fingerprints within the access history, wherein the fingerprints include a delta logical block address and a delta operation type.
20. The non-transitory storage medium of claim 11 , the operations further comprising creating a ranked list of a cumulative frequency distribution, which corresponds to a total percentage of IO per delta operation type.