Predictive capacity calculation backup modeling
View Patent ↗One example method includes surveying a computing environment, creating a profile for a data source discovered during surveying of the computing environment, wherein the profile includes information concerning a particular type of the data source, and creating a map that includes the profile. These processes may be performed by a profiler. The method also includes generating a data storage capacity forecast based in part on information contained in the profile. Generation of the data storage capacity forecast may be performed by a predictive engine.
1. A method, comprising:
surveying a computing environment, wherein surveying the computing environment comprises:
identifying a client in the computing environment;
identifying a configuration of the client; and
identifying, for the client, an amount of client data targeted for backup;
generating, by a profiler based on the surveying, a client-specific profile for the client, wherein the client-specific profile includes characteristics of the client;
for a target storage device that is operable to receive, from a backup server that includes a backup application, a backup dataset that includes some of the client data targeted for backup and is operable to store the received client data, generating a target storage device profile that includes one or more characteristics of the target storage device, wherein the target storage device profile is generated by a device connector associated with the target storage device, wherein the device connector serves to connect the target storage device with the backup server that includes the backup application such that a backup generated by the backup application can be transmitted by the backup server to the target storage device by way of the device connector;
with a predictive engine that obtains data from a profile database that stores the target device storage profile generated by the device connector and that obtains data from a connector database that stores information about the device connector, correlating the target storage device with the client data targeted for backup, and the correlating is based on the data obtained by the predictive engine from the profile database and from the connector database;
generating, by the predictive engine using a machine learning process, a data storage capacity forecast based in part on the correlating, wherein the data storage capacity forecast relates to an amount of data storage space projected to be consumed by a backup of the client data targeted for backup; and
running, by the backup server, a backup process that backs up the client data targeted for backup at the target storage device, and the backup process is performed when the data storage capacity forecast indicates that adequate data storage space is and/or will be available to support the backup process.
2. The method as recited in claim 1 , wherein the client-specific profile comprises any one or more of: a raw source capacity of the client; an extent to which the client data targeted for backup has been, or can be, deduplicated; and, an extent to which the client data targeted for backup has been, or can be, compressed.
3. The method as recited in claim 1 , wherein generating a data storage capacity forecast using the machine learning process implemented by the predictive engine comprises one of: updating, in real time, an existing data storage capacity forecast based upon information included in the client-specific profile and/or the target storage device profile; or, generating, in real time, a new data storage capacity forecast based upon information included in the client-specific profile and/or the target storage device profile.
4. The method as recited in claim 1 , wherein the target storage device profile comprises any one or more of: information concerning whether or not data deduplication is enabled for the target device; whether or not data compression is enabled for the target device; a raw capacity of the target device; and, a current utilization of a storage capacity of the target device.
5. The method as recited in claim 1 , wherein the data storage capacity forecast is generated for the target storage device based at least in part upon an amount of data that can be stored by the target storage device, an amount of data to be handled by the target storage device on a particular time basis, a current utilization of the target storage device, and a loading factor for the target storage device.
6. The method as recited in claim 1 , wherein the data storage capacity forecast is expressed in terms of a time to replenish storage capacity.
7. The method as recited in claim 1 , wherein the data storage capacity forecast is expressed in terms of a time to replenish storage capacity, and the time to replenish storage capacity is expressed as: current utilization x loading factor.
8. The method as recited in claim 1 , further comprising gathering information concerning usage of the target storage device, wherein the information comprises a basis for generation of the data storage capacity forecast.
9. The method as recited in claim 1 , further comprising creating a map of the client data that is backed up by the backup process.
10. A non-transitory storage medium having stored therein instructions which are executable by one or more hardware processors to perform operations comprising:
surveying a computing environment, wherein surveying the computing environment comprises:
identifying a client in the computing environment;
identifying a configuration of the client; and
identifying, for the client, an amount of client data targeted for backup;
generating, by a profiler based on the surveying, a client-specific profile for the client, wherein the client-specific profile includes characteristics of the client;
for a target storage device that is operable to receive, from a backup server that includes a backup application, a backup dataset that includes some of the client data targeted for backup and is operable to store the received client data, generating a target storage device profile that includes one or more characteristics of the target storage device, wherein the target storage device profile is generated by a device connector associated with the target storage device, wherein the device connector serves to connect the target storage device with the backup server that includes the backup application such that a backup generated by the backup application can be transmitted by the backup server to the target storage device by way of the device connector;
with a predictive engine that obtains data from a profile database that stores the target device storage profile generated by the device connector and that obtains data from a connector database that stores information about the device connector, correlating the target storage device with the client data targeted for backup, and the correlating is based on the data obtained by the predictive engine from the profile database and from the connector database;
generating, by the predictive engine using a machine learning process, a data storage capacity forecast based in part on the correlating, wherein the data storage capacity forecast relates to an amount of data storage space projected to be consumed by a backup of the client data targeted for backup; and
running, by the backup server, a backup process that backs up the client data targeted for backup at the target storage device, and the backup process is performed when the data storage capacity forecast indicates that adequate data storage space is and/or will be available to support the backup process.
11. The non-transitory storage medium as recited in claim 10 , wherein the client-specific profile comprises any one or more of: a raw source capacity of the client; an extent to which the client data targeted for backup has been, or can be, deduplicated; and, an extent to which the client data targeted for backup has been, or can be, compressed.
12. The non-transitory storage medium as recited in claim 10 , wherein generating a data storage capacity forecast using the machine learning process implemented by the predictive engine comprises one of: updating, in real time, an existing data storage capacity forecast based upon information included in the client-specific profile and/or one of the target storage device profile; or, generating, in real time, a new data storage capacity forecast based upon information included in the client-specific profile and/or one of the target storage device profile.
13. The non-transitory storage medium as recited in claim 10 , wherein the target storage device profile comprises any one or more of: information concerning whether or not data deduplication is enabled for the target device; whether or not data compression is enabled for the target device; a raw capacity of the target device; and, a current utilization of a storage capacity of the target device.
14. The non-transitory storage medium as recited in claim 10 , wherein the data storage capacity forecast is generated for the target storage device based at least in part upon an amount of data that can be stored by the target storage device, an amount of data to be handled by the target storage device on a particular time basis, a current utilization of the target storage device, and a loading factor for the target storage device.
15. The non-transitory storage medium as recited in claim 10 , wherein the data storage capacity forecast is expressed in terms of a time to replenish storage capacity.
16. The non-transitory storage medium as recited in claim 10 , wherein the data storage capacity forecast is expressed in terms of a time to replenish storage capacity, and the time to replenish storage capacity is expressed as: current utilization x loading factor.
17. The non-transitory storage medium as recited in claim 10 , wherein the operations further comprise gathering information concerning usage of the target storage device, wherein the information comprises a basis for generation of the data storage capacity forecast.
18. The non-transitory storage medium as recited in claim 10 , wherein the operations further creating a map of the client data that is backed up by the backup process.
19. A system, comprising:
one or more hardware processors; and
a non-transitory storage medium having stored therein instructions which are executable by the one or more hardware processors to perform operations comprising:
surveying a computing environment, wherein surveying the computing environment comprises:
identifying a client in the computing environment;
identifying a configuration of the client; and
identifying, for the client, an amount of client data targeted for backup;
generating, by a profiler based on the surveying, a client-specific profile for the client, wherein the client-specific profile includes characteristics of the client;
for a target storage device that is operable to receive, from a backup server that includes a backup application, a backup dataset that includes some of the client data targeted for backup and is operable to store the received client data, generating a target storage device profile that includes one or more characteristics of the target storage device, wherein the target storage device profile is generated by a device connector associated with the target storage device, wherein the device connector serves to connect the target storage device with the backup server that includes the backup application such that a backup generated by the backup application can be transmitted by the backup server to the target storage device by way of the device connector;
with a predictive engine that obtains data from a profile database that stores the target device storage profile generated by the device connector and that obtains data from a connector database that stores information about the device connector, correlating the target storage device with the client data targeted for backup, and the correlating is based on the respective data obtained by the predictive engine from the profile database and from the connector database;
generating, by the predictive engine using a machine learning process, a data storage capacity forecast based in part on the correlating, wherein the data storage capacity forecast relates to an amount of data storage space projected to be consumed by a backup of the client data targeted for backup; and
running, by the backup server, a backup process that backs up the client data targeted for backup at the target storage device, and the backup process is performed when the data storage capacity forecast indicates that adequate data storage space is and/or will be available to support the backup process.
20. The system as recited in claim 19 , wherein generating a data storage capacity forecast using the machine learning process implemented by the predictive engine comprises one of: updating, in real time, an existing data storage capacity forecast based upon information included in the client-specific profile and/or the target storage device profile; or, generating, in real time, a new data storage capacity forecast based upon information included in the client-specific profile and/or the target storage device profile.