Flexible scheduler for backups
Flexible scheduling for backup jobs includes backup policies that allow for flexibility in scheduling execution time, and an automated data driven backup job execution scheduler. The scheduler balances load on the customer's and data protection system's resources using a dynamic pricing calculator that takes into account the real-time and predicted near-future status of the protection environment. The backup job scheduler includes a user interface that enables users to specify user-customized backup policies that enable flexibility in scheduling execution times and transparency in pricing.
1. A computer-implemented method for flexible backup scheduling in a data protection environment, the method comprising:
determining a real-time status of a data protection environment;
determining a predicted status of the data protection environment;
calculating an expected dynamic price rate for scheduling a backup job based on the determined real-time and predicted statuses of the data protection environment;
presenting a graphical user interface including a plurality of dynamic price rates based on a FLEX parameter of a backup job policy associated with the plurality of dynamic price rates, the plurality of dynamic price rates comprising at least a first dynamic price rate calculated based on a first value of the FLEX parameter and a second dynamic price rate calculated based on a second value of the FLEX parameter, wherein the first dynamic price rate is calculated based on the expected dynamic price rate and the first value of the FLEX parameter, wherein the second dynamic price rate is calculated based on the expected dynamic price rate and the second value of the FLEX parameter, and wherein the FLEX parameter indicates a time within a plus or a minus time shift from a selected one from a plurality of values of the FLEX parameter to start the backup job, wherein a START TIME parameter indicates a start time for the backup job without the time shift;
receiving a user input for a selected one of a plurality of flexible backup schedules that is associated with one of the dynamic price rates for the backup job;
configuring the backup job policy including the START TIME parameter and the FLEX parameter based on the received selection, wherein the start time for the backup job is determined based on the START TIME parameter and the FLEX parameter; and
pricing the backup job in accordance with the selected flexible backup schedule.
2. A computer-implemented method for flexible backup scheduling of claim 1 , the method further comprising:
applying a time series model to historical data for the data protection environment, the historical data including data values for resource utilization of the data protection environment and data values for backup jobs scheduled in the data protection environment, the data values recorded over time; and
determining the predicted status of the data protection environment in accordance with the application of the time series model to the historical data, including a near-future predicted status of the data protection environment.
3. The computer-implemented method for flexible backup scheduling of claim 2 , wherein the time series model is any one or more of an exponential smoothing model and an autoregressive integrated moving average (ARIMA) model.
4. The computer-implemented method for flexible backup scheduling of claim 1 , further comprising:
obtaining real-time performance of the data protection environment, including real-time resource utilization based on key performance indicators; and
determining the real-time status of a data protection environment based on the real-time performance.
5. The computer-implemented method for flexible backup scheduling of claim 1 , wherein the backup job policy further includes any one of a frequency and a type parameter, the method further comprising:
tagging the backup job with the one of the calculated dynamic price rates that is associated with the selected one of the plurality of flexible backup schedules responsive to receiving the user input.
6. A data processing system operating in a data protection environment, comprising:
a policy repository to store one or more backup job policies for scheduling backup jobs that create backups of primary storage in protection storage in a data protection environment;
a processor in communication with the policy repository, the processor configured to:
determine a real-time status of the data protection environment;
determine a predicted status of the data protection environment;
calculate an expected dynamic price rate for scheduling a backup job based on the determined real-time and predicted statuses of the data protection environment;
present a graphical user interface including a plurality of dynamic price rates based on a FLEX parameter of a backup job policy associated with the plurality of dynamic price rates, the plurality of dynamic price rates comprising at least a first dynamic price rate calculated based on a first value of the FLEX parameter and a second dynamic price rate calculated based on a second value of the FLEX parameter, wherein the first dynamic price rate is calculated based on the expected dynamic price rate and the first value of the FLEX parameter, wherein the second dynamic price rate is calculated based on the expected dynamic price rate and the second value of the FLEX parameter, and wherein the FLEX parameter indicates a time within a plus or a minus time shift from a selected one from a plurality of values of the FLEX parameter to start the backup job, wherein a START TIME parameter indicates a start time for the backup job without the time shift;
receive a user input for a selected one of a plurality of the flexible backup schedules that is associated with one of the dynamic price rates for the backup job;
configure the backup job policy including the START TIME parameter and the FLEX parameter based on the received selection, wherein the start time for the backup job is determined based on the START TIME parameter and the FLEX parameter; and
price the backup job in accordance with the selected flexible backup schedules.
7. The data processing system of claim 6 , wherein the processor is further configured to:
apply a time series model to historical data for the data protection environment, the historical data including data values for resource utilization in the data protection environment and data values for backup jobs scheduled in the data protection environment, the data values having been recorded over time; and
determine the predicted status of the data protection environment in accordance with the application of the time series model to the historical data, including a near-future predicted status of the data protection environment.
8. The data processing system of claim 7 , wherein the time series model is any one or more of an exponential smoothing model and an autoregressive integrated moving average (ARIMA) model.
9. The data processing system of claim 6 , wherein the processor is further configured to:
obtain real-time performance of the data protection environment, including real-time resource utilization based on key performance indicators; and
determine the real-time status of a data protection environment based on the real-time performance.
10. The data processing system of claim 6 , further comprising a display interface in communication with the processor and the policy repository, wherein the flexibility window is a scheduling window for the start time, and wherein the backup job policy includes any one of a frequency and a type parameter, the processor further configured to:
tag the backup job with the one of the calculated dynamic price rates that is associated with the selected one of the plurality of flexible backup schedules responsive to receiving the user input.
11. A non-transitory computer-readable storage medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations for flexible backup scheduling in a data protection environment, the operations comprising:
determine a real-time status of a data protection environment;
determine a predicted status of the data protection environment;
calculate an expected dynamic price rate for scheduling a backup job based on the determined real-time and predicted statuses of the data protection environment;
present a graphical user interface including a plurality of dynamic price rates based on a FLEX parameter of a backup job policy associated with the plurality of dynamic price rates, the plurality of dynamic price rates comprising at least a first dynamic price rate calculated based on a first value of the FLEX parameter and a second dynamic price rate calculated based on a second value of the FLEX parameter, wherein the first dynamic price rate is calculated based on the expected dynamic price rate and the first value of the FLEX parameter, wherein the second dynamic price rate is calculated based on the expected dynamic price rate and the second value of the FLEX parameter, and wherein the FLEX parameter indicates a time within a plus or a minus time shift from a selected one from a plurality of values of the FLEX parameter to start the backup job, wherein a START TIME parameter indicates a start time for the backup job without the time shift;
receive a user input for a selected one of a plurality of flexible backup schedule schedules that is associated with one of the dynamic price rate for the backup job;
configure the backup job policy including the START TIME parameter and the FLEX parameter based on the received selection, wherein the start time for the backup job is determined based on the START TIME parameter and the FLEX parameter; and
price the backup job in accordance with the selected flexible backup schedules.
12. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising:
apply a time series model to historical data for the data protection environment, the historical data including data values for resource utilization of the data protection environment and data values for backup jobs scheduled in the data protection environment, the data values recorded over time; and
determine the predicted status of the data protection environment in accordance with the application of the time series model to the historical data, including a near-future predicted status of the data protection environment.
13. The non-transitory computer-readable storage medium of claim 12 , wherein the time series model is any one or more of an exponential smoothing model and an autoregressive integrated moving average (ARIMA) model.
14. The non-transitory computer-readable storage medium of claim 11 , the operations further comprising:
obtain real-time performance of the data protection environment, including real-time resource utilization based on key performance indicators; and
determine the real-time status of a data protection environment based on the real-time performance.
15. The non-transitory computer-readable storage medium of claim 11 , wherein the flexibility window is a flexible scheduling window for the start time, and wherein the backup job policy further includes any one of a frequency and a type parameter, the operations further comprising:
tag the backup job with the one of the calculated dynamic price rates that is associated with the selected one of the plurality of flexible backup schedules responsive to receiving the user input.