Automated capacity provisioning method using historical performance data
The method may include collecting performance data relating to processing nodes of a computer system which provide services via one or more applications, analyzing the performance data to generate an operational profile characterizing resource usage of the processing nodes, receiving a set of attributes characterizing expected performance goals in which the services are expected to be provided, and generating at least one provisioning policy based on an analysis of the operational profile in conjunction with the set of attributes. The at least one provisioning policy may specify a condition for re-allocating resources associated with at least one processing node in a manner that satisfies the performance goals of the set of attributes. The method may further include re-allocating, during runtime, the resources associated with the at least one processing node when the condition of the at least one provisioning policy is determined as satisfied.
1. A method for automatically allocating computer resources in a computer system, the method comprising:
obtaining performance data characterizing the computer system, the computer system implementing services with fluctuating demand over time;
generating a system resource usage profile based on the performance data, the performance data comprising central processing unit (CPU) utilization data and response time data, the response time data defined for one or more of transactions, workloads, jobs, tasks, applications, or threads comprising the services;
receiving service level objectives for the services, the service level objectives characterizing a manner in which the services are provided to users over time;
automatically generating one or more provisioning policies based on the system resource usage profile and one or more of the service level objectives, including executing a series of workload scenarios, the workload scenarios including combinations of workload levels and service level objectives; and
provisioning the computer resources based on at least one of the provisioning policies, wherein the provisioning includes:
allocating one or more additional servers for a first time slot of a plurality of time slots in response to the response time data being greater than a first threshold level; and
allocating one or more additional servers for a second time slot of the plurality of time slots in response to the CPU utilization data being greater than a second threshold level.
2. The method of claim 1 , wherein the provisioning the computer resources based on at least one of the provisioning policies includes activating at least one server to process transactions and de-activating at least one server to stop processing transactions.
3. The method of claim 1 , wherein at least one of the service level objectives indicate an arrival value for transactions at a server of the computer system.
4. The method of claim 1 , wherein the system resource usage profile characterizes resource usage of the computer resources of the computer system over time.
5. The method of claim 1 , wherein the automatically generating one or more provisioning policies based on the system resource usage profile and one or more of the service level objectives includes analyzing the system resource usage profile and one or more of the service level objections within at least one of a trending analysis or a predictive analysis.
6. The method of claim 1 , further comprising:
collecting new performance data while the computer system is executing the services;
re-generating the system resource usage profile based on the new performance data; and
updating at least one of the provisioning policies based on an analysis of the re-generated system resource usage profile in view of one or more of the service level objectives.
7. The method of claim 1 , further comprising:
providing a display of the automatically generated provisioning policies via a user interface of the computer system;
receiving a change to a provisioning policy of the displayed provisioning policies via the user interface; and
updating the provisioning policy based on the change.
8. A non-transitory computer-readable medium storing instructions, when executed by at least one processor, are configured to:
obtain performance data characterizing the computer system, the computer system implementing services with fluctuating demand over time;
generate a system resource usage profile based on the performance data, the performance data comprising central processing unit (CPU) utilization data and response time data, the response time data defined for one or more of transactions, workloads, jobs, tasks, applications, or threads comprising the services;
receive service level objectives for the services, the service level objectives characterizing a manner in which the services are provided to users over time;
automatically generate one or more provisioning policies based on the system resource usage profile and one or more of the service level objectives, including execute a series of workload scenarios, the workload scenarios including combinations of workload levels and service level objectives; and
provision the computer resources based on at least one of the provisioning policies, including:
allocate one or more additional servers for a first time slot of a plurality of time slots in response to the response time data being greater than a first threshold level; and
allocate one or more additional servers for a second time slot of the plurality of time slots in response to the CPU utilization data being greater than a second threshold level.
9. The non-transitory computer-readable medium of claim 8 , wherein the instructions to provision the computer resources include instructions to activate at least one server to process transactions.
10. The non-transitory computer-readable medium of claim 8 , wherein at least one of the service level objectives indicate an arrival value for transactions at a server of the computer system.
11. The non-transitory computer-readable medium of claim 8 , wherein the system resource usage profile characterizes resource usage of the computer resources of the computer system over time.
12. The non-transitory computer-readable medium of claim 8 , further comprising:
collect new performance data while the computer system is executing the services;
re-generate the system resource usage profile based on the new performance data; and
update at least one of the provisioning policies based on an analysis of the re-generated system resource usage profile in view of one or more of the service level objectives.
13. The non-transitory computer-readable medium of claim 8 , further comprising:
provide a display of the automatically generated provisioning policies via a user interface of the computer system;
receive a change to a provisioning policy of the displayed provisioning policies via the user interface; and
update the provisioning policy based on the change.
14. A system for automatically allocating computer resources in a computer system, the system comprising:
an assessment module configured to cause at least one processor to obtain performance data of a computer system that implements services with fluctuating demand, and to generate a system resource usage profile based on the performance data, the performance data comprising central processing unit (CPU) utilization data and response time data, the response time data defined for one or more of transactions, workloads, jobs, tasks, applications, or threads comprising the services;
a policy generating module configured to cause the at least one processor to receive service level objectives for the services, the service level objectives characterizing a manner in which the services are provided to users over time,
the policy generating module configured to cause the at least one processor to automatically generate one or more provisioning policies based on an analysis of the system resource usage profile and one or more of the service level objectives, the policy generating module configured to execute a series of workload scenarios, the workload scenarios including combinations of workload levels and service level objectives;
a load balancer configured to cause the at least one processor to provision the computer resources based on at least one of the provisioning policies, the load balancer configured to allocate one or more additional servers for a first time slot of a plurality of time slots in response to the response time data being greater than a first threshold level, the load balancer configured to allocate one or more additional servers for a second time slot of the plurality of time slots in response to the CPU utilization data being greater than a second threshold level.
15. The system of claim 14 , wherein the policy generating module includes a predictive module configured to cause the at least one processor to apply historical trending and predictive analysis to predict a number of servers required for one or more time slots.
16. The system of claim 14 , wherein at least one of the service level objectives indicate an arrival value for transactions at a server of the computer system.
17. The system of claim 14 , further comprising:
a migrating module configured to cause the at least one processor to generate a provisioning policy to consolidate available servers between virtual partitions of the computer system by estimating a number of homogeneous servers needed to support the services before migration.