Dynamic renewable runtime resource management
A system and method is provided for dynamic renewable runtime resource management in response to flexible resource allocations by a processor. In embodiments, a method includes: calculating, by a processor of a system, a resource consumption value of a first workload by aggregating allocation values of persistent resources currently allocated to the first workload by the processor; determining, by the processor, that the resource consumption value of the first workload is greater than a predefined resource allocation target for the first workload; and temporarily adjusting, by the processor, a renewable runtime resource target of the first workload from an initial target value to a temporary target value based on the resource consumption value.
1. A method, comprising:
calculating, by a processor, a resource consumption value of a first workload having at least one first service class by weighted aggregation of allocation values of persistent resources currently allocated to the at least one first service class of the first workload by the processor using predetermined resource weighting values, a service class being a recognizable logical grouping of active jobs identifiable by a respective session attribute within a workload;
determining, by the processor, that the resource consumption value of the first workload is greater than a predefined resource allocation target for the first workload;
scheduling, by the processor, execution of incoming jobs from the first workload and incoming jobs from a second workload having at least one second service class, wherein the scheduling is based on capacity limits of a system, the capacity limits of the system comprising a total amount of memory available; and
temporarily and automatically adjusting, by the processor, a first renewable runtime resource target of the first workload from an initial target value to a first temporary target value proportional to the calculated resource consumption value by adjusting a second renewable runtime resource target of the second workload proportional to the adjustment of the first renewable runtime resource target of the first workload and temporarily sharing resources of the second workload and the first workload based on the adjustment of the first renewable runtime resource target of the first workload.
2. The method of claim 1 , wherein the persistent resources comprises one or more memory units and worker threads, a renewable runtime resource associated with the renewable runtime resource target comprises a central processing unit (CPU), and the weighting values comprise neutral weightings, the neutral weightings representing a relative share value applicable across both persistent resources and renewable runtime resources; and
wherein the memory units have a different weighting than the worker threads.
3. The method of claim 1 , wherein the calculating the resource consumption value is initiated by the processor based on a determination that a new job of the first workload or another workload has been admitted to the system.
4. The method of claim 1 , wherein the temporarily adjusting the first renewable runtime resource target of the first workload comprises increasing the first initial target value an amount in proportion to the resource consumption value.
5. The method of claim 1 , wherein scheduling the execution of incoming jobs from the first workload and incoming jobs from the second workload is further based on: the predefined resource allocation target for the first workload; and a second predefined resource allocation target for the second workload; and
wherein the capacity limits of the system further comprises a total number of worker threads available for a duration of time.
6. The method of claim 1 , further comprising:
determining, by the processor, that one or more jobs of the first workload have completed;
reverting, by the processor, the renewable runtime resource target of the first workload back to the initial target value; and
reverting, by the processor, the second renewable runtime resource target of the second workload back to the second initial target value.
7. The method of claim 1 , wherein the processor includes software provided as a service in a cloud environment.
8. A computer program product comprising one or more computer readable storage media having program instructions collectively stored on the one or more computer readable storage media, the program instructions executable by a processor managing execution of jobs in a system to:
calculate a resource consumption value of a first workload having at least one first service class by weighted aggregation of allocation values of persistent resources currently allocated to the at least one first service class of the first workload by a job scheduling module using predetermined resource weighting values, a service class being a recognizable logical grouping of active jobs identifiable by a respective session attribute within a workload;
determine whether the resource consumption value of the first workload is greater than a predefined resource allocation target for the first workload in response to a job being admitted into the system;
schedule execution of incoming jobs from the first workload and incoming jobs from a second workload having at least one second service class, wherein the scheduling is based on capacity limits of the system, the capacity limits of the system comprising a total amount of memory available; and
temporarily and automatically increase a first renewable runtime resource target of the first workload from an initial target value of the first workload to a first temporary target value of the first workload proportional to the calculated resource consumption value, by decreasing a second renewable runtime resource target of the second workload proportional to the increase of the first renewable runtime resource target of the first workload and temporarily applying resources of the second workload to the first workload, in response to determining that the resource consumption value of the first workload is greater than the predefined resource allocation target for the first workload.
9. The computer program product of claim 8 , wherein the predefined resource allocation target for the first workload is a soft target enabling the processor to exceed the predefined resource allocation target for the first workload in response to determining that a portion of the persistent resources are not otherwise allocated in the system.
10. The computer program product of claim 9 , wherein the program instructions are further executable by the processor to:
determine that one or more jobs of the first workload have completed such that the resource consumption value of the first workload is less than the predefined resource allocation target for the first workload; and
in response to determining that the renewable runtime resource target of the first workload is the temporary target value, revert the renewable runtime resource target from the temporary target value back to the initial target value of the first workload.
11. The computer program product of claim 9 , wherein the program instructions are further executable by the processor to decrease the second renewable runtime resource target of a second workload from an initial target value of the second workload to a second temporary target value in response to increasing the initial target value of the first workload.
12. The computer program product of claim 8 , wherein the program instructions are further executable by the processor to maintain the initial target value of the first workload in response to determining the resource consumption value of the first workload is less than or equal to the predefined resource allocation target for the first workload.
13. The computer program product of claim 8 , wherein scheduling the execution of incoming jobs from the first workload and the second workload is further based on: the predefined resource allocation target for the first workload; and a second predefined resource allocation target for the second workload; and
wherein the capacity limits of the system further comprises a total number of threads available for a duration of time, and wherein a predetermined resource weighting value for the total amount of memory is higher than a predetermined resource weighting value for the number of worker threads available.
14. A system comprising:
a processor, a computer readable memory, one or more computer readable storage media, and program instructions collectively stored on the one or more computer readable storage media, the program instructions executable to:
calculate a resource consumption value of a first workload having at least one first service class by weighted aggregation of allocation values of persistent resources currently allocated to the at least one first service class of the first workload by a job scheduling module using predetermined resource weighting values, a service class being a recognizable logical grouping of active jobs identifiable by a respective session attribute within a workload;
determine whether the resource consumption value of the first workload is greater than a user-defined resource allocation target for the first workload in response to a job of the first workload or another workload being admitted into the system;
schedule execution of incoming jobs from the first workload and incoming jobs from a second workload having at least one second service class, wherein the scheduling is based on capacity limits of the system, the capacity limits of the system comprising a total amount of memory available;
temporarily and automatically increase a first renewable runtime resource target of the first workload from an initial target value of the first workload to a temporary target value of the first workload proportional to the calculated resource consumption value, by decreasing a second renewable runtime resource target of the second workload proportional to the increase of the first renewable runtime resource target of the first workload and temporarily applying resources of the second workload to the first workload, in response to determining that the resource consumption value of the first workload is greater than the user-defined resource allocation target for the first workload; and
determine whether to revert the renewable runtime resource target from the temporary target value of the first workload to the initial target value of the first workload in response to a job of the first workload completing.
15. The system of claim 14 wherein the program instructions are further executable to maintain the initial target value of the first workload in response determining the resource consumption value of the first workload is less than or equal to the user-defined resource allocation target for the first workload.
16. The system of claim 14 , wherein the program instructions are further executable to temporarily decrease a renewable runtime resource target of the second workload from an initial target value of the second workload to a second temporary target value in response to the increase to the initial target value of the first workload.
17. The system of claim 14 , wherein: the program instructions are further executable to schedule execution of incoming jobs from the first workload and the second workload the scheduling based on: the user-defined resource allocation target for the first workload; a second user-defined resource allocation target for the second workload; and capacity limits of the system; and
the incoming jobs are based on structured query language (SQL) requests.
18. The system of claim 14 , wherein the program instructions are further executable to:
calculate a resource consumption value of the second workload by aggregating allocation values of persistent resources currently allocated to the second workload;
determine whether the resource consumption value of the second workload is greater than a user-defined resource allocation target for the second workload when the job of the first workload or the another workload is admitted into the system; and
temporarily increase a renewable runtime resource target of the second workload from an initial target value of the second workload to a temporary target value of the second workload in response to determining that the resource consumption value of the second workload is greater than the user-defined resource allocation target for the second workload.
19. The system of claim 14 , wherein the user-defined resource allocation target for the first workload is a soft target enabling the system to exceed the user-defined resource allocation target for the first workload when a portion of the persistent resources are not otherwise allocated in the system.
20. The system of claim 14 , wherein the processor includes software provided as a service in a cloud environment.