Resource manager for managing the sharing of resources among multiple workloads in a distributed computing environment
A technique for managing pooled resources in a distributed computing environment includes a resource manager that receives resource allocation requests from workload managers for running one or more applications. The applications are initiated by a consumer through at least one of the workload managers where each workload manager is configured to translate demand requests from the applications into resource allocation requests. A determination is made whether there are available resources to satisfy the resource allocation requests. Responsive to determining that there is an unmet resource allocation request, a candidate resource meeting some but not all attributes needed to satisfy the unmet resource allocation request is identified and reconfigured to have the attributes needed to satisfy the unmet resource allocation request.
1. A system for managing pooled resources in a distributed computing environment, the system comprising:
a processor: and
a resource manager executable by the processor to:
receive resource allocation requests from a plurality of workload managers for running one or more applications, the one or more applications initiated by a consumer through at least one of the plurality of workload managers, and wherein each workload manager is configured to translate demand requests received from the one or more applications into the resource allocation requests;
determine whether there are available resources to satisfy the resource allocation requests;
responsive to determining that there is an unmet resource allocation request, identify a candidate resource meeting some but not all attributes needed to satisfy the unmet resource allocation request; and
reconfigure the candidate resource to have the attributes needed to satisfy the unmet resource allocation request.
2. The system of claim 1 wherein the resource manager is executable to allocate the modified candidate resource to one of the workload managers having the unmet resource allocation request.
3. The system of claim 1 wherein the resource manager is executable to release all assigned resources associated with an application when the application has run to completion.
4. The system of claim 1 wherein the resource manager is executable to:
determine the presence of idle resources among the pooled resources;
determine whether the idle resources should be removed from the pooled resources in accordance with a reprovisioning policy; and
dynamically shut down one or more of the idle resources so as to reduce power consumption.
5. The system of claim 1 wherein the resource requests are given different priorities and wherein a resource allocation policy takes into account the different priorities of each resource request when determining the availability of requested resources.
6. The system of claim 1 wherein the resource manager is executable to:
receive a resource modification request;
determine whether additional resources are available to satisfy the resource modification request;
assign the additional resources when additional resources are available;
flag the resource modification request when the additional resources are not available; and
wait until there are additional resources available to satisfy the resource modification request and then assign the additional resources.