Adaptive resource management using survival minimum resources for low priority consumers
View Patent ↗Allocation of resources across multiple consumers allows efficient utilization of shared resources. Observed usages of resources by consumers over time intervals are used to determine a total throughput of resources by the consumers. The total throughput of resources is used to determine allocation of resources for a subsequent time interval. The consumers are associated with priorities used to determine their allocations. Minimum and maximum resource guarantees may be associated with consumers. The resource allocation aims to allocate resources based on the priorities of the consumers while aiming to avoid starvation by any consumer. The resource allocation allows efficient usage of network resources in a database storage system storing multiple virtual databases.
1. A method for allocating a network resource to a plurality of consumers, the method comprising:
determining a metric representing aggregate needs of a low priority set of consumers of a network resource based on measures of needs of each of the low priority set of consumers, the measure of needs of a consumer determined based on an observed usage of the network resource by the consumer;
determining a measure of survival minimum resources for the low priority consumers, the survival minimum resources for a consumer determined based on a minimum amount of resources needed to operate a mode of processing of a task for the consumer;
responsive to the aggregate needs of the low priority set of consumers being below the measure of survival minimum resources, determining allocations of the network resource for the low priority set of consumers before determining allocations for a high priority set of consumers, the allocation for each consumer from the low priority set determined based on the measure of needs of the consumer;
determining allocations of the network resource for the high priority set of consumers based on the resources remaining after allocating resources to the low priority set of consumers; and
allocating resources to the high priority set of consumers based on the determined allocations for the high priority set of consumers.
2. The method of claim 1 , wherein determining allocations of the network resource for the high priority set of consumers comprises allocating an amount of resources based on an estimate of the requirement of each consumer from the high priority set of consumers.
3. The method of claim 1 , further comprising:
responsive to determining allocations of the network resource for the high priority set of consumers, determining a left over network resource not allocated to the high priority set of consumers; and
allocating the left over network resource to the low priority set of consumers.
4. The method of claim 3 , wherein allocating the left over network resource to the low priority set of consumers further comprises:
responsive to determining that the left over network resource is less than the needs of the low priority set of consumers, dividing the left over network resource between the low priority set of consumers, wherein the network resource allocated to each consumer from the low priority set of consumers is based on a priority of the consumer.
5. The method of claim 3 , further comprising:
determining whether a network resource is lightly loaded based on the observed usage of the network resource by consumers; and
dividing the left over network resource equally among all consumers of the low priority set if the network resource is determined to be lightly loaded.
6. The method of claim 5 , further comprising:
determining whether a network resource is lightly loaded based on the observed usage of the network resource by consumers; and
dividing the left over network resource among consumers of the low priority set based on priority of each consumer if the network resource is determined to be not lightly loaded.
7. The method of claim 6 , wherein the left over network resource is divided among consumers of the low priority set based on the usage of each consumer.
8. The method of claim 1 , further comprising:
responsive to determining that the left over network resource for the low priority set of consumers are below the survival minimum resources for the low priority consumer, stopping execution of one or more consumers from the low priority set of consumers.
9. The method of claim 1 , further comprising:
determining the measure of survival minimum resources for the low priority consumers as a percentage of historically observed usage of the low priority consumers.
10. The method of claim 1 , wherein an aggregate of survival minimum resources for a set of consumers for a network resource is determined as a value proportionate to a throughput of the network resource.
11. The method of claim 1 , wherein the measure of needs of a consumer is determined based on observed usage of a consumer increased by a margin associated with the consumer, wherein the margin is determined based on the priority of the consumer.
12. The method of claim 1 , further comprising:
determining a measure of potential starvation of a consumer based on a fraction of time interval during which the usage of the consumer exceeds a predetermined percentage of allocation.
13. The method of claim 12 , further comprising:
modifying the priority of the consumer based the measure of potential starvation of the consumer.
14. The method of claim 12 , further comprising:
promoting the consumer to a higher priority responsive to the measure of potential starvation of the consumer exceeding a threshold.
15. A non-transitory computer-readable storage medium storing computer-executable code allocating a network resource to a plurality of consumers, the code comprising:
a metrics manager configured to:
determine a metric representing aggregate needs of a low priority set of consumers of a network resource based on measures of needs of each of the low priority set of consumers, the measure of needs of a consumer determined based on an observed usage of the network resource by consumer;
an allocations manager configured to:
determine a measure of survival minimum resources for the low priority consumers, the survival minimum resources for a consumer determined based on a minimum amount of resources needed to operate a mode of processing of a task for the consumer;
responsive to the aggregate needs of the low priority set of consumers being below the measure of survival minimum resources, determine allocations of the network resource for the low priority set of consumers before determining allocations for a high priority set of consumers, the allocation for each consumer from the low priority set determined based on the measure of needs of the consumer;
determine allocations of the network resource for the high priority set of consumers based on the resources remaining after allocating resources to the low priority set of consumers; and
allocating resources to the high priority set of consumers based on the determined allocations for the high priority set of consumers.
16. The non-transitory computer-readable storage medium of claim 15 , wherein the allocations manager is further configured to determine allocations of the network resource for the high priority set of consumers and allocate an amount of network resource based on an estimate of the requirement of each consumer from the high priority set of consumers.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the allocations manager is further configured to:
responsive to determining allocations of the network resource for the high priority set of consumers, determine a left over network resource not allocated to the high priority set of consumers; and
allocate the left over network resource to the low priority set of consumers.
18. The non-transitory computer-readable storage medium of claim 17 , wherein allocating the left over network resource to the low priority set of consumers further comprises:
responsive to determining that the left over network resource is less than the needs of the low priority set of consumers, dividing the left over network resource between the low priority set of consumers, wherein the network resource allocated to each consumer from the low priority set of consumers is based on a priority of the consumer.
19. A computer system comprising:
a computer processor:
a non-transitory computer-readable storage medium storing computer-executable code for execution by the computer processor, the code comprising:
a metrics manager configured to:
determine a metric representing aggregate needs of a low priority set of consumers of a network resource based on measures of needs of each of the low priority set of consumers, the measure of needs of a consumer determined based on an observed usage of the network resource by consumer;
an allocations manager configured to:
determine a measure of survival minimum resources for the low priority consumers, the survival minimum resources for a consumer determined based on a minimum amount of resources needed to operate a mode of processing of a task for the consumer;
responsive to the aggregate needs of the low priority set of consumers being below the measure of survival minimum resources, determine allocations of the network resource for the low priority set of consumers before determining allocations for a high priority set of consumers, the allocation for each consumer from the low priority set determined based on the measure of needs of the consumer;
determine allocations of the network resource for the high priority set of consumers based on the resources remaining after allocating resources to the low priority set of consumers; and
allocating resources to the high priority set of consumers based on the determined allocations for the high priority set of consumers.
20. The computer system of claim 19 , wherein the allocations manager is further configured to determine allocations of the network resource for the high priority set of consumers and allocate an amount of network resource based on an estimate of the requirement of each consumer from the high priority set of consumers.
21. The computer system of claim 19 , wherein the allocations manager is further configured to:
responsive to determining allocations of the network resource for the high priority set of consumers, determine a left over network resource not allocated to the high priority set of consumers; and
allocate the left over network resource to the low priority set of consumers.
22. The computer system of claim 21 , wherein allocating the left over network resource to the low priority set of consumers further comprises:
responsive to determining that the left over network resource is less than the needs of the low priority set of consumers, dividing the left over network resource between the low priority set of consumers, wherein the network resource allocated to each consumer from the low priority set of consumers is based on a priority of the consumer.