Resource availability-based workflow execution timing determination
View Patent ↗According to a computer-implemented method, an available amount of each of multiple computing resources is determined by machine logic over a period of time at a computing device. The machine logic also determines an expected usage of each computing resource to execute each workflow in a queue. The machine logic also determines a time of execution of each workflow in the queue based on the available amount of each of the multiple computing resources over time and the expected usage of each computing resource to execute each workflow in the queue.
1. A computer-implemented method, comprising:
scheduling, by machine logic, multiple workflows in a queue for execution over a period of time by a data processing system;
determining, by the machine logic, an available amount of multiple computing resources of the data processing system to execute the multiple workflows over the period of time;
determining, by the machine logic, an expected usage of each computing resource to execute the multiple workflows in the queue by creating a superimposed time-based graph of resource usage of a first combination of the multiple workflows superimposed over resource usage of a second combination of the multiple workflows, wherein the superimposed time-based graph is mapped using previous workflows that have been performed by similar computing resources having characteristics of the multiple workflows; and
rescheduling, by the machine logic, an order of the multiple workflows in the queue based on an execution order that maximizes usage of the multiple computing resources without overcommitment, by comparing the expected usage with the available amount of the multiple computing resources.
2. The computer-implemented method of claim 1 , wherein scheduling the multiple workflows in the queue comprises sequentially placing the multiple workflows in the queue in an order that the multiple workflows are received.
3. The computer-implemented method of claim 1 , wherein scheduling the multiple workflows in the queue comprises placing the multiple workflows in the queue based on a priority of the multiple workflows.
4. The computer-implemented method of claim 1 , further comprising storing historical information of an amount of computing resources used over time for the previous workflows.
5. The computer-implemented method of claim 1 , wherein rescheduling the multiple workflows comprises ordering the multiple workflows in the queue based on an expected average computing resource usage of the multiple workflows in the queue.
6. The computer-implemented method of claim 5 , wherein the multiple workflows are ordered in the queue in descending order of expected average computing resource usage, wherein a workflow with a highest expected average computing resource usage is executed first.
7. A system, comprising:
a scheduler to schedule multiple workflows in a queue for execution over a period of time by a data processing system;
a resource analyzer to determine an available amount of multiple computing resources of the data processing system to execute the multiple workflows over the period of time; and
a workflow analyzer to determine an expected usage of each computing resource to execute the multiple workflows in the queue by creating a superimposed time-based graph of resource usage of a first combination of the multiple workflows superimposed over resource usage of a second combination of the multiple workflows, wherein the superimposed time-based graph is mapped using previous workflows that have been performed by similar computing resources having characteristics of the multiple workflows;
a scheduler to reschedule an order of the multiple workflows in the queue based on an execution order that maximizes usage of the multiple computing resources without overcommitment, by comparing the expected usage with the available amount of the multiple computing resources.
8. The system of claim 7 , wherein the scheduler is to:
sequentially analyze each of the multiple workflows in the queue to determine whether a given workflow would overcommit any of the multiple computing resources at a scheduled time of execution; and
move the given workflow that would overcommit any of the multiple computing resources down in the queue.
9. The system of claim 7 , wherein the scheduler is to:
determine which of the multiple workflows can be executed at a particular point in time without overcommitting the multiple computing resources; and
determine, for workflows that would overcommit the multiple computing resources if executed at the particular point in time, when each of the workflows can be executed without overcommitting the multiple computing resources.
10. The system of claim 7 , wherein the scheduler is to:
determine that expected computing resource usage for a given workflow is above a threshold level; and
reschedule the given workflow in the queue in response to determining that the expected computing resource usage for the given workflow would not overcommit the multiple computing resources over the time period.
11. The system of claim 10 , wherein determining that the expected computing resource usage for the given workflow would not overcommit the multiple computing resources over the time period comprises determining that the expected computing resource usage over the time period is less than a maximum resource utilization limit.
12. The system of claim 10 , wherein the threshold level is a user-specified parameter.