Apparatus and method for computational workflow management

1. An apparatus configured to perform computational workflow management, the apparatus comprising processing circuitry and a cache, the processing circuitry configured to:

receive a computation resource reservation request for the cache from a client;

decompose the computation resource reservation request into a workflow of tasks, wherein each task has a task result and wherein at least some tasks are dependent upon the task results of other tasks;

generate a task label for each task result and its associated task, wherein each task label is a functional description of the associated task and tasks that are dependent upon the task result of the associated task;

compare a selected task label with previous task labels to determine if the selected task label matches one of the previous task labels, wherein the selected task label is one of the generated task labels, and wherein the previous task labels are associated with task results for previously executed tasks that are currently stored in the cache;

in response to determining that the selected task label matches one of the previous task labels, retrieve the task result associated with the matched one of the previous task labels from the cache; and

in response to determining that the selected task label does not match any of the previous task labels, evict portions of the cache associated with the previous task labels that do not match the selected task label and are not reserved by other workflows, perform the task associated with the selected task label, and store the task result of the performance to the evicted portions of the cache.

2. The apparatus of claim 1 , wherein the processing circuitry is further configured to:

release a portion of the cache reserved for a task that is dependent upon the selected task when the selected task is complete.

3. The apparatus of claim 1 , wherein the processing circuitry is further configured to:

receive a maximum memory size bound for each task in the workflow.

4. The apparatus of claim 3 , wherein the processing circuitry is further configured to:

calculate cache size requirements for the workflow based on the maximum memory size bound for each task in the workflow.

5. The apparatus of claim 1 , wherein the processing circuitry is further configured to:

receive a maximum memory size bound for each task in the workflow;

compare the generated task labels with the previous task labels to identify previous task labels that do not match the generated task labels and are not reserved by the other workflows;

evict portions of the cache associated with the previous task labels that do not match the generated task labels and are not reserved by the other workflows; and

calculate cache size requirements for the workflow based on the maximum memory size bound for each task in the workflow and the evicted portions of the cache.

6. The apparatus of claim 1 , wherein the generated labels have a fixed length.

7. The apparatus of claim 1 , wherein the processing circuitry is further configured to:

request and receive, from the cache, a listing of the previous task labels for the comparison.

8. An apparatus configured to perform computational workflow management, the apparatus comprising processing circuitry and a cache, the processing circuitry configured to:

receive a computation resource reservation request for the cache from a client;

decompose the computation resource reservation request into a workflow of tasks, wherein each task has a task result and wherein at least some tasks are dependent upon the task results of other tasks;

generate a task label for each task result and its associated task, wherein each task label is a functional description of the associated task and tasks that are dependent upon the task result of the associated task;

compare the generated task labels with previous task labels to identify previous task labels that do not match the generated task labels, wherein the previous task labels are associated with task results for previously executed tasks that are currently stored in a cache;

evict portions of the cache associated with the previous task labels that do not match the generated task labels and are not reserved by other workflows;

perform the tasks associated with the generated task labels that do not match the identified previous task labels; and

store the task results of the performance to the evicted portions of the cache.

9. The apparatus of claim 8 , wherein the processing circuitry is further configured to:

receive a maximum memory size bound for each task in the workflow.

10. The apparatus of claim 9 , wherein the processing circuitry is further configured to:

calculate cache size requirements for the workflow based on the maximum memory size bound for each task in the workflow.

11. The apparatus of claim 9 , wherein the processing circuitry is further configured to:

calculate cache size requirements for the workflow based on the maximum memory size bound for each task in the workflow and the evicted portions of the cache.

12. A method for performing computational workflow management, the method comprising:

receiving a computation resource reservation request for a cache from a client;

decomposing the computation resource reservation request into a workflow of tasks, wherein each task has a task result and wherein at least some tasks are dependent upon the task results of other tasks;

generating a task label for each task result and its associated task, wherein each task label is a functional description of the associated task and tasks that are dependent upon the task result of the associated task;

comparing a selected task label with previous task labels to determine if the selected task label matches one of the previous task labels, wherein the selected label is one of the generated labels, and wherein the previous task labels are associated with task results for previously executed tasks that are currently stored in the cache; and

in response to determining that the selected task label matches one of the previous task labels, retrieving the task result associated with the matched one of the previous task labels from the cache; and

in response to determining that the selected task label does not match any of the previous task labels, evicting portions of the cache associated with the previous task labels that do not match the selected task label and are not reserved by other workflows, performing the task associated with the selected task label, and storing the task result of the performance to the evicted portions of the cache.

13. The method of claim 12 , further comprising:

releasing a portion of the cache reserved for a task that is dependent upon the selected task when the selected task is complete.

14. The method of claim 12 , further comprising:

receiving a maximum memory size bound for each task in the workflow.

15. The method of claim 14 , further comprising:

calculating cache size requirements for the workflow based on the maximum memory size bound for each task in the workflow.

16. The method of claim 12 , further comprising:

receiving a maximum memory size bound for each task in the workflow;

comparing the generated task labels with the previous labels to identify previous task labels that do not match the generated task labels and are not reserved by the other workflows;

evicting portions of the cache associated with the previous task labels that do not match the generated task labels and are not reserved by the other workflows; and

calculating cache size requirements for the workflow based on the maximum memory size bound for each task in the workflow and the evicted portions of the cache.

17. The method of claim 12 , wherein the generated labels have a fixed length.

18. The method of claim 12 , further comprising:

requesting and receiving, from the cache, a listing of the previous task labels for the comparison.