Cross-cloud workflow management
A method of workflow management in a cloud computing system that includes generating a workflow graph from a workflow definition, the workflow graph including nodes representing work-elements; generating a stream matrix from the workflow graph, the stream matrix including pointers to lists of the work-elements, each of the lists representing a workstream; processing the stream matrix to place work-elements in a platform service pipeline for the cloud computing system based on resource availability of the platform service pipeline; and removing work-elements from the lists and the platform service pipeline upon completion.
1. A method of workflow management in a cloud computing system, comprising:
generating a workflow graph from a workflow definition, the workflow graph including nodes representing work-elements;
generating a stream matrix from the workflow graph, the stream matrix including pointers to lists of the work-elements, each of the lists representing a workstream;
processing the stream matrix to place work-elements in a platform service pipeline for the cloud computing system based on resource availability of the platform service pipeline; and
removing work-elements from the lists and the platform service pipeline upon completion.
2. The method of claim 1 , further comprising:
reading the workflow definition; and
verifying absence of cyclic workstreams in the workflow definition prior to generating the workflow graph.
3. The method of claim 2 , further comprising:
verifying validity of the work-elements prior to generating the workflow graph.
4. The method of claim 1 , further comprising:
generating stream weights for each of the lists referenced by the stream matrix.
5. The method of claim 4 , further comprising:
decreasing a stream weight of a list of the lists based on one or more work-elements removed from the list.
6. The method of claim 1 , further comprising:
checking a platform service list for the cloud system to verify resource availability prior to processing the stream matrix.
7. The method of claim 1 , wherein the workflow graph includes a workflow stream having a micro flow, the micro flow comprising a workflow having a plurality of workstreams, each workstream of the plurality of workstreams in the micro flow comprising a plurality of work-elements.
8. A non-transitory computer readable medium comprising instructions, which when executed in a computer system, causes the computer system to carry out a method of workflow management in a cloud computing system, comprising:
generating a workflow graph from a workflow definition, the workflow graph including nodes representing work-elements;
generating a stream matrix from the workflow graph, the stream matrix including pointers to lists of the work-elements, each of the lists representing a workstream;
processing the stream matrix to place work-elements in a platform service pipeline for the cloud computing system based on resource availability of the platform service pipeline; and
removing work-elements from the lists and the platform service pipeline upon completion.
9. The non-transitory computer readable medium of claim 8 , further comprising:
reading the workflow definition; and
verifying absence of cyclic workstreams in the workflow definition prior to generating the workflow graph.
10. The non-transitory computer readable medium of claim 9 , further comprising:
verifying validity of the work-elements prior to generating the workflow graph.
11. The non-transitory computer readable medium of claim 8 , further comprising:
generating stream weights for each of the lists referenced by the stream matrix.
12. The non-transitory computer readable medium of claim 11 , further comprising:
decreasing a stream weight of a list of the lists based on one or more work-elements removed from the list.
13. The non-transitory computer readable medium of claim 8 , further comprising:
checking a platform service list for the cloud system to verify resource availability prior to processing the stream matrix.
14. The non-transitory computer readable medium of claim 8 , wherein the workflow graph includes a workflow stream having a micro flow, the micro flow comprising a workflow having a plurality of workstreams, each workstream of the plurality of workstreams in the micro flow comprising a plurality of work-elements.
15. A computing system, comprising:
a plurality of cloud computing systems; and
a computer, coupled to the plurality of cloud computing systems, the computer executing a workflow manager configured to:
generate a workflow graph from a workflow definition, the workflow graph including nodes representing work-elements;
generate a stream matrix from the workflow graph, the stream matrix including pointers to lists of the work-elements, each of the lists representing a worktream;
process the stream matrix to place work-elements in a platform service pipeline for a cloud computing system based on resource availability of the platform service pipeline; and
remove work-elements from the lists and the platform service pipeline upon completion.
16. The computing system of claim 15 , wherein the workflow manager is configured to:
read the workflow definition; and
verify absence of cyclic workstreams in the workflow definition prior to generating the workflow graph.
17. The computing system of claim 16 , wherein the workflow manager is configured to:
verify validity of the work-elements prior to generating the workflow graph.
18. The computing system of claim 15 , wherein the workflow manager is configured to:
generate stream weights for each of the lists referenced by the stream matrix.
19. The computing system of claim 18 , wherein the workflow manager is configured to:
decrease a stream weight of a list of the lists based on one or more work-elements removed from the list.
20. The computing system of claim 15 , wherein the workflow manager is configured to:
check a platform service list for the cloud system to verify resource availability prior to processing the stream matrix.