Computer implemented system and method and computer program product for a test framework for orchestration workflows
View Patent ↗A system, method and computer program product for a test framework for orchestration workflows. For example, a method in accordance with some embodiments includes accessing a workflow test function library comprised of a plurality of workflow test functions. A workflow test function is a function that tests an orchestration workflow component. A plurality of workflow test suites may be accessed, each of which is comprised of one or more workflow tests. A workflow test hook is inserted into a target orchestration workflow component. The inserted workflow test hook is associated with at least one of the plurality of workflow test suites. The inserted workflow test hook is invoked thereby causing each of workflow tests to be performed on the target workflow test component. Target orchestration workflow component test result information is received from the target orchestration workflow component and the target workflow component test result information is outputted.
1. A computer implemented method for providing a framework for testing an orchestration workflow component, the method comprising:
accessing a workflow test function library, the workflow test function library is comprised of a plurality of workflow test functions, wherein a workflow test function is a function that tests an orchestration workflow component;
accessing a plurality of workflow test suites, wherein each of the plurality of workflow test suites is comprised of one or more workflow tests selected from the group consisting of valid output, null output and invalid output;
inserting a workflow test hook into a target orchestration workflow component, wherein the target orchestration workflow component is an orchestration workflow component to be tested;
associating the inserted workflow test hook with at least one of the plurality of workflow test suites;
invoking the inserted workflow test hook thereby causing each of the one or more workflow tests comprising the workflow test suite associated with the invoked workflow test hook to be performed on the target workflow test component;
receiving target orchestration workflow component test result information from the target orchestration workflow component, wherein the target orchestration workflow component test result information is comprised of information indicating results of performing each of the one or more workflow tests on the target workflow component;
restoring a workflow deployment environment to a pre-workflow test state, wherein the pre-workflow test state is a state of the workflow test environment prior to invoking the inserted workflow test hook; and
outputting target workflow component test result information.
2. The method of claim 1 , further comprising:
verifying output received from the target orchestration workflow component by comparing the received output with a known result.
3. The method of claim 1 , wherein the target workflow component is comprised of one or more target workflow source code blocks.
4. The method of claim 3 , further comprising:
identifying at least one of the one or more target workflow source code blocks by identifying a start point of the at least one of the one or more target workflow source code block to be tested and an end point of the at least one of the one or more target workflow source code block to be tested.
5. A computer implemented system for providing a testing framework for testing an orchestration workflow component, the system comprising:
at least one processor; and
at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the system to at least:
access a workflow test function library, the workflow test function library is comprised of a plurality of workflow test functions, wherein a workflow test function is a is a function that tests an orchestration workflow component;
access a plurality of workflow test suites, wherein each of the plurality of workflow test suites is comprised of one or more workflow tests selected from the group consisting of valid output, null output and invalid output;
insert a workflow test hook into a target orchestration workflow component, wherein the target orchestration workflow component is an orchestration workflow component to be tested;
associate the inserted workflow test hook with at least one of the plurality of workflow test suites;
invoke the inserted workflow test hook thereby causing each of the one or more workflow tests comprising the workflow test suite associated with the invoked workflow test hook to be performed on the target workflow test component;
receive target orchestration workflow component test result information from the target orchestration workflow component, wherein the target orchestration workflow component test result information is comprised of information indicating results of performing each of the one or more workflow tests on the target workflow component;
restore a workflow deployment environment to a pre-workflow test state, wherein the pre-workflow test state is a state of the workflow test environment prior to invoking the inserted workflow test hook; and
output target workflow component test result information.
6. The system of claim 5 , wherein the at least one memory and stored computer program code are configured, with the at least one processor, to further cause the system to:
verify output received from the target orchestration workflow component by comparing the received output with a known result.
7. The system of claim 5 , wherein the target workflow component is comprised of one or more target workflow source code blocks.
8. The system of claim 7 , wherein the at least one memory and stored computer program code are configured, with the at least one processor, to further cause the system to:
identify at least one of the one or more target workflow source code blocks by identifying a start point of the at least one of the one or more target workflow source code block to be tested and an end point of the at least one of the one or more target workflow source code block to be tested.
9. A computer program product for providing a testing framework for testing an orchestration workflow component, the computer program product comprising at least one non-transitory computer-readable storage medium having program instructions stored thereon, which when executed by at least one processor, cause the at least one processor to perform a method comprising:
accessing a workflow test function library, the workflow test function library is comprised of a plurality of workflow test functions, wherein a workflow test function is a is a function that tests an orchestration workflow component;
accessing a plurality of workflow test suites, wherein each of the plurality of workflow test suites is comprised of one or more workflow tests selected from the group consisting of valid output, null output and invalid output;
inserting a workflow test hook into a target orchestration workflow component, wherein the target orchestration workflow component is an orchestration workflow component to be tested;
associating the inserted workflow test hook with at least one of the plurality of workflow test suites;
invoking the inserted workflow test hook thereby causing each of the one or more workflow tests comprising the workflow test suite associated with the invoked workflow test hook to be performed on the target workflow test component;
receiving target orchestration workflow component test result information from the target orchestration workflow component, wherein the target orchestration workflow component test result information is comprised of information indicating results of performing each of the one or more workflow tests on the target workflow component;
restoring a workflow deployment environment to a pre-workflow test state, wherein the pre-workflow test state is a state of the workflow test environment prior to invoking the inserted workflow test hook; and
outputting target workflow component test result information.
10. The computer program product of claim 9 , wherein the least one non-transitory computer-readable storage medium having program instructions stored thereon, which when executed by the at least one processor, cause the at least one processor to perform a method further comprising:
verifying output received from the target orchestration workflow component by comparing the received output with a known result.
11. The computer program product of claim 9 , wherein the target workflow component is comprised of one or more target workflow source code blocks.
12. The computer program product of claim 11 , wherein the least one non-transitory computer-readable storage medium having program instructions stored thereon, which when executed by the at least one processor, cause the at least one processor to perform a method further comprising:
identifying at least one of the one or more target workflow source code blocks by identifying a start point of the at least one of the one or more target workflow source code block to be tested and an end point of the at least one of the one or more target workflow source code block to be tested.