Data center environment architecture including test case scoring for use when performing test automation orchestration
A system, method, and computer-readable medium for performing a data center management and monitoring operation. The data center management and monitoring operation includes: receiving a plurality of system under test (SUT) test plans, each SUT test plan comprising a plurality of SUT test cases; analyzing the plurality of SUT test cases, the analyzing comprising generating a test case intelligence score for each of the plurality of SUT test cases; generating a continuous schedule for the SUT test plan, the generating the continuous schedule taking into account the test case intelligence score for each of the plurality of SUT test cases; and, continuously orchestrating the SUT test plan based upon the continuous schedule for the SUT test plan.
1 . A computer-implementable method for performing a data center management and monitoring operation, comprising:
receiving a plurality of system under test (SUT) test plans, each SUT test plan comprising a plurality of SUT test cases, each of the plurality of SUT test cases being associated with a component of a data center asset contained within a data center;
analyzing the plurality of SUT test cases, the analyzing comprising generating a test case intelligence score for each of the plurality of SUT test cases;
generating a continuous schedule for each SUT test plan, the generating the continuous schedule taking into account the test case intelligence score for each of the plurality of SUT test cases, the continuous schedule for each SUT test plan being regularly updated based upon a plurality of program constraints, the continuous schedule for each SUT test plan regularly updating a schedule for executing each SUT test plan, the schedule for executing each SUT test plan using the plurality of program constraints to calculate relative priorities of each SUT test case when updating the schedule for executing each SUT test plan; and,
continuously orchestrating the SUT test plan based upon the continuous schedule for the SUT test plan, the continuously orchestrating using the continuous schedule to apply each of the plurality of SUT test cases to the associated component of the data center asset contained within the data center based upon each SUT test plan.
2 . The method of claim 1 , wherein:
the analyzing ranks the plurality of SUT test cases using the test case intelligence scores for each of the plurality of SUT test cases.
3 . The method of claim 1 , wherein:
the test case intelligence score for each of the plurality of SUT test cases is based upon one or more test case analysis scores associated with each of the plurality of SUT test cases.
4 . The method of claim 3 , wherein:
the one or more test case analysis scores associated with each of the plurality of SUT test cases include a recency score, a disposition score, a fail score, a phase score and a severity score.
5 . The method of claim 3 , wherein:
the test case intelligence score is based on weighted values of the one or more test case analysis scores associated with each of the plurality of SUT test cases.
6 . The method of claim 1 , further comprising:
presenting a test case intelligence visual representation for a test case intelligence score for a SUT test case, the visual representation providing a visual indication of the test case intelligence score.
7 . A system comprising:
a processor;
a data bus coupled to the processor;
a data center asset client module; and, a non-transitory, computer-readable storage medium embodying computer program code, the non-transitory, computer-readable storage medium being coupled to the data bus, the computer program code interacting with a plurality of computer operations and comprising instructions executable by the processor and configured for:
receiving a plurality of system under test (SUT) test plans, each SUT test plan comprising a plurality of SUT test cases, each of the plurality of SUT test cases being associated with a component of a data center asset contained within a data center;
analyzing the plurality of SUT test cases, the analyzing comprising generating a test case intelligence score for each of the plurality of SUT test cases;
generating a continuous schedule for each SUT test plan, the generating the continuous schedule taking into account the test case intelligence score for each of the plurality of SUT test cases, the continuous schedule for each SUT test plan being regularly updated based upon a plurality of program constraints, the continuous schedule for each SUT test plan regularly updating a schedule for executing each SUT test plan, the schedule for executing each SUT test plan using the plurality of program constraints to calculate relative priorities of each SUT test case when updating the schedule for executing each SUT test plan; and,
continuously orchestrating the SUT test plan based upon the continuous schedule for the SUT test plan, the continuously orchestrating using the continuous schedule to apply each of the plurality of SUT test cases to the associated component of the data center asset contained within the data center based upon each SUT test plan.
8 . The system of claim 7 , wherein:
the analyzing ranks the plurality of SUT test cases using the test case intelligence scores for each of the plurality of SUT test cases.
9 . The system of claim 7 , wherein:
the test case intelligence score for each of the plurality of SUT test cases is based upon one or more test case analysis scores associated with each of the plurality of SUT test cases.
10 . The system of claim 9 , wherein:
the one or more test case analysis scores associated with each of the plurality of SUT test cases include a recency score, a disposition score, a fail score, a phase score and a severity score.
11 . The system of claim 7 , wherein:
the test case intelligence score is based on weighted values of the one or more test case analysis scores associated with each of the plurality of SUT test cases.
12 . The system of claim 7 , wherein the instructions executable by the processor are further configured for:
presenting a test case intelligence visual representation for a test case intelligence score for a SUT test case, the visual representation providing a visual indication of the test case intelligence score.
13 . A non-transitory, computer-readable storage medium embodying computer program code, the computer program code comprising computer executable instructions configured for:
receiving a plurality of system under test (SUT) test plans, each SUT test plan comprising a plurality of SUT test cases, each of the plurality of SUT test cases being associated with a component of a data center asset contained within a data center;
analyzing the plurality of SUT test cases, the analyzing comprising generating a test case intelligence score for each of the plurality of SUT test cases;
generating a continuous schedule for each SUT test plan, the generating the continuous schedule taking into account the test case intelligence score for each of the plurality of SUT test cases, the continuous schedule for each SUT test plan being regularly updated based upon a plurality of program constraints, the continuous schedule for each SUT test plan regularly updating a schedule for executing each SUT test plan, the schedule for executing each SUT test plan using the plurality of program constraints to calculate relative priorities of each SUT test case when updating the schedule for executing each SUT test plan; and,
continuously orchestrating the SUT test plan based upon the continuous schedule for the SUT test plan, the continuously orchestrating using the continuous schedule to apply each of the plurality of SUT test cases to the associated component of the data center asset contained within the data center based upon each SUT test plan.
14 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the analyzing ranks the plurality of SUT test cases using the test case intelligence scores for each of the plurality of SUT test cases.
15 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the test case intelligence score for each of the plurality of SUT test cases is based upon one or more test case analysis scores associated with each of the plurality of SUT test cases.
16 . The non-transitory, computer-readable storage medium of claim 15 , wherein:
the one or more test case analysis scores associated with each of the plurality of SUT test cases include a recency score, a disposition score, a fail score, a phase score and a severity score.
17 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the test case intelligence score is based on weighted values of the one or more test case analysis scores associated with each of the plurality of SUT test cases.
18 . The non-transitory, computer-readable storage medium of claim 15 , wherein the computer executable instructions are further configured for:
presenting a test case intelligence visual representation for a test case intelligence score for a SUT test case, the visual representation providing a visual indication of the test case intelligence score.
19 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the computer executable instructions are deployable to a client system from a server system at a remote location.
20 . The non-transitory, computer-readable storage medium of claim 13 , wherein:
the computer executable instructions are provided by a service provider to a user on an on-demand basis.