Accelerated event generation for supervised learning
A method for generating testing information for prediction model training includes: identifying, by an automated event generation and data labeling (AEGDL) manager, a test case initiation event; in response to the identification: selecting a first test case of a plurality of test cases; identifying a first test configuration cluster (TCC) of a plurality of TCCs based on the test case; performing the first test case in the TCC; generating testing information based on the performing of the first test case in the TCC; and providing the testing information to prediction models for model training.
1 . A method for generating testing information, comprising:
identifying, by an automated event generation and data labeling (AEGDL) manager, a test case initiation event;
in response to the identification:
selecting a first test case of a plurality of test cases;
identifying a first test configuration cluster (TCC) of a plurality of TCCs based on the test case;
performing the first test case in the TCC;
generating testing information based on the performing of the first test case in the TCC; and
providing the testing information to prediction models for model training; and
initiating telemetry collection associated with the first test case to generate telemetry information;
confirming test configuration cluster configuration is in a required state based on the test case;
performing a first iteration of iterations of the first test case; and
resetting the first test configuration cluster.
2 . The method of claim 1 , wherein:
the first TCC comprises a first configuration of compute devices, network devices, and storage devices; and
a second TCC of the plurality of TCCs comprises a second configuration of compute devices, network devices, and storage devices.
3 . The method of claim 2 , wherein the first TCC further comprises at least one testing device that performs at least a portion of the first test case.
4 . The method of claim 1 , wherein:
the first test case comprises a first error scenario associated with the first TCC; and
a second test case of the plurality of test cases comprises a second error scenario associated with the first TCC.
5 . The method of claim 4 , wherein the testing information comprises:
telemetry information associated with the first TCC generated during the performance of the first test case; and
a label specifying the first error scenario.
6 . The method of claim 5 , wherein generating the testing information based on the performing of the first test case in the TCC comprises labeling the telemetry information with the label to enable prediction model training.
7 . The method of claim 1 , wherein performing the first test case in the TCC comprises: making a first determination that additional test iterations are required; and in response to the first determination:
performing a second iteration of iterations of the first test case.
8 . The method of claim 1 , wherein identifying the first TCC comprises comparing TCC configuration information associated with the first TCC with test case parameters associated with the first test case.
9 . The method of claim 8 , wherein the test case parameters further specify:
the iterations;
the configuration information; and
the required state.
10 . The method of claim 1 , wherein the AEGDL manager executes in an on-premises environment comprising the plurality of TCCs.
11 . The method of claim 1 , wherein the AEGDL manager executes in a cloud environment operatively connected to the plurality of TCCs.
12 . A system for generating testing information, comprising:
a processor;
memory storing computer executable instructions when executed by the processor to:
identifying, by an automated event generation and data labeling (AEGDL) manager, a test case initiation event;
in response to the identification:
selecting a first test case of a plurality of test cases;
identifying a first test configuration cluster (TCC) of a plurality of TCCs based on the test case;
performing the first test case in the TCC, wherein performing the first test case in the TCC comprises:
initiating telemetry collection associated with the first test case to generate telemetry information;
confirming test configuration cluster configuration is in a required state based on the test case;
performing a first iteration of iterations of the first test case; and resetting the first test configuration cluster; generating testing information based on the performing of the first test case in the TCC; and
providing the testing information to prediction models for model training.
13 . The system of claim 12 , wherein: the first TCC comprises a first configuration of devices; and a second TCC of the plurality of TCCs comprises a second configuration of devices.
14 . The system of claim 13 , wherein the first configuration of devices comprises compute devices, network devices, and storage devices.
15 . The system of claim 13 , wherein the first TCC further comprises at least one testing device that performs at least a portion of the first test case.
16 . The system of claim 12 , wherein: the first test case comprises a first error scenario associated with the first TCC; and a second test case of the plurality of test cases comprises a second error scenario associated with the first TCC.
17 . The system of claim 16 , wherein the testing information comprises:
telemetry information associated with the first TCC generated during the performance of the first test case; and
a label specifying the first error scenario.
18 . The system of claim 17 , wherein generating the testing information based on the performing of the first test case in the TCC comprises labeling the telemetry information with the label to enable prediction model training.
19 . The system of claim 12 , wherein performing the first test case in the TCC comprises: making a first determination that additional test iterations are required; and in response to the first determination: performing a second iteration of iterations of the first test case.