Advanced automation confidence reinforcement through observation of path changes
A method comprises: at a controller of a network, establishing a historical probability of success that an automated response, when executed on the network, will remediate an alarm event: performing a service test on the network to collect first path information from the network; after performing the service test, receiving from the network a report of the alarm event, and deploying the automated response to the network to remediate the alarm event; after the automated response is executed, repeating the service test on the network to collect second path information and a second test result that indicates pass or fail; determining whether a change from the first path information to the second path information represents a network degradation; and adjusting the historical probability of the success based on the second test result and whether the change represents the network degradation.
1 . A method comprising:
at a controller of a network, establishing a historical probability of success that an automated response, when executed on the network, will remediate an alarm event:
performing a service test on the network to collect first path information from the network;
after performing the service test, receiving from the network a report of the alarm event, and deploying the automated response to the network to remediate the alarm event;
after the automated response is executed, repeating the service test on the network to collect second path information and a second test result that indicates pass or fail;
determining whether a change from the first path information to the second path information represents a network degradation; and
adjusting the historical probability of the success based on the second test result and whether the change represents the network degradation.
2 . The method of claim 1 , wherein adjusting includes:
when the second test result indicates the pass and the change represents the network degradation, decreasing the historical probability of the success so that the automated response is less likely to be deployed at a future time.
3 . The method of claim 1 , wherein adjusting includes:
when the second test result indicates the pass but the change does not represent the network degradation, increasing the historical probability of the success so that the automated response is more likely to be deployed at a future time.
4 . The method of claim 1 , wherein adjusting includes:
when the second test result indicates fail, decreasing the historical probability of the success so that the automated response is less likely to be deployed at a future time.
5 . The method of claim 1 , wherein:
the first path information defines a first path over which the service test was performed;
the second path information defines a second path over which the service test was repeated; and
determining that the change represents the network degradation includes determining that the first path and the second path differ.
6 . The method of claim 1 , further comprising:
upon receiving the alarm event and upon determining that the historical probability of the success exceeds a threshold, deploying the automated response.
7 . The method of claim 1 , wherein:
the service test tests a parameter of a path over which the service test is performed;
the first path information includes a first measurement of the parameter;
the second path information includes a second measurement of the parameter; and
determining whether the change from the first path information to the second path information represents the network degradation includes comparing the first measurement to the second measurement represents.
8 . The method of claim 7 , wherein:
the parameter includes a delay time of the path.
9 . An apparatus comprising:
a network interface to communicate with a network; and
a processor coupled to the network interface and configured to perform:
establishing a historical probability of success that an automated response, when executed on the network, will remediate an alarm event:
performing a service test on the network to collect first path information from the network;
after performing the service test, receiving from the network a report of the alarm event, and deploying the automated response to the network to remediate the alarm event;
after the automated response is executed, repeating the service test on the network to collect second path information and a second test result that indicates pass or fail;
determining whether a change from the first path information to the second path information represents a network degradation; and
adjusting the historical probability of the success based on the second test result and whether the change represents the network degradation.
10 . The apparatus of claim 9 , wherein the processor is configured to perform adjusting by:
when the second test result indicates the pass and the change represents the network degradation, decreasing the historical probability of the success so that the automated response is less likely to be deployed at a future time.
11 . The apparatus of claim 9 , wherein the processor is configured to perform adjusting by:
when the second test result indicates the pass but the change does not represent the network degradation, increasing the historical probability of the success so that the automated response is more likely to be deployed at a future time.
12 . The apparatus of claim 9 , wherein the processor is configured to perform adjusting by:
when the second test result indicates fail, decreasing the historical probability of the success so that the automated response is less likely to be deployed at a future time.
13 . The apparatus of claim 9 , wherein:
the first path information defines a first path over which the service test was performed;
the second path information defines a second path over which the service test was repeated; and
the processor is configured to perform determining that the change represents the network degradation by determining that the first path and the second path differ.
14 . The apparatus of claim 9 , wherein the processor is further configured to perform:
upon receiving the alarm event and upon determining that the historical probability of the success exceeds a threshold, deploying the automated response.
15 . The apparatus of claim 9 , wherein:
the service test is configured to test a parameter of a path;
the first path information includes a first measurement of the parameter;
the second path information includes a second measurement of the parameter; and
the processor is configured to perform determining whether the change from the first path information to the second path information represents the network degradation by comparing the first measurement to the second measurement represents.
16 . The apparatus of claim 15 , wherein:
the parameter includes a delay time of the path.
17 . A non-transitory computer readable medium encoded with instructions, that when executed by a processor, cause the processor to perform:
establishing a historical probability of success that an automated response, when executed on a network, will remediate an alarm event:
performing a service test on the network to collect first path information from the network;
after performing the service test, receiving from the network a report of the alarm event, and deploying the automated response to the network to remediate the alarm event;
after the automated response is executed, repeating the service test on the network to collect second path information and a second test result that indicates pass or fail;
determining whether a change from the first path information to the second path information represents a network degradation; and
adjusting the historical probability of the success based on the second test result and whether the change represents the network degradation.
18 . The non-transitory computer readable medium of claim 17 , wherein the instructions to cause the processor to perform adjusting include instructions to cause the processor to perform:
when the second test result indicates the pass and the change represents the network degradation, decreasing the historical probability of the success so that the automated response is less likely to be deployed at a future time.
19 . The non-transitory computer readable medium of claim 17 , wherein the instructions to cause the processor to perform adjusting include instructions to cause the processor to perform:
when the second test result indicates the pass but the change does not represent the network degradation, increasing the historical probability of the success so that the automated response is more likely to be deployed at a future time.
20 . The non-transitory computer readable medium of claim 17 , wherein the instructions to cause the processor to perform adjusting include instructions to cause the processor to perform:
when the second test result indicates fail, decreasing the historical probability of the success so that the automated response is less likely to be deployed at a future time.