Communication network failure detection and restoration
An apparatus includes a processor and a memory having instructions stored thereon that, when executed by the processor, cause the apparatus to process a first notification received from a first network node to determine a first status of the first network node. The apparatus is also caused to process a second notification received from a second network node to determine a second status of the second network node. The apparatus is further caused to, response to determining the first status and the second status indicate an alarm state, cause a workload assigned to a first data center associated with the first network node and the second network node to be reassigned to a second data center different from the first data center.
1 . A method, comprising:
processing, by a processor, a first notification received from a first network node to determine a first status of the first network node, wherein the first notification comprises a first node identifier and a first host name corresponding to the first network node;
processing a second notification received from a second network node to determine a second status of the second network node, wherein the second notification comprises a second node identifier and a second host name corresponding to the second network node;
determining whether the first notification and the second notification are defined in a database as being indicative of an alarm state based on the first node identifier, the first host name, the second node identifier, and the second host name;
identifying two or more alternative network nodes capable of being used as the first network node or the second network node for facilitating a workload reassigned to a second data center by searching the database for alternative network nodes of a compatible type of network node based on a description of the first network node, the second network node, and the alternative network nodes included in the database; and
in response to identifying the two or more alternative network nodes, causing the workload assigned to a first data center associated with the first network node and the second network node to be reassigned to the second data center different from the first data center.
2 . The method of claim 1 , wherein, before causing the workload to be reassigned to the second data center in response to identifying the two or more alternative network nodes, the method further comprises:
processing a third notification received from the first network node to determine a third status of the first network node;
processing a fourth notification received from the second network node to determine a fourth status of the second network node; and
in response to determining the third status and the fourth status indicate the alarm state, causing the workload to be reassigned to the second data center.
3 . The method of claim 2 , wherein the third notification and the fourth notification are processed after a preset period of time has elapsed after determining the first status and the second status indicate the alarm state.
4 . The method of claim 1 , further comprising:
causing a network orchestrator to instantiate the workload reassigned to the second data center; and
updating the database to include information indicative of the workload reassigned to the second data center and information indicative of an association between the alternative network nodes and the second data center.
5 . The method of claim 1 , wherein the first network node and the second network node are border leaf switches.
6 . The method of claim 1 , wherein the first network node and the second network node are of a same network node type, and the network node type is a switch, a spine switch, an access gateway switch, a computer, or a router.
7 . The method of claim 1 , wherein
the first network node is a first network node type, the second network node is a second network node type different from the first network node type, and
the first network node type and the second network node type comprise one or more of a switch, a border leaf switch, a spine switch, an access gateway switch, a computer, or a router.
8 . An apparatus, comprising:
a processor; and
a memory having instructions stored thereon that, when executed by the processor, cause the apparatus to:
process a first notification received from a first network node to determine a first status of the first network node, wherein the first notification comprises a first node identifier and a first host name corresponding to the first network node;
process a second notification received from a second network node to determine a second status of the second network node, wherein the second notification comprises a second node identifier and a second host name corresponding to the second network node;
determine whether the first notification and the second notification are defined in a database as being indicative of an alarm state based on the first node identifier, the first host name, the second node identifier, and the second host name;
identify two or more alternative network nodes capable of being used as the first network node or the second network node for facilitating a workload reassigned to a second data center by searching the database for alternative network nodes of a compatible type of network node based on a description of the first network node, the second network node, and the alternative network nodes included in the database; and
in response to identifying the two or more alternative network nodes, cause the workload assigned to a first data center associated with the first network node and the second network node to be reassigned to the second data center different from the first data center.
9 . The apparatus of claim 8 , wherein, before causing the workload to be reassigned to the second data center in response to identifying the two or more alternative network nodes, the apparatus is further caused to:
process a third notification received from the first network node to determine a third status of the first network node;
process a fourth notification received from the second network node to determine a fourth status of the second network node; and
in response to determining the third status and the fourth status indicate the alarm state, cause the workload to be reassigned to the second data center.
10 . The apparatus of claim 9 , wherein the third notification and the fourth notification are processed after a preset period of time has elapsed after determining the first status and the second status indicate the alarm state.
11 . The apparatus of claim 9 , wherein the first notification, the second notification, the third notification and the fourth notification are received by way of an observability framework communicatively coupled with the first network node and the second network node.
12 . The apparatus of claim 8 , wherein the apparatus is further caused to:
cause a network orchestrator to instantiate the workload reassigned to the second data center; and
update the database to include information indicative of the workload reassigned to the second data center and information indicative of an association between the alternative network nodes and the second data center.
13 . The apparatus of claim 12 , wherein to instantiate the workload assigned to the second data center, the network orchestrator pushes at least a Day 1 and a Day 2 configuration to the alternative network nodes to facilitate performance of the workload following reassignment to the second data center.
14 . The apparatus of claim 8 , wherein the first network node and the second network node are switches.
15 . The apparatus of claim 14 , wherein the first network node and the second network node are border leaf switches.
16 . The apparatus of claim 8 , wherein the first network node and the second network node are of a same network node type, and the network node type is a switch, a spine switch, an access gateway switch, a computer, or a router.
17 . The apparatus of claim 8 , wherein
the first network node is a first network node type, the second network node is a second network node type different from the first network node type, and
the first network node type and the second network node type comprise one or more of a switch, a border leaf switch, a spine switch, an access gateway switch, a computer, or a router.
18 . A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause an apparatus to:
process a first notification received from a first network node to determine a first status of the first network node, wherein the first notification comprises a first node identifier and a first host name corresponding to the first network node;
process a second notification received from a second network node to determine a second status of the second network node, wherein the second notification comprises a second node identifier and a second host name corresponding to the second network node;
determine whether the first notification and the second notification are defined in a database as being indicative of an alarm state based on the first node identifier, the first host name, the second node identifier, and the second host name;
identify two or more alternative network nodes capable of being used as the first network node or the second network node for facilitating a workload reassigned to a second data center by searching the database for alternative network nodes of a compatible type of network node based on a description of the first network node, the second network node, and the alternative network nodes included in the database; and
in response to identifying the two or more alternative network nodes, cause the workload assigned to a first data center associated with the first network node and the second network node to be reassigned to the second data center different from the first data center.
19 . The non-transitory computer readable medium of claim 18 , wherein, before causing the workload to be reassigned to the second data center in response to identifying the two or more alternative network nodes, the apparatus is further caused to:
process a third notification received from the first network node to determine a third status of the first network node;
process a fourth notification received from the second network node to determine a fourth status of the second network node; and
in response to determining the third status and the fourth status indicate the alarm state, cause the workload to be reassigned to the second data center.
20 . The non-transitory computer readable medium of claim 19 , wherein the third notification and the fourth notification are processed after a preset period of time has elapsed after determining the first status and the second status indicate the alarm state.