Micro-level network node failover system
An improved core network that can monitor micro-level issues, identify specific services of specific nodes that may be causing an outage, and perform targeted node failovers in a manner that does not cause unnecessary disruptions in service is described herein. For example, the improved core network can include a failover and isolation server (FIS) system. The FIS system can obtain service-specific KPIs from the various nodes in the core network. The FIS can then compare the obtained KPI values of the respective service with corresponding threshold values. If any KPI value exceeds a corresponding threshold value, the FIS may preliminarily determine that the service of the node associated with the KPI value is responsible for a service outage. The FIS can initiate a failover operation, which causes the node to re-route any received requests corresponding to the service potentially responsible for the service outage to a redundant node.
1. A computer-implemented method comprising:
obtaining one or more key performance indicator (KPI) values associated with one or more nodes in a core network that offer a first service, wherein the one or more KPI values are associated with the first service;
comparing a first KPI value in the one or more KPI values with a first threshold value;
determining that the first KPI value exceeds the first threshold value;
determining that the first KPI value corresponds with a first node in the one or more nodes;
instructing the first node to re-route requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
obtaining one or more second KPI values associated with the one or more nodes after the first node is instructed to re-route the requests;
determining that a second KPI value in the one or more second KPI values exceeds a second threshold value;
determining that the second KPI value corresponds with a third node in the one or more nodes;
instructing the first node to no longer re-route the requests corresponding to the first service; and
instructing the third node to re-route second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.
2. The computer-implemented method of claim 1 , further comprising:
resetting a failover timer after instructing the first node to re-route the requests corresponding to the first service; and
determining, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time.
3. The computer-implemented method of claim 1 , determining that the second KPI value deviates from the second threshold value by an amount greater than an amount by which the first KPI value deviates from the first threshold value.
4. The computer-implemented method of claim 1 , wherein the third node further offers a second service, and wherein the third node does not re-route third requests corresponding to the second service.
5. The computer-implemented method of claim 1 , wherein the first node and the second node perform the same operations.
6. The computer-implemented method of claim 1 , wherein the first service is one of a file transfer service, a voice call service, a call waiting service, a conference call service, a video chat service, or a short message service (SMS).
7. The computer-implemented method of claim 1 , wherein the first node comprises one of a session border controller (SBC), a call session control function (CSCF), a breakout gateway control function (BGCF), or a media gateway controller function (MGCF).
8. Non-transitory, computer-readable storage media comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to:
obtain one or more key performance indicator (KPI) values associated with one or more nodes in a core network that offer a first service, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
determine that the first node is responsible for a service outage in the first service in response to the determination that the first KPI value exceeds the first threshold value;
instruct the first node to re-route requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
determine that a third node in the one or more nodes is associated with a second KPI value obtained after the first node is instructed, wherein the second KPI value exceeds a second threshold value;
instruct the first node to no longer re-route the requests corresponding to the first service; and
instruct the third node to re-route second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.
9. The non-transitory, computer-readable storage media of claim 8 , wherein the computer-executable instructions further cause the computer system to obtain, in response to instructing the first node to re-route the requests, the second KPI value, wherein the second KPI value is obtained at a time after a time that the one or more KPI values are obtained.
10. The non-transitory, computer-readable storage media of claim 9 , wherein the computer-executable instructions further cause the computer system to:
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service; and
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer exceeds a threshold healing time.
11. The non-transitory, computer-readable storage media of claim 9 , wherein the computer-executable instructions further cause the computer system to:
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time; and
determine that the second KPI value deviates from the second threshold value by an amount greater than an amount by which the first KPI value deviates from the first threshold value.
12. The non-transitory, computer-readable storage media of claim 9 , wherein the computer-executable instructions further cause the computer system to:
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service; and
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time.
13. The non-transitory, computer-readable storage media of claim 8 , wherein the first node further offers a second service, and wherein the first node does not re-route second requests corresponding to the second service.
14. The non-transitory, computer-readable storage media of claim 8 , wherein the first node and the second node perform the same operations.
15. The non-transitory, computer-readable storage media of claim 8 , wherein the first service is one of a file transfer service, a voice call service, a call waiting service, a conference call service, a video chat service, or a short message service (SMS).
16. The non-transitory, computer-readable storage media of claim 8 , wherein the first node comprises one of a session border controller (SBC), a call session control function (CSCF), a breakout gateway control function (BGCF), or a media gateway controller function (MGCF).
17. A core network comprising:
one or more nodes that each offer a first service; and
a failover and isolation server (FIS) comprising a processor in communication with the one or more nodes and configured with specific computer-executable instructions to:
obtain one or more key performance indicator (KPI) values associated with the one or more nodes, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
determine that the first node is responsible for a service outage in the first service in response to the determination that the first KPI value exceeds the first threshold value;
initiate a failover operation with respect to the first node such that the first node redirects requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
determine that a third node in the one or more nodes is associated with a second KPI value obtained after the first node is instructed, wherein the second KPI value exceeds a second threshold value;
instruct the first node to no longer redirect the requests corresponding to the first service; and
instruct the third node to redirect second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.
18. The core network of claim 17 , wherein the FIS is further configured with specific computer-executable instructions to obtain, in response to initiating the failover operation, the second KPI value, wherein the second KPI value is obtained at a time after a time that the one or more KPI values are obtained.
19. The core network of claim 18 , wherein the FIS is further configured with specific computer-executable instructions to:
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service; and
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer exceeds a threshold healing time.
20. The core network of claim 18 , wherein the FIS is further configured with specific computer-executable instructions to:
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time; and
determine that the second KPI value deviates from the second threshold value by an amount greater than an amount by which the first KPI value deviates from the first threshold value.
21. Non-transitory, computer-readable storage media comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to:
obtain one or more key performance indicator (KPI) values associated with one or more nodes in a core network that offer a first service, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
instruct the first node to re-route requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
obtain, in response to instructing the first node to re-route the requests, one or more second KPI values associated with the one or more nodes, wherein the one or more second KPI values are obtained at a time after a time that the one or more KPI values are obtained;
determine that a second KPI value in the one or more second KPI values exceeds a second threshold value;
determine that the second KPI value corresponds with a third node in the one or more nodes;
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer exceeds a threshold healing time; and
instruct the third node to re-route second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.
22. Non-transitory, computer-readable storage media comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to:
obtain one or more key performance indicator (KPI) values associated with one or more nodes in a core network that offer a first service, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
instruct the first node to re-route requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
obtain, in response to instructing the first node to re-route the requests, one or more second KPI values associated with the one or more nodes, wherein the one or more second KPI values are obtained at a time after a time that the one or more KPI values are obtained;
determine that a second KPI value in the one or more second KPI values exceeds a second threshold value;
determine that the second KPI value corresponds with a third node in the one or more nodes;
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time;
determine that the second KPI value deviates from the second threshold value by an amount greater than an amount by which the first KPI value deviates from the first threshold value;
instruct the first node to no longer re-route the requests corresponding to the first service; and
instruct the third node to re-route second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.
23. Non-transitory, computer-readable storage media comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a computer system, cause the computer system to:
obtain one or more key performance indicator (KPI) values associated with one or more nodes in a core network that offer a first service, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
instruct the first node to re-route requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
obtain, in response to instructing the first node to re-route the requests, one or more second KPI values associated with the one or more nodes, wherein the one or more second KPI values are obtained at a time after a time that the one or more KPI values are obtained;
determine that a second KPI value in the one or more second KPI values exceeds a second threshold value;
determine that the second KPI value corresponds with a third node in the one or more nodes;
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time; and
determine that the first KPI value deviates from the second threshold value by an amount greater than an amount by which the second KPI value deviates from the first threshold value.
24. A core network comprising:
one or more nodes that each offer a first service; and
a failover and isolation server (FIS) comprising a processor in communication with the one or more nodes and configured with specific computer-executable instructions to:
obtain one or more key performance indicator (KPI) values associated with the one or more nodes, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
initiate a failover operation with respect to the first node such that the first node redirects requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
obtain, in response to instructing the first node to re-route the requests, one or more second KPI values associated with the one or more nodes, wherein the one or more second KPI values are obtained at a time after a time that the one or more KPI values are obtained;
determine that a second KPI value in the one or more second KPI values exceeds a second threshold value;
determine that the second KPI value corresponds with a third node in the one or more nodes;
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer exceeds a threshold healing time; and
initiate a failover operation with respect to the third node such that the third node redirects second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.
25. A core network comprising:
one or more nodes that each offer a first service; and
a failover and isolation server (FIS) comprising a processor in communication with the one or more nodes and configured with specific computer-executable instructions to:
obtain one or more key performance indicator (KPI) values associated with the one or more nodes, wherein the one or more KPI values are associated with the first service;
compare a first KPI value in the one or more KPI values with a first threshold value;
determine that the first KPI value exceeds the first threshold value;
determine that the first KPI value corresponds with a first node in the one or more nodes;
initiate a failover operation with respect to the first node such that the first node redirects requests corresponding to the first service to a second node in the one or more nodes that is redundant to the first node;
obtain, in response to instructing the first node to re-route the requests, one or more second KPI values associated with the one or more nodes, wherein the one or more second KPI values are obtained at a time after a time that the one or more KPI values are obtained;
determine that a second KPI value in the one or more second KPI values exceeds a second threshold value;
determine that the second KPI value corresponds with a third node in the one or more nodes;
reset a failover timer after instructing the first node to re-route the requests corresponding to the first service;
determine, in response to determining that the second KPI value exceeds the second threshold value, that a value of the failover timer does not exceed a threshold healing time;
determine that the second KPI value deviates from the second threshold value by an amount greater than an amount by which the first KPI value deviates from the first threshold value;
reverse the failover operation initiated with respect to the first node such that the first node no longer redirects the requests corresponding to the first service; and
initiate a failover operation with respect to the third node such that the third node redirects second requests corresponding to the first service to a fourth node in the one or more nodes that is redundant to the third node.