Fault tolerant distributed mobile architecture
A method, system and machine-readable storage medium for providing fault tolerance in a distributed mobile architecture (dMA) system. The method includes receiving a message or failing to receive the message within a predetermined time relating to a first dMA gateway (dMAG) at a second dMAG. It is determined whether the first dMAG is not operational or is otherwise offline based on the received message or the failure to receive the message. One or more dMA nodes associated with the first dMAG are notified in order to request connections to an external system via the second dMAG. The external system is also notified to request connections to one or more dMA nodes associated with the first dMAG via the second dMAG.
1. A method comprising:
detecting a failure condition relating to a first distributed mobile architecture (dMA) gateway (dMAG) at a dMAG management system, wherein the dMAG management system is in communication with at least the first dMAG, a second dMAG, and a plurality of dMA nodes;
determining that the first dMAG is not operational or is otherwise offline based on the failure condition;
selecting, at the dMAG management system, the second dMAG;
sending a first notification from the dMAG management system to the second dMAG, wherein the first notification instructs the second dMAG to take over operations from the first dMAG;
sending a second notification from the dMAG management system to at least one dMA node of the plurality of dMA nodes, wherein the at least one dMA node is configured to connect a call from a mobile station to an external system via the first dMAG, and wherein the second notification indicates that the second dMAG has taken over the operations from the first dMAG and that the at least one dMA node is to connect subsequent calls from the mobile station to the external system via the second dMAG; and
sending a third notification from the dMAG management system to the external system, wherein the external system is configured to connect calls to the mobile station via the first dMAG, and wherein the third notification indicates that the second dMAG has taken over the operations from the first dMAG and indicates that the external system is to connect subsequent calls to the mobile station via the second dMAG.
2. The method of claim 1 , wherein the failure condition is detected in response to receiving a message from the first dMAG, wherein the message indicates that the first dMAG is going offline.
3. The method of claim 1 , wherein the failure condition is detected in response to receiving a message from a dMA node local to the first dMAG, the message comprising a request for the second dMAG to take over the operations from the first dMAG.
4. The method of claim 3 , further comprising notifying the dMA node that the second dMAG is to take over the operations from the first dMAG.
5. The method of claim 1 , wherein the failure condition is detected in response to receiving a message from a dMAG interface of a legacy system, the message comprising a request for the second dMAG to take over the operations from the first dMAG.
6. The method of claim 1 , wherein the failure condition is detected in response to failing to receive a periodic heartbeat message from the first dMAG at the dMAG management system.
7. A system comprising:
a distributed mobile architecture (dMA) gateway (dMAG) management system comprising:
an operation determination module configured to:
receive messages; and
detect a failure condition associated with a first dMAG;
a dMAG selection module configured to select a second dMAG in response to detecting the failure condition; and
a notification module configured to:
send a first notification to the second dMAG, wherein the first notification instructs the second dMAG to take over operation of the first dMAG; and
send a second notification to a plurality of dMA nodes, wherein the plurality of dMA nodes are configured to request connections to an external system via the first dMAG, wherein the second notification identifies the second dMAG as having taken over the operation of the first dMAG, and wherein the second notification indicates that the plurality of dMA nodes are to subsequently request connections to the external system via the second dMAG; and
send a third notification from the dMAG management system to the external system, wherein the external system is configured to connect calls to a mobile station via the first dMAG, and wherein the third notification indicates that the second dMAG has taken over the operation of the first dMAG and indicates that the external system is to connect subsequent calls to the mobile station via the second dMAG,
wherein the dMAG management system is in communication with at least the first dMAG, the second dMAG, and the plurality of dMA nodes.
8. The system of claim 7 , wherein the operation determination module detects the failure condition based on a message received from the first dMAG, wherein the message is an offline message indicating that the first dMAG is going offline.
9. The system of claim 7 , wherein the operation determination module detects the failure condition based on a message received from a dMA node of the plurality of dMA nodes, the message comprising a request for the second dMAG to take over the operation of the first dMAG.
10. The system of claim 7 , wherein the operation determination module detects the failure condition based on a message received from the external system, the message comprising a request for the second dMAG to take over the operation of the first dMAG.
11. A machine-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
detecting a failure condition relating to a first dMA gateway (dMAG) at a dMAG management system, wherein the dMAG management system is in communication with at least the first dMAG, a second dMAG, and a plurality of dMA nodes;
selecting the second dMAG;
sending a first notification from the dMAG management system to the second dMAG,
wherein the first notification instructs the second dMAG to take over operation of the first dMAG; and
sending a second notification to at least one dMA node of the plurality of dMA nodes, wherein the at least one dMA node is configured to request connections to an external system via the first dMAG, wherein the second notification identifies the second dMAG as having taken over the operation of the first dMAG, and wherein the second notification indicates that the at least one dMA node is to subsequently request connections to the external system via the second dMAG; and
sending a third notification from the dMAG management system to the external system, wherein the external system is configured to connect calls to a mobile station via the first dMAG, and wherein the third notification indicates that the second dMAG has taken over the operations of the first dMAG and indicates that the external system is to connect subsequent calls to the mobile station via the second dMAG.