Data preservation for node evacuation in unstable nodes within a mesh
Described is a system and method that includes rerouting incoming data of a node to a first destination in response to determining that the node is in an unstable state, and evacuating data stored in the node to a second destination. Each destination of the first destination and the second destination comprises at least one of a persistent volume, a cloud storage, or another node in a mesh networkode.
1. A method comprising:
rerouting, by a processing device executing a data risk mitigation service (DRMS), incoming data of a node to a first destination in response to determining that the node is in an unstable state; and
evacuating data stored in the node to a second destination, wherein each destination of the first destination and the second destination comprises at least one of a persistent volume, a cloud storage, or another node in a mesh network.
2. The method of claim 1 , further comprising determining whether the node is in the unstable state in view of metadata.
3. The method of claim 1 , further comprising determining whether the node is in the unstable state in view of a call for help from the node.
4. The method of claim 2 , wherein the metadata comprises a set of metrics, and wherein the set of metrics comprise a load on the node, a usage of a CPU of the node, a temperature of the node, a firmware version of the node, or a recent network connectivity issue.
5. The method of claim 1 , further comprising:
determining that the node reaches a stable state; and
stopping the rerouting incoming data of the node and evacuating data stored in the node, in response to determining that the node reaches the stable state.
6. The method of claim 1 , further comprising recovering the node by returning the evacuated data to the node.
7. The method of claim 1 , wherein the rerouting the incoming data of the node and evacuating the data stored in the node comprises deploying a script onto the node.
8. A system comprising:
a memory;
a processing device, executing a data risk mitigation service (DRMS) and operatively coupled with the memory, the processing device to:
reroute incoming data of a node to a first destination in response to determining that the node is in an unstable state; and
evacuate data stored in the node to a second destination, wherein each destination of the first destination and the second destination comprises at least one of a persistent volume, a cloud storage, or another node in a mesh network.
9. The system of claim 8 , wherein the processing device is further to determine whether the node is in the unstable state in view of metadata.
10. The system of claim 8 , wherein the processing device is further to determine whether the node is in the unstable state in view of a call for help from the node.
11. The system of claim 9 , wherein the metadata comprises a set of metrics, and wherein the set of metrics comprise a load on the node, a usage of a CPU of the node, a temperature of the node, a firmware version of the node, or a recent network connectivity issue.
12. The system of claim 8 , wherein the processing device is further to:
determine that the node reaches a stable state; and
stop the rerouting incoming data of the node and evacuating data stored in the node, in response to determining that the node reaches the stable state.
13. The system of claim 8 , wherein the processing device is further to recover the node by returning the evacuated data to the node.
14. A non-transitory computer-readable storage medium including instructions that, when executed by a processing device, cause the processing device to:
reroute incoming data of a node to a first destination in response to determining that the node is in an unstable state; and
evacuate data stored in the node to a second destination, wherein each destination of the first destination and the second destination comprises at least one of a persistent volume, a cloud storage, or another node in a mesh network.
15. The non-transitory computer-readable storage medium of claim 14 , wherein the processing device is further to determine whether the node is in the unstable state based on metadata.
16. The non-transitory computer-readable storage medium of claim 14 , device wherein the processing device is further to determine whether the node is in the unstable state based on a call for help from the node.
17. The non-transitory computer-readable storage medium of claim 15 , wherein the metadata comprises a set of metrics, and wherein the set of metrics comprise a load on the node, a usage of a CPU of the node, a temperature of the node, a firmware version of the node, or a recent network connectivity issue.
18. The non-transitory computer-readable storage medium of claim 17 , wherein the processing device is further to:
determine that the node reaches a stable state; and
stop the rerouting incoming data of the node and evacuating data stored in the node, in response to determining that the node reaches the stable state.
19. The non-transitory computer-readable storage medium of claim 14 , wherein the processing device is further to recover the node by returning the evacuated data to the node.
20. The non-transitory computer-readable storage medium of claim 14 , wherein to reroute the incoming data of the node and evacuate the data stored in the node, the processing device to use rules to reroute the incoming data of the node and evacuate the data stored in the node.