Synchronous replication error detection and handling
View Patent ↗Some embodiments are directed to a method, corresponding system, and corresponding apparatus that may store data and may monitor, detect, and handle one or more warning or error indications within one or more synchronized replication volumes. Some embodiments may provide first and second storage pools of storage devices with respective volumes. In some embodiments, the first and second storage pools may not share the same controller. Some embodiments may synchronize the first and second storage pools by a storage device of the first storage pool. Some embodiments may monitor for failures, including but not limited to warnings, soft errors, and/or hard errors, at a storage device of the first storage pool. In some embodiments, the one or more failures may be invisible or inaccessible to a user. Prior to an out of sync event or failure, some embodiments may automatically replace the second volume with the first volume.
1. A computer-implemented method for storing data, the method comprising:
providing a first pool of storage having a first plurality of storage devices and an associated first volume;
providing a second pool of storage having a second plurality of storage devices and an associated second volume, data of the first pool of storage corresponding to data of the second pool of storage, the first pool of storage and the second pool of storage not sharing the same controller;
synchronizing, by a storage device of the first plurality of storage devices, the first pool of storage with the second pool of storage;
monitoring, at a storage device of the first plurality of storage devices, each given storage device of the first plurality of storage devices for one or more warning indications including one or more soft errors; and
based on results of the monitoring, automatically taking corrective action, prior to a loss of synchronization event and prior to a failure of the first volume,
wherein the synchronizing includes performing one or more bi-directional acknowledgements between the first pool of storage and the second pool of storage; and
wherein automatically taking corrective action includes replacing the second volume with the first volume, prior to the loss of synchronization event and prior to the failure of the first volume.
2. The computer-implemented method of claim 1 , further comprising, based on results of the monitoring, detecting one or more conditions and initiating the automatically taken corrective action based upon a predefined threshold associated with the one or more conditions.
3. The computer-implemented method of claim 1 , wherein the one or more warning indications are at least one of: invisible to a user and inaccessible to a user.
4. The computer-implemented method of claim 1 , wherein the one or more warning indications include a disk error including a logical block addressing (LBA) error, and zero or more of: a lost block, a port down, a network link error, and a hardware fault.
5. The computer-implemented method of claim 1 , wherein the storage device of the first plurality of storage devices monitors for the one or more warning indications in one or more event logs that are associated with each given storage device.
6. The computer-implemented method of claim 1 , wherein automatically taking corrective action further includes running a rescan on the second volume, mounting storage devices of the second volume, registering one or more virtual machines (VMs) of the second volume, and powering on one or more virtual machines (VMs) of the second volume.
7. The computer-implemented method of claim 1 , wherein replacing the second volume with the first volume includes configuring the second volume using at least one of: a different number of storage devices and a different arrangement of storage devices, as compared with the second volume, without loss of data from the first volume.
8. The computer-implemented method of claim 1 , wherein the one or more warning indications include a network link error, and zero or more of: a lost block, a disk error, a port down, and a hardware fault.
9. An information handling system (IHS) comprising:
a data module configured to provide a first pool of storage having a first plurality of storage devices and an associated first volume;
the data module further configured to provide a second pool of storage having a second plurality of storage devices and an associated second volume, data of the first pool of storage corresponding to data of the second pool of storage, the first pool of storage and the second pool of storage not sharing the same controller;
a computing module configured to synchronize, by a storage device of the first plurality of storage devices, the first pool of storage with the second pool of storage;
the computing module further configured to monitor, at a storage device of the first plurality of storage devices, each given storage device of the first plurality of storage devices for one or more warning indications including one or more soft errors; and
the computing module further configured to automatically take corrective action, based on results of the monitoring, prior to a loss of synchronization event and prior to a failure of the first volume,
wherein the computing module is further configured to synchronize including performing one or more bi-directional acknowledgements between the first pool of storage and the second pool of storage;
wherein the computing module is further configured to further automatically taking corrective action including replacing the second volume with the first volume, prior to the loss of synchronization event and prior to the failure of the first volume.
10. The IHS of claim 9 , wherein the computing module is further configured, based on results of the monitoring, to detect one or more conditions and initiate the automatically taken corrective action based upon a predefined threshold associated with the one or more conditions.
11. The IHS of claim 9 , wherein the one or more warning indications are at least one of: invisible to a user and inaccessible to a user.
12. The IHS of claim 9 , wherein the one or more warning indications include a disk error including a logical block addressing (LBA) error, and zero or more of: a lost block, a port down, a network link error, and a hardware fault.
13. The IHS of claim 9 , wherein the computing module is further configured to monitor, at the storage device of the first plurality of storage devices, for the one or more warning indications in one or more event logs that are associated with each given storage device.
14. The IHS of claim 9 , wherein the computing module is further configured to automatically take corrective action including running a rescan on the second volume, mounting storage devices of the second volume, registering one or more virtual machines (VMs) of the second volume, and powering on one or more virtual machines (VMs) of the second volume.
15. The IHS of claim 11 , wherein replacing the second volume with the first volume includes configuring the second volume using at least one of: a different number of storage devices and a different arrangement of storage devices, as compared with the second volume, without loss of data from the first volume.
16. The IHS of claim 9 , wherein the one or more warning indications include a network link error, and zero or more of: a lost block, a disk error, a port down, and a hardware fault.
17. A non-transitory computer readable medium having stored thereon a sequence of instructions which, when loaded and executed by a processor coupled to an apparatus, causes the apparatus to:
provide a first pool of storage having a first plurality of storage devices and an associated first volume;
provide a second pool of storage having a second plurality of storage devices and an associated second volume, data of the first pool of storage corresponding to data of the second pool of storage, the first pool of storage and the second pool of storage not sharing the same controller;
synchronize, by a storage device of the first plurality of storage devices, the first pool of storage with the second pool of storage, through one or more bi directional acknowledgements between the first pool of storage and the second pool of storage;
monitor, at a storage device of the first plurality of storage devices, each given storage device of the first plurality of storage devices for one or more warning indications including one or more soft errors; and
automatically take corrective action, based on results of the monitoring, prior to a loss of synchronization event and prior to a failure of the first volume; and
further automatically taking corrective action including replacing the second volume with the first volume, prior to the loss of synchronization event and prior to the failure of the first volume.
18. The computer-implemented method of claim 1 , wherein the one or more warning indications include a lost block, and zero or more of: a disk error, a port down, a network link error, and a hardware fault.