STORAGE SYSTEM WITH CLOUD ASSISTED RECOVERY
A cluster storage system including servers containing storage processing units (SPUs) can create synchronized snapshot sets for the volumes that the SPUs maintain and can report the snapshot sets to a cloud-based service. Each snapshot in a set reflects the state a corresponding volume had at a rollback point corresponding to the set. A user of the storage system contacts the cloud-based service about recovery of the storage system, and the cloud-based service may present the user with a list of rollback points corresponding to the synchronized snapshot sets. The user may select to recover the storage system to any of the rollback points, and the SPUs promote the selected snapshots to replace the volumes for storage services.
1 . A system, comprising:
a processor; and
a memory storing instructions that, when executed by the processor, cause the processor to:
create a first snapshot set including a plurality of first snapshots respectively of a plurality of volumes, the first snapshots capturing respective states that the plurality of volumes have at a first time;
create a second snapshot set including a plurality of second snapshots respectively of a plurality of volumes, the second snapshots capturing respective states that the plurality of volumes have at a second time;
provide, for presentation to the user, a list of recovery points, the recovery points including a first recovery point corresponding to the first time and a second recovery point corresponding to the second time; and
in response to receiving a selection from the list of recovery points, promote either the first snapshots or the second snapshots to update the plurality of volumes.
2 . The process of claim 1 , wherein the process further comprises creating a third snapshot set, the third snapshot set including a plurality of third snapshots respectively of the plurality of volumes, the third snapshots capturing respective states that the plurality of volumes have at a third time, wherein the list of recovery points presented to the user further includes a third recovery point corresponding to the third time.
3 . The process of claim 2 , further comprising instructing one or more storage processing units (SPUs) to perform a snapshot operation at times indicated by a schedule, wherein:
each performance of the snapshot operation including each of the SPUs snapshotting each of the volumes that the SPU exports;
the schedule includes the first time and the third time;
the first snapshot set is results of the SPUs performing the snapshot operation at the first time; and
the third snapshot set is results of the SPUs performing the snapshot operation at the third time.
4 . The process of claim 1 , wherein the process further comprises receiving communication from the user to communicate with a cloudbased service about recovery while the volumes are corrupted or encrypted.
5 . The process of claim 4 , wherein when the cloud-based service presents the list, the cloud-based service also provides to the user information indicating whether the first snapshots appear to be corrupted or encrypted.
6 . The process of claim 1 , wherein creating the first snapshot set comprises performing, by one or more service processing units (SPUs), a snapshot operation that includes:
suspending incoming storage service requests;
completing pending storage operations for prior storage service requests to the SPU;
creating the first snapshots of the volumes that the SPU maintains; and
resuming acceptance of incoming storage requests to the SPU.
7 . The process of claim 6 , wherein each of the SPUs creates the first snapshots of the volumes without copying data of the volumes.
8 . The process of claim 1 , wherein the promoting of snapshots comprises promoting, by one or more storage processing units (SPUs), their respective volumes, thereby rolling back an entire cluster of storage nodes associated with the SPUs.
9 . A method comprising:
creating a first snapshot set including a plurality of first snapshots respectively of a plurality of volumes, the first snapshots capturing respective states that the plurality of volumes have at a first time;
creating a second snapshot set including a plurality of second snapshots respectively of a plurality of volumes, the second snapshots capturing respective states that the plurality of volumes have at a second time;
providing, for presentation to the user, a list of recovery points, the recovery points including a first recovery point corresponding to the first time and a second recovery point corresponding to the second time; and
in response to receiving a selection from the list of recovery points, promoting either the first snapshots or the second snapshots to update the plurality of volumes.
10 . The method of claim 9 , wherein the process further comprises creating a third snapshot set, the third snapshot set including a plurality of third snapshots respectively of the plurality of volumes, the third snapshots capturing respective states that the volumes have at a third time, wherein the list of recovery points presented to the user further includes a third recovery point corresponding to the third time.
11 . The method of claim 9 , wherein the instructions further comprise instructing one or more storage processing units (SPUs) to perform a snapshot operation at times indicated by a schedule, wherein:
each performance of the snapshot operation includes each of the SPUs snapshotting each of the volumes that the SPU exports;
the schedule includes the first time and the third time;
the first snapshot set is results of the SPUs performing the snapshot operation at the first time; and
the third snapshot set is results of the SPUs performing the snapshot operation at the third time.
12 . The method of claim 11 , further comprising receiving communication from the user to communicate with a cloudbased service about recovery while the volumes are corrupted or encrypted.
13 . The method of claim 12 , wherein when the cloud-based service presents the list, the cloud-based service also provides to the user information indicating whether the first snapshots appear to be corrupted or encrypted.
14 . The method of claim 9 , wherein creating the first snapshot set comprises performing, by one or more storage processing units (SPUs), a snapshot operation that includes:
suspending incoming storage service requests;
completing pending storage operations for prior storage service requests to the SPU;
creating the first snapshots of the volumes that the SPU maintains; and
resuming acceptance of incoming storage requests to the SPU.
15 . The method of claim 14 , wherein each of the SPUs creates the first snapshots of the volumes without copying data of the volumes.
16 . One or more processors to provide, for presentation to a user, a list of recovery points for a storage unit comprising a plurality of volumes, the recovery points including a first recovery point corresponding to a first time and a second recovery point corresponding to a second time, and in response to receiving a selection from the list of recovery points, promoting either the first snapshots or the second snapshots to update the plurality of volumes.
17 . The one or more processors of claim 16 , wherein the promoting of snapshots includes one or more storage processing units (SPUs) promoting their respective volumes in response to the instructions from the cloud-based service, thereby rolling back an entire cluster of storage nodes associated with the SPUs.
18 . The one or more processors of claim 16 , further to delete one or more snapshots of volumes that are not boot volumes.
19 . The one or more processors of claim 18 , wherein the one or more deleted snapshots are disqualified from providing a possible recovery point.
20 . The one or more processors of claim 16 , further to instruct one or more storage processing units (SPUs) to perform a snapshot operation at times indicated by a schedule, wherein:
each performance of the snapshot operation includes each of the SPUs snapshotting each of the volumes that the SPU exports;
the schedule includes the first time and the third time;
the first snapshot set is results of the SPUs performing the snapshot operation at the first time; and
the third snapshot set is results of the SPUs performing the snapshot operation at the third time.