Asynchronous cross-region block volume replication
Techniques are provided for cross-region replication of block volume data. The techniques include a method wherein a computer system implements operations including creating a first snapshot of a block volume at a first geographic region and at a first logical time, the block volume including a plurality of partitions, transmitting first snapshot data to an object storage system at a second geographic region, creating a second snapshot of the block volume at the first geographic region and at a second logical time, generating a plurality of deltas, transmitting a plurality of delta data sets corresponding to the plurality of deltas to the object storage system at the second geographic region, generating a checkpoint at least in part by aggregating object metadata associated with the plurality of deltas and the first snapshot, receiving a restore request to generate a restore volume, and generating the restore volume from the checkpoint.
1 . A method, comprising:
receiving a resize request for one or more partitions of a first plurality of partitions in a source volume of a first data center located in a first geographic region;
in response to the resize request for the one or more partitions in the source volume:
executing an update for data stored in a standby volume based on the source volume prior to resizing the one or more partitions in the source volume at least by:
generating one or more deltas for the one or more partitions in the source volume of the first data center located in the first geographic region prior to resizing the one or more partitions in the source volume,
wherein a delta, of the one or more deltas, corresponds to a difference between (a) a first state of a partition in the source volume of the first data center at a first point in time and (b) a second state of the partition in the source volume at a second point in time that is subsequent to the first point in time;
applying an update based on the one or more deltas to one or more partitions of a second plurality of partitions in the standby volume of a second data center located in a second geographic region;
resizing the one or more partitions in the source volume of the first data center located in the first geographic region based at least in part on the resize request; and
resizing the one or more partitions in the standby volume of the second data center located in the second geographic region based at least in part on (a) the resize request for the one or more partitions in the source volume and/or (b) resizing of the one or more partitions in the source volume,
wherein the method is performed by a computing system including a hardware processor.
2 . The method of claim 1 , wherein the resize request corresponds to a request to add one or more partitions to the source volume.
3 . The method of claim 1 , wherein the resize request corresponds to a request to remove one or more partitions from the source volume.
4 . The method of claim 1 , wherein the resize request corresponds to a request to resize one or more partitions of the source volume.
5 . The method of claim 1 , wherein generating one or more deltas for the one or more partitions in the source volume of the first data center comprises:
creating a new snapshot of the source volume at the first data center; and
generating the one or more deltas based at least in part on the new snapshot of the source volume.
6 . The method of claim 1 , wherein the standby volume corresponds to a structure of the source volume of the first data center located at the first geographic region.
7 . The method of claim 6 , wherein the structure comprises at least one of a size of the source volume or a partitioning of the source volume.
8 . The method of claim 1 , wherein applying the update based on the one or more deltas to one or more partitions in a standby volume of a second data center located in a second geographic region comprises:
providing the one or more deltas to the second data center located in the second geographic region.
9 . The method of claim 8 , wherein the one or more deltas are provided to the second data center located in the second geographic region with any new data added to the source volume of the first data center located in the first geographic region.
10 . The method of claim 8 , wherein the one or more deltas are provided to the second data center located in the second geographic region with metadata that identifies any data removed from the source volume of the first data center located in the first geographic region.
11 . A computing system including a hardware processor and configured to perform operations comprising:
receiving a resize request for one or more partitions of a first plurality of partitions in a source volume of a first data center located in a first geographic region;
in response to the resize request for the one or more partitions in the source volume;
executing an update for data stored in a standby volume based on the source volume prior to resizing the one or more partitions in the source volume at least by:
generating one or more deltas for the one or more partitions in the source volume of the first data center located in the first geographic region prior to resizing the one or more partitions in the source volume,
wherein a delta, of the one or more deltas, corresponds to a difference between (a) a first state of a partition in the source volume of the first data center at a first point in time and (b) a second state of the partition in the source volume at a second point in time that is subsequent to the first point in time;
applying an update based on the one or more deltas to one or more partitions of a second plurality of partitions in the standby volume of a second data center located in a second geographic region;
resizing the one or more partitions in the source volume of the first data center located in the first geographic region based at least in part on the resize request; and
resizing the one or more partitions in the standby volume of the second data center located in the second geographic region based at least in part on (a) the resize request for the one or more partitions in the source volume and/or (b) resizing of the one or more partitions in the source volume.
12 . The computing system of claim 11 , wherein the resize request corresponds to a request to add one or more partitions to the source volume.
13 . The computing system of claim 11 , wherein the resize request corresponds to a request to remove one or more partitions from the source volume.
14 . The computing system of claim 11 , wherein the resize request corresponds to a request to resize one or more partitions of the source volume.
15 . The computing system of claim 11 , wherein generating one or more deltas for the one or more partitions in the source volume of the first data center comprises:
creating a new snapshot of the source volume at the first data center; and
generating the one or more deltas based at least in part on the new snapshot of the source volume.
16 . A non-transitory computer-readable medium, storing computer-executable instructions that, when executed, cause one or more processors of a computing system to perform operations comprising:
receiving a resize request for one or more partitions of a first plurality of partitions in a source volume of a first data center located in a first geographic region;
in response to the resize request for the one or more partitions in the source volume;
executing an update for data stored in a standby volume based on the source volume prior to resizing the one or more partitions in the source volume at least by:
generating one or more deltas for the one or more partitions in the source volume of the first data center located in the first geographic region prior to resizing the one or more partitions in the source volume,
wherein a delta, of the one or more deltas, corresponds to a difference between (a) a first state of a partition in the source volume of the first data center at a first point in time and (b) a second state of the partition in the source volume at a second point in time that is subsequent to the first point in time;
applying an update based on the one or more deltas to one or more partitions of a second plurality of partitions in the standby volume of a second data center located in a second geographic region;
resizing the one or more partitions in the source volume of the first data center located in the first geographic region based at least in part on the resize request; and
resizing the one or more partitions in the standby volume of the second data center located in the second geographic region based at least in part on (a) the resize request for the one or more partitions in the source volume and/or (b) resizing of the one or more partitions in the source volume.
17 . The non-transitory computer-readable medium of claim 16 , wherein the resize request corresponds to a request to add one or more partitions to the source volume.
18 . The non-transitory computer-readable medium of claim 16 , wherein the resize request corresponds to a request to remove one or more partitions from the source volume.
19 . The non-transitory computer-readable medium of claim 16 , wherein the resize request corresponds to a request to resize one or more partitions of the source volume.
20 . The non-transitory computer-readable medium of claim 16 , wherein generating one or more deltas for the one or more partitions in the source volume of the first data center comprises:
creating a new snapshot of the source volume at the first data center; and
generating the one or more deltas based at least in part on the new snapshot of the source volume.