Synthesizing fully hydrated cloud snapshots
Systems and methods for synthesizing cloud snapshots of production data. A client system includes data and snapshots may be taken of that data. These snapshots are transferred to the cloud and hydrated to block devices that are similar to the devices on which the production data exists. Snapshots are then taken of the block devices. The cloud snapshots are the same as and correspond to the locally generated snapshots.
1. A method for synthesizing a cloud snapshot, the method comprising:
generating a snapshot of production data and storing the snapshot on a storage device;
converting the snapshot to a raw disk image;
transferring the raw disk image to cloud storage, wherein the raw disk image is stored in the cloud storage as an object;
hydrating the object to a block device in the cloud;
creating a snapshot from the hydrated object to create a cloud snapshot, wherein the cloud snapshot corresponds to the snapshot on the storage device; and
generating a second cloud snapshot that corresponds to a second generated snapshot on the storage device by applying a snapdiff object that is generated to include differences between the second snapshot on the storage device and the snapshot on the storage device,
wherein the cloud snapshot and the second cloud snapshot are configured for attachment to a compute instance without further conversion or data modification.
2. The method according to claim 1 , further comprising compressing and/or encrypting the snapshot before transferring the snapshot to the cloud storage.
3. The method according to claim 1 , wherein hydrating the object to a block device includes importing the object to the block device using a snapshot import feature.
4. The method according to claim 1 , further comprising connecting the cloud snapshot to a compute instance.
5. The method according to claim 1 , further comprising storing the changes between the second snapshot and the snapshot in the snapdiff object.
6. The method according to claim 5 , further comprising transferring the snapdiff object to the cloud storage.
7. The method according to claim 6 , wherein applying the snapdiff object comprises applying the changes in the snapdiff object to the block device.
8. The method according to claim 7 , further comprising taking a second cloud snapshot of the block device after the snapdiff object has been applied to the block device.
9. The method according to claim 1 , wherein the production data comprises data, an application, or data and an application.
10. A method for synthesizing a cloud snapshot, the method comprising:
generating a snapshot of production data and storing the snapshot on a storage device, wherein the production data are stored on a volume;
converting the snapshot to a raw disk image;
transferring the raw disk image to cloud storage, wherein the raw disk image is stored in the cloud storage as an object;
importing the object to a block device, wherein a configuration of the block device is the same as the volume on which the data is stored;
creating a snapshot of the data on the block device to create a cloud snapshot, wherein the cloud snapshot corresponds to the snapshot on the storage device;
updating the block device based on changes stored in subsequent snapshots on the storage device, wherein at least some of the subsequent snapshots includes only changes from a previous snapshot; and
creating subsequent cloud snapshots of the updated block device, wherein the subsequent cloud snapshots correspond to the subsequent snapshots on the storage device, wherein the cloud snapshot and the subsequent cloud snapshots are configured for attachment to a compute instance without further conversion or data modification.
11. The method according to claim 10 , further comprising compressing and/or encrypting the snapshot and the subsequent snapshots before transferring the snapshot and the subsequent snapshots to the cloud storage.
12. The method according to claim 10 , wherein importing the object includes hydrating the object the block device using a snapshot import feature.
13. The method according to claim 10 , further comprising connecting the cloud snapshot to a compute instance.
14. The method according to claim 10 , further comprising generating a metadata file, wherein the metadata file includes changes from one of the snapshots to another of the snapshots.
15. The method according to claim 14 , wherein the metadata file identifies locations of changes and sizes of the changes.
16. The method according to claim 15 , wherein each of the subsequent snapshots is associated with a corresponding metadata file.
17. The method according to claim 14 , wherein updating the block device includes applying the changes associated with a metadata file to the block device.
18. The method according to claim 14 , further comprising storing the changes in a snapdiff object.
19. The method according to claim 10 , wherein the production data comprises data, an application, or data and an application.