Snapshots for any point in time replication
Systems and methods for providing any point in time functionality. With a storage system such as a VSAN, any point in time protection is achieved by combining a metadata stream with snapshots of the storage system. This allows snapshots to be generated in hindsight such that any point in time functionality is provided.
1. A method for realizing any point in time functionality in a storage system, the method comprising:
receiving an input/output at an owner of an object in the storage system, the storage system storing objects;
extracting metadata associated with the input/output;
manipulating and storing the extracted metadata in a metadata object that is owned by the owner, wherein the manipulated metadata includes the metadata object and a data object;
performing the input/output on the object;
generating a new snapshot for a selected point in time by only manipulating the metadata object and without copying or moving data included in the objects;
restoring a production volume by:
scanning the metadata object to determine relevant metadata included in the metadata object;
creating a metadata volume from a blank metadata volume by writing relevant metadata from the metadata object corresponding to the new snapshot to populate the blank metadata volume, the metadata including identifiers, wherein each identifier points to data in the objects; and
while creating the metadata volume, hydrating the production volume using the metadata volume and the objects, wherein the production volume corresponds to the selected point in time.
2. The method of claim 1 , further comprising converting the metadata object with a snapshot of the object and appending the relevant portion of the metadata object into the snapshot of the object.
3. The method of claim 2 , wherein the snapshot of the object comprises a b+tree and wherein the new snapshot comprises a b+tree.
4. The method of claim 3 , wherein the storage system comprises a VSAN.
5. The method of claim 4 , further comprising appending the relevant portion of the metadata object to internal nodes of the b+tree.
6. The method of claim 1 , wherein all IOs for the object pass through the owner.
7. The method of claim 1 , further comprising exposing the object based on the new snapshot.
8. The method of claim 1 , further comprising rebalancing the new snapshot after all of the relevant portion of the metadata objects has been appended to the snapshot of the object.
9. The method of claim 1 , further comprising generating the new snapshot in hindsight.
10. A non-transitory computer readable medium comprising computer executable instructions configured to be executed by a processor to perform a method for realizing any point in time functionality in a storage system, the method comprising:
receiving an input/output at an owner of an object in the storage system, the storage system storing objects;
extracting metadata associated with the input/output;
manipulating and storing the extracted metadata in a metadata object that is owned by the owner, wherein the manipulated metadata includes the metadata object and a data object;
performing the input/output on the object;
generating a new snapshot for a selected point in time by only manipulating the metadata object and without copying or moving data included in the objects;
restoring a production volume by:
scanning the metadata object to determine relevant metadata included in the metadata object;
creating a metadata volume from a blank metadata volume by writing relevant metadata from the metadata object corresponding to the new snapshot to populate the blank metadata volume, the metadata including identifiers, wherein each identifier points to data in the objects; and
while creating the metadata volume, hydrating the production volume using the metadata volume and the objects, wherein the production volume corresponds to the selected point in time.
11. The non-transitory computer readable medium of claim 10 , further comprising converting the metadata object with a snapshot of the object and appending the relevant portion of the metadata object into the snapshot of the object.
12. The non-transitory computer readable medium of claim 11 , wherein the snapshot of the object comprises a b+tree and wherein the new snapshot comprises a b+tree.
13. The non-transitory computer readable medium of claim 12 , wherein the storage system comprises a VSAN.
14. The non-transitory computer readable medium of claim 13 , further comprising appending the relevant portion of the metadata object to internal nodes of the b+tree.
15. The non-transitory computer readable medium of claim 10 , wherein all IOs for the object pass through the owner.
16. The non-transitory computer readable medium of claim 10 , further comprising exposing the object based on the new snapshot.
17. The non-transitory computer readable medium of claim 10 , further comprising rebalancing the new snapshot after all of the relevant portion of the metadata objects has been appended to the snapshot of the object.
18. The non-transitory computer readable medium of claim 10 , further comprising generating the new snapshot in hindsight.