Reducing stable data eviction with synthetic baseline snapshot and eviction state refresh
With a forever incremental snapshot configuration and a typical caching policy (e.g., least recently used), a storage appliance may evict stable data blocks of an older snapshot, perhaps unchanged data blocks of the snapshot baseline. If stable data blocks have been evicted, restore of a recent snapshot will suffer the time penalty of downloading the stable blocks for restoring the recent snapshot. Creating synthetic baseline snapshots and refreshing eviction data of stable data blocks can avoid eviction of stable data blocks and reduce the risk of violating a recovery time objective.
1 . A method comprising:
creating snapshot metadata records for one or more snapshots;
determining whether a threshold for creating a synthetic baseline snapshot is satisfied;
in response to the threshold being satisfied, iterating over prior snapshots of the one or more snapshots that precede a received snapshot back to a baseline snapshot to retrieve snapshot metadata records of the received snapshot and the prior snapshots; and
creating the synthetic baseline snapshot based upon the snapshot metadata records of the received snapshot and the prior snapshots.
2 . The method of claim 1 , wherein the creating snapshot metadata records further comprises:
creating inode records, directory records, and data map records as the snapshot metadata records.
3 . The method of claim 1 , comprising:
configuring the threshold to achieve a balance between synthetic baseline snapshot creation frequency and managing a cache to avoid eviction of stable data.
4 . The method of claim 1 , comprising:
configuring the threshold based upon a number of snapshots and an amount of cache consumed by using a snapshot change rate.
5 . The method of claim 4 , comprising:
dynamically recalculating the snapshot change rate.
6 . The method of claim 1 , comprising:
walking local snapshot identifiers associated with a data collection corresponding to the received snapshot.
7 . The method of claim 1 , comprising:
in response to creating the synthetic baseline snapshot, updating parent-child relationship metadata for the prior snapshots to indicate that the synthetic baseline snapshot is a parent snapshot for subsequent incremental snapshots.
8 . The method of claim 1 , comprising:
maintaining parent-child relationships between incremental snapshots and a baseline snapshot; and
adding metadata to indicate that the synthetic baseline snapshot is a synthetic parent for subsequent incremental snapshots.
9 . The method of claim 1 , comprising:
utilizing the snapshot metadata records of the received snapshot and the prior snapshots and refresh of eviction state data to reduce stable data eviction from a cache.
10 . A non-transitory machine readable medium comprising instructions for performing a method, which when executed by a machine, causes the machine to perform operations comprising:
creating snapshot metadata records for one or more snapshots;
determining whether a threshold for creating a synthetic baseline snapshot is satisfied;
in response to the threshold being satisfied, iterating over prior snapshots of the one or more snapshots that precede a received snapshot back to a baseline snapshot to retrieve snapshot metadata records of the received snapshot and the prior snapshots; and
creating the synthetic baseline snapshot based upon the snapshot metadata records of the received snapshot and the prior snapshots.
11 . The non-transitory machine readable medium of claim 10 , wherein the operations comprise:
creating inode records, directory records, and data map records as the snapshot metadata records.
12 . The non-transitory machine readable medium of claim 10 , wherein the operations comprise:
configuring the threshold to achieve a balance between synthetic baseline snapshot creation frequency and managing a cache to avoid eviction of stable data.
13 . The non-transitory machine readable medium of claim 10 , wherein the operations comprise:
configuring the threshold based upon a number of snapshots and an amount of cache consumed by using a snapshot change rate.
14 . The non-transitory machine readable medium of claim 13 , wherein the operations comprise:
dynamically recalculating the snapshot change rate.
15 . The non-transitory machine readable medium of claim 10 , wherein the operations comprise:
walking local snapshot identifiers associated with a data collection corresponding to the received snapshot.
16 . The non-transitory machine readable medium of claim 10 , wherein the operations comprise:
in response to creating the synthetic baseline snapshot, updating parent-child relationship metadata for the prior snapshots to indicate that the synthetic baseline snapshot is a parent snapshot for subsequent incremental snapshots.
17 . A computing device comprising:
a memory comprising machine executable code for performing a method; and
a processor coupled to the memory, the processor configured to execute the machine executable code to cause the processor to perform operations comprising:
creating snapshot metadata records for one or more snapshots;
determining whether a threshold for creating a synthetic baseline snapshot is satisfied;
in response to the threshold being satisfied, iterating over prior snapshots of the one or more snapshots that precede a received snapshot back to a baseline snapshot to retrieve snapshot metadata records of the received snapshot and the prior snapshots; and
creating the synthetic baseline snapshot based upon the snapshot metadata records of the received snapshot and the prior snapshots.
18 . The computing device of claim 17 , wherein the machine executable code to causes the processor to perform operations comprising:
in response to creating the synthetic baseline snapshot, updating parent-child relationship metadata for the prior snapshots to indicate that the synthetic baseline snapshot is a parent snapshot for subsequent incremental snapshots.
19 . The computing device of claim 17 , wherein the machine executable code to causes the processor to perform operations comprising:
walking local snapshot identifiers associated with a data collection corresponding to the received snapshot.
20 . The computing device of claim 17 , wherein the machine executable code to causes the processor to perform operations comprising:
configuring the threshold based upon a number of snapshots and an amount of cache consumed by using a snapshot change rate.