Cloud-aware snapshot difference determination
Modifications made to files (e.g., stub files) within a distributed file storage system over a defined time period are determined. Moreover, the distributed file storage system employs a tiered cloud storage architecture. In one aspect, snapshots of a stub file can be generated at different instances of time. Further, metadata of the stub file within the different snapshots can be compared to determine whether the stub file has been modified. As an example, the metadata can include cache metadata that describes the content within the cache of the stub file and/or mapping metadata that describes the content within cloud storage that is referenced by the stub file.
1. A system, comprising:
a processor; and
a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising:
determining first snapshot data comprising a first snapshot of a stub file at a first instance in time, wherein the first snapshot data comprises first metadata associated with the stub file that comprises a first data structure that references content stored in a network storage device, and comprises a second data structure associated with a first portion of the content that has been cached within the stub file, wherein the second data structure indicates that a first portion of the content stored in the network storage device has been read or modified;
determining second snapshot data indicative of a second snapshot of the stub file at a second instance in time, wherein the second snapshot data comprises second metadata associated with the stub file that indicates that a second portion of the content has been read or modified; and
in response to determining that the first metadata and the second metadata satisfies a defined criterion, determining that the content has been changed between the first instance in time and the second instance in time.
2. The system of claim 1 , wherein the second metadata comprises a third data structure that references the content and comprises a fourth data structure associated with a second portion of the content that has been cached within the stub file.
3. The system of claim 2 , wherein the determining the first snapshot data is performed in response to receiving a first request for the first portion of the content, and wherein the determining the second snapshot data is performed in response to receiving a second request for the second portion of the content.
4. The system of claim 2 , wherein the second data structure indicates that the first portion of the content has been read or modified, and wherein the fourth data structure indicates that the first portion of the content has been read or modified.
5. The system of claim 2 , wherein the operations further comprise:
in response to determining that the fourth data structure indicates that the second portion of the content has been read and that the first data structure matches the third data structure, determining that the content has not been changed between the first instance and the second instance in time.
6. The system of claim 2 , wherein the determining that the first metadata and the second metadata satisfies the defined criterion comprises determining that the fourth data structure indicates that the second portion of the content has been written to and that the first data structure matches the third data structure.
7. The system of claim 2 , wherein the operations further comprise:
in response to determining that the fourth data structure indicates that the second portion of the content has been written to and that the first data structure does not match the third data structure, determining that the content has not been changed between the first instance and the second instance in time.
8. The system of claim 2 , wherein the determining that the first metadata and the second metadata satisfies the defined criterion comprises determining that the fourth data structure indicates that the second portion of the content has been read and that the first data structure does not match the third data structure.
9. The system of claim 1 , wherein the first metadata further comprises sparseness information describing a sparse region of the network storage device, and wherein the sparse region is a portion of the network storage device that does not store the content.
10. The system of claim 1 , wherein the stub file is stored on a source cluster device and wherein the determining that the content has been changed comprises determining that the content has been changed in response to determining that the stub file is to be synchronized with a replica of the stub file that is stored on a target cluster device.
11. The system of claim 1 , wherein at a third instance in time the stub file is converted to a local file, and wherein the local file comprises the content and is retained within a source cluster device.
12. A method, comprising:
determining, by a system comprising a processor, first snapshot data comprising a first snapshot of a stub file at a first instance in time, wherein the first snapshot data comprises first metadata associated with the stub file that comprises a first mapping data structure that references content stored in a network storage device, and comprises a first cache data structure associated with a first portion of the content that has been cached within the stub file, wherein the first data structure indicates that a first portion of the content stored in the network storage device has been read or modified;
determining, by the system, second snapshot data indicative of a second snapshot of the stub file at a second instance in time, wherein the second snapshot data comprises second metadata associated with the stub file that indicates that a second portion of the content has been read or modified; and
in response to determining that the first metadata and the second metadata satisfies a defined criterion, determining, by the system, that the content has been changed between the first instance in time and the second instance in time.
13. The method of claim 12 , further comprising:
in response to determining that a second cache data structure of the second metadata indicates that the content has been modified and that the first mapping data structure and a second mapping data structure of the second metadata do not match, determining, by the system, that the content has not been altered between the first instance in time and the second instance in time.
14. The method of claim 12 , further comprising:
in response to determining that the first cache data structure of the first metadata indicates that the content has been modified and that the first mapping data structure of the first metadata and a second mapping data structure of the second metadata match, determining, by the system, that the content has been altered between the first instance in time and the second instance in time.
15. The method of claim 12 , wherein the determining that the first metadata and the second metadata satisfies a defined criterion comprises:
in response to determining that the first cache data structure indicates that the portion of the content has been read and that the first mapping data structure and a second mapping data structure of the second metadata match, determining, by the system, that the content has not been altered between the different instances in time.
16. The method of claim 12 , further comprising:
receiving, by the system, query data indicative of a query for determining a difference in the first snapshot and the second snapshot.
17. The method of claim 15 , wherein the stub file is retained within a source cluster device and the method further comprises:
in response to determining a difference between the first snapshot and the second snapshot, synchronizing, by the system, the stub file with a replica of the stub file that is retained within a target cluster device.
18. A non-transitory computer-readable storage medium comprising instructions that, in response to execution, cause a device comprising a processor to perform operations, comprising:
determining first snapshot data comprising a first snapshot of a stub file at a first instance in time, wherein the first snapshot data comprises first metadata associated with the stub file that comprises a first mapping data structure that references content stored in a network storage device, and comprises a first cache data structure associated with a first portion of the content that has been cached within the stub file, wherein the first cache data structure indicates that a first portion of the content stored in the network storage device has been read or modified;
determining second snapshot data indicative of a second snapshot of the stub file at a second instance in time, wherein the second snapshot data comprises second metadata associated with the stub file that indicates that a second portion of the content has been read or modified; and
in response to determining that the first metadata and the second metadata satisfies a defined criterion, determining that the content has been changed between the first instance in time and the second instance in time.
19. The non-transitory computer-readable storage medium of claim 18 , wherein the operations further comprise:
in response to determining that a second cache data structure of the second metadata indicates that the content has been modified and that the first mapping data structure and a second mapping data structure of the second metadata do not match, verifying that the content has not been altered between the first instance in time and the second instance in time.
20. The non-transitory computer-readable storage medium of claim 18 , wherein operations further comprise:
in response to determining that the first cache data structure indicates that the content has been modified and that the first mapping data structure and a second mapping data structure of the second metadata match, verifying that the content has been altered between the first instance in time and the second instance in time.