Granted Patent B2

US 10,025,528 · App. 15/411,476 · Granted Jul 17, 2018

Abstract

Claims (57)

1. A method for transforming snapshots, the method comprising:

storing, in a storage system, a plurality of source snapshots, wherein each source snapshot shares data blocks with one or more other source snapshots;

receiving one or more transform scripts for transforming data of a source snapshot, each transform script comprising a sequence of transform operations;

executing the one or more transform scripts, the executing comprising, for each transform script, storing one or more intermediate snapshots, each intermediate snapshot stored after applying one or more transform operations of the transform script to a previously stored intermediate snapshot;

receiving a new transform script for executing using the source snapshot, the new transform script comprising a new sequence of transform operations;

identifying a previously executed transform script, the previously executed transform script with a sequence of transform operations having a prefix matching with the new sequence;

identifying an intermediate snapshot saved after executing the matching prefix of the identified transform script; and

executing transform operations of the new transform script occurring after the matching prefix using the intermediate snapshot as input to obtain a result of execution of the second transform script.

2. The method of claim 1 , wherein identifying the previously executed transform script comprises, selecting a transform script that was modified to obtain the new transform script.

3. The method of claim 2 , further comprising:

associating each transform script with a version, wherein identifying the previously executed transform script comprises, selecting a transform script having a version occurring before the version of the new transform script.

4. The method of claim 1 , wherein identifying the previously executed transform script comprises:

determining for each of the one or more previously executed transform script, whether the previously executed transform script has a prefix of sequence of transform operations that matches a prefix of sequence of transform operations of the new transform script.

5. The method of claim 4 , further comprising:

responsive to determining that a plurality of previously executed transform script match the new transform script, selecting a previously executed transform script having the longest matching prefix.

6. The method of claim 1 , wherein executing a transform script comprises:

determining a metric value indicative of an amount of processing performed since a previous intermediate snapshot was saved; and

determining whether to save another intermediate snapshot responsive to the metric value exceeding a threshold value.

7. The method of claim 1 , wherein the snapshot stores a plurality of database blocks and the transform script comprises one or more database commands, wherein executing a transform script comprises:

creating a virtual database comprising a file structure pointing at database blocks of the snapshot; and

executing the one or more database commands of the transform script against the virtual database.

8. The method of claim 1 , wherein the source snapshot stores data configured to be executed by a first version of an application and the transform script modifies the data of the source snapshot such that the modified data is configured to be executed by a second version of the application.

9. The method of claim 8 , wherein the application is a database system.

10. The method of claim 1 , wherein the source snapshot stores data configured to be executed by a first application offered by a first vendor and the transform script modifies the data of the source snapshot such that the modified data is configured to be executed by a second application offered by a second vendor.

11. A non-transitory computer-readable storage medium storing instructions for:

storing, in a storage system, a plurality of source snapshots, wherein each source snapshot shares data blocks with one or more other source snapshots;

receiving one or more transform scripts for transforming data of an input source snapshot, each transform script comprising a sequence of transform operations;

executing the one or more transform scripts, the executing comprising, for each transform script, storing one or more intermediate snapshots, each intermediate snapshot stored after applying one or more transform operations of the transform script to a previously stored intermediate snapshot;

receiving a new transform script for executing using the source snapshot, the new transform script comprising a new sequence of transform operations;

identifying a previously executed transform script, the previously executed transform script with a sequence of transform operations having a prefix matching with the new sequence;

identifying an intermediate snapshot saved after executing the matching prefix of the identified transform script; and

executing the transform operations of the new transform script occurring after the matching prefix using the intermediate snapshot as input to obtain a result of execution of the second transform script.

12. The non-transitory computer-readable storage medium of claim 11 , wherein identifying the previously executed transform script comprises, selecting a transform script that was modified to obtain the new transform script.

13. The non-transitory computer-readable storage medium of claim 12 , further comprising:

associating each transform script with a version, wherein identifying the previously executed transform script comprises, selecting a transform script having a version occurring before the version of the new transform script.

14. The non-transitory computer-readable storage medium of claim 11 , wherein identifying the previously executed transform script comprises:

determining for each of the one or more previously executed transform script, whether the previously executed transform script has a prefix of sequence of transform operations that matches a corresponding prefix of sequence of transform operations of the new transform script.

15. The non-transitory computer-readable storage medium of claim 14 , further comprising:

responsive to determining that a plurality of previously executed transform script match the new transform script, selecting a previously executed transform script having the longest matching prefix.

16. The non-transitory computer-readable storage medium of claim 11 , wherein executing a transform script comprises:

determining a metric value indicative of an amount of processing performed since a previous intermediate snapshot was saved; and

determining whether to save another intermediate snapshot responsive to the metric value exceeding a threshold value.

17. The non-transitory computer-readable storage medium of claim 11 , wherein the snapshot stores a plurality of database blocks and the transform script comprises one or more database commands, wherein executing a transform script comprises:

creating a virtual database comprising a file structure pointing at database blocks of the snapshot; and

executing the one or more database commands of the transform script against the virtual database.

18. The non-transitory computer-readable storage medium of claim 11 , wherein the source snapshot stores data configured to be executed by a first version of an application and the transform script modifies the data of the source snapshot such that the modified data is configured to be executed by a second version of the application.

19. The non-transitory computer-readable storage medium of claim 11 , wherein the source snapshot stores data configured to be executed by a first application offered by a first vendor and the transform script modifies the data of the source snapshot such that the modified data is configured to be executed by a second application offered by a second vendor.

20. A computer system, comprising:

an electronic processor; and

a non-transitory computer-readable storage medium storing instructions for:

storing, in a storage system, a plurality of source snapshots, wherein each source snapshot shares data blocks with one or more other source snapshots;

receiving one or more transform scripts for transforming data of an input source snapshot, each transform script comprising a sequence of transform operations;

executing the one or more transform scripts, the executing comprising, for each transform script, storing one or more intermediate snapshots, each intermediate snapshot stored after applying one or more transform operations of the transform script to a previously stored intermediate snapshot;

receiving a new transform script for executing using the source snapshot, the new transform script comprising a new sequence of transform operations;

identifying a previously executed transform script, the previously executed transform script with a sequence of transform operations having a prefix matching with the new sequence;

identifying an intermediate snapshot saved after executing the matching prefix of the identified transform script; and

executing the transform operations of the new transform script occurring after the matching prefix using the intermediate snapshot as input to obtain a result of execution of the second transform script.

Assignments (16)

Cited By (2)

US 12,423,277 US 12,443,577