Dataset image creation
An application may store data to a dataset comprising a plurality of volumes stored on a plurality of storage systems. The application may request a dataset image of the dataset, the dataset image comprising a volume image of each volume of the dataset. A dataset image manager operates with a plurality of volume image managers in parallel to produce the dataset image, each volume image manager executing on a storage system. The plurality of volume image managers respond by performing requested operations and sending responses to the dataset image manager in parallel. Each volume image manager on a storage system may manage and produce a volume image for each volume of the dataset stored to the storage system. If a volume image for any volume of the dataset fails, or a timeout period expires, a cleanup procedure is performed to delete any successful volume images.
1. A method executed by one or more processors, comprising:
generating a data structure associated with an operation identifier identifying an operation for producing a dataset image of a dataset having a plurality of volumes, wherein the data structure is populated with a header including the operational identifier, a start time for producing the dataset image, and a dataset timeout period for producing the dataset image, and wherein the data structure includes a plurality of grouping entries that each represent a grouping of one or more of the plurality of volumes stored on a single storage system;
in response to suspending input/output (I/O) operations associated with each of the volumes of the plurality of volumes and initiating production of volume images for each of the volumes of the plurality of volumes, updating the data structure to indicate that each of the plurality of volumes have been suspended and that volume image production has been initiated;
in response to receiving a volume-commit request for a selected volume of the plurality of volumes and upon determining that a volume image for the selected volume was successfully created, updating the data structure indicating a success status for the volume image of the selected volume; and
determining that production of the dataset image of the dataset is successful from status information of the data structure indicating that each of the volume images of the plurality of volumes has been successfully produced.
2. The method of claim 1 , further comprising:
suspending the I/O operations in response to a volume-start request that includes the operation identifier.
3. The method of claim 1 , further comprising:
aborting a timeout period upon successful volume image production for the plurality of volumes, the timeout period indicates a duration for successfully executing volume image production for the plurality of volumes.
4. The method of claim 3 , further comprising:
unsuspending the I/O operations, upon aborting the timeout period.
5. The method of claim 1 , further comprising:
deleting successfully generated volume images when the status information indicates unsuccessful volume image production for one of the plurality of volumes.
6. The method of claim 1 , further comprising:
reporting failure of the volume commit request, in response to unsuccessful volume image production for one of the plurality of volumes.
7. The method of claim 6 , further comprising:
indicating the operation identifier in reporting the failure.
8. A non-transitory machine readable medium having instructions stored thereon, the non-transitory machine readable medium comprising instructions for:
generate a data structure associated with an operation identifier identifying an operation for producing a dataset image of a dataset having a plurality of volumes, wherein the data structure is populated with a header including the operational identifier, a start time for producing the dataset image, and a dataset timeout period for producing the dataset image, and wherein the data structure includes a plurality of grouping entries that each represent a grouping of one or more of the plurality of volumes stored on a single storage system;
in response to suspending input/output (I/O) operations associated with each of the volumes of the plurality of volumes and initiating production of volume images for each of the volumes of the plurality of volumes, update the data structure to indicate that each of the plurality of volumes have been suspended and that volume image production has been initiated;
in response to receiving a volume-commit request for a selected volume of the plurality of volumes and upon determining that a volume image for the selected volume was successfully created, update the data structure indicating a success status for the volume image of the selected volume; and
determine that production of the dataset image of the dataset is successful from status information of the data structure indicating that each of the volume images of the plurality of volumes has have been successfully produced.
9. The non-transitory machine readable medium of claim 8 , wherein the instructions cause the machine to:
suspend the I/O operations in response to a volume-start request that includes the operation identifier.
10. The non-transitory machine readable medium of claim 8 , wherein the instructions cause the machine to:
abort a timeout period upon successful volume image production for the plurality of volumes, the timeout period indicates a duration for successfully executing volume image production for the plurality of volumes.
11. The non-transitory machine readable medium of claim 10 , wherein the instructions cause the machine to:
unsuspend the I/O operations, upon aborting the timeout period.
12. The non-transitory machine readable medium of claim 8 , wherein the instructions cause the machine to:
delete successfully generated volume images when the status information indicates unsuccessful volume image production for one of the plurality of volumes.
13. The non-transitory machine readable medium of claim 8 , wherein the instructions cause the machine to:
report failure of the volume commit request, in response to unsuccessful volume image production for one of the plurality of volumes.
14. The non-transitory machine readable medium of claim 13 , wherein the instructions cause the machine to:
indicate the operation identifier in reporting the failure.
15. A computing device comprising:
a memory comprising instructions; and
a processor coupled to the memory, the processor configured to execute the instructions to cause the processor to:
generate a data structure associated with an operation identifier identifying an operation for producing a dataset image of a dataset having a plurality of volumes, wherein the data structure is populated with a header including the operational identifier, a start time for producing the dataset image, and a dataset timeout period for producing the dataset image, and wherein the data structure includes a plurality of grouping entries that each represent a grouping of one or more of the plurality of volumes stored on a single storage system;
in response to suspending input/output (I/O) operations associated with each of the volumes of the plurality of volumes and initiating production of volume images for each of the volumes of the plurality of volumes, update the data structure to indicate that each of the plurality of volumes have been suspended and that volume image production has been initiated;
in response to receiving a volume-commit request for a selected volume of the plurality of volumes and upon determining that a volume image for the selected volume was successfully created, update the data structure indicating a success status for the volume image of the selected volume; and
determine that production of the dataset image of the dataset is successful from status information of the data structure indicating that each of the volume images of the plurality of volumes has been successfully produced.
16. The computing device of claim 15 , wherein the instructions cause the processor to:
suspend the I/O operations in response to a volume-start request that includes the operation identifier.
17. The computing device of claim 15 , wherein the instructions cause the processor to:
abort a timeout period upon successful volume image production for the plurality of volumes, the timeout period indicates a duration for successfully executing volume image production for the plurality of volumes.
18. The computing device of claim 17 , wherein the instructions cause the processor to:
unsuspend the I/O operations, upon aborting the timeout period.
19. The computing device of claim 15 , wherein the instructions cause the processor to:
delete successfully generated volume images when the status information indicates unsuccessful volume image production for one of the plurality of volumes.
20. The computing device of claim 15 , wherein the instructions cause the processor to:
report failure of the volume commit request, in response to unsuccessful volume image production for one of the plurality of volumes.