Methods and systems for eventually-complete backups
Disclosed are techniques that provide for eventually-complete backups, and restoration thereof. For example, such methods, computer program products, and computer systems can include initiating a backup operation (where the backup operation is configured back up a dataset), detecting termination of the backup operation, detecting termination of the backup operation, and determining whether the backup operation backed up the dataset completely. In response to a determination that the backup operation did not backup the dataset completely, generating an indication that the backup is not complete. In response to a determination that the backup operation did not backup the dataset completely, generating an indication that the backup is complete.
1. A method comprising:
initiating a backup operation, wherein
the backup operation is one of a plurality of backup operations of a backup,
the backup comprises a plurality of partial backups,
the plurality of backup operations are configured to back up a dataset,
the dataset comprises a plurality of data chunks, and
the backup operation produces a partial backup of the plurality of partial backups;
selecting a selected data chunk of the plurality of data chunks;
determining whether the selected data chunk was backed up in a previous partial backup of the plurality of partial backups;
in response to a determination that the selected data chunk was not backed up in a previous partial backup of the plurality of partial backups,
storing a backup image of data of the selected data chunk in the partial backup;
in response to a determination that the selected data chunk was backed up in a previous partial backup of the plurality of partial backups,
determining whether data of the selected data chunk has been modified since the previous partial backup was created, and
in response to a determination that the data of the selected data chunk was modified since the previous partial backup was created,
storing the backup image of the data of the selected data chunk in the partial backup;
detecting termination of the backup operation;
determining whether the backup operation backed up the dataset completely;
in response to a determination that the backup operation did not result in the dataset being backed up completely,
generating an indication that the backup is not complete; and
in response to a determination that the backup operation did result in the dataset being backed up completely,
generating an indication that the backup is complete.
2. The method of claim 1 , wherein the method further comprises:
in response to the indication that the backup is not complete, storing progress information, wherein
the progress information indicates data of the dataset that has been backed up.
3. The method of claim 1 , wherein
the determining whether the selected data chunk was backed up in the previous partial backup of the plurality of partial backups comprises
determining whether the previous partial backup comprises
the backup image of the data of the selected data chunk, or
a reference to a backup image of the data of the selected data chunk in another previous partial backup of the plurality of partial backups.
4. The method of claim 3 , wherein
upon the dataset being backed up completely, the backup comprises the plurality of partial backups.
5. The method of claim 3 , wherein
the partial backup comprises a backup image of at least one data chunk of the plurality of data chunks.
6. The method of claim 5 , wherein
the partial backup further comprises one or more references to backup images of at least one other data chunk in the another previous partial backup.
7. The method of claim 6 , wherein
the selected data chunk is one of a new data chunk or an existing data chunk.
8. The method of claim 1 , wherein
the termination is a result of an end of a backup window.
9. The method of claim 1 , further comprising:
retrieving progress information; and
causing the backup operation to be initiated at a point in the dataset indicated by the progress information.
10. A non-transitory computer-readable storage medium, comprising program instructions, which, when executed by one or more processors of a computing system, perform a method comprising:
initiating a backup operation, wherein
the backup operation is one of a plurality of backup operations of a backup,
the backup comprises a plurality of partial backups,
the plurality of backup operations are configured to back up a dataset,
the dataset comprises a plurality of data chunks, and
the backup operation produces a partial backup of the plurality of partial backups;
selecting a selected data chunk of the plurality of data chunks;
determining whether the selected data chunk was backed up in a previous partial backup of the plurality of partial backups;
in response to a determination that the selected data chunk was not backed up in a previous partial backup of the plurality of partial backups,
storing a backup image of data of the selected data chunk in the partial backup;
in response to a determination that the selected data chunk was backed up in a previous partial backup of the plurality of partial backups,
determining whether data of the selected data chunk has been modified since the previous partial backup was created, and
in response to a determination that the data of the selected data chunk was modified since the previous partial backup was created,
storing the backup image of the data of the selected data chunk in the partial backup;
detecting termination of the backup operation;
determining whether the backup operation backed up the dataset completely;
in response to a determination that the backup operation did not result in the dataset being backed up completely,
generating an indication that the backup is not complete; and
in response to a determination that the backup operation did result in the dataset being backed up completely,
generating an indication that the backup is complete.
11. The non-transitory computer-readable storage medium of claim 10 , wherein and the method further comprises:
in response to the indication that the backup is not complete, storing progress information, wherein
the progress information indicates data of the dataset that has been backed up.
12. The non-transitory computer-readable storage medium of claim 10 , wherein
the determining whether the selected data chunk was backed up in the previous partial backup of the plurality of partial backups comprises
determining whether the previous partial backup comprises
the backup image of the data of the selected data chunk, or
a reference to a backup image of the data of the selected data chunk in another previous partial backup of the plurality of partial backups,
upon the dataset being backed up completely, the backup comprises the plurality of partial backups.
13. The non-transitory computer-readable storage medium of claim 12 , wherein
the partial backup comprises a backup image of at least one data chunk of the plurality of data chunks.
14. The non-transitory computer-readable storage medium of claim 13 , wherein
the partial backup further comprises one or more references to backup images of at least one other data chunk in the another previous partial backup.
15. The non-transitory computer-readable storage medium of claim 10 , wherein the termination is a result of an end of a backup window.
16. The non-transitory computer-readable storage medium of claim 12 , the method further comprising:
retrieving progress information; and
causing the backup operation to be initiated at a point in the dataset indicated by the progress information.
17. A computing system comprising:
one or more processors; and
a computer-readable storage medium coupled to the one or more processors, comprising program instructions, which, when executed by the one or more processors, perform a method comprising
initiating a backup operation, wherein
the backup operation is one of a plurality of backup operations of a backup,
the backup comprises a plurality of partial backups,
the plurality of backup operations are configured to back up a dataset,
the dataset comprises a plurality of data chunks, and
the backup operation produces a partial backup of the plurality of partial backups,
selecting a selected data chunk of the plurality of data chunks,
determining whether the selected data chunk was backed up in a previous partial backup of the plurality of partial backups,
in response to a determination that the selected data chunk was not backed up in a previous partial backup of the plurality of partial backups,
storing a backup image of data of the selected data chunk in the partial backup,
in response to a determination that the selected data chunk was backed up in a previous partial backup of the plurality of partial backups,
determining whether data of the selected data chunk has been modified since the previous partial backup was created, and
in response to a determination that the data of the selected data chunk was modified since the previous partial backup was created,
storing the backup image of the data of the selected data chunk in the partial backup,
detecting termination of the backup operation,
determining whether the backup operation backed up the dataset completely,
in response to a determination that the backup operation did not result in the dataset being backed up completely,
generating an indication that the backup is not complete, and
in response to a determination that the backup operation did result in the dataset being backed up completely,
generating an indication that the backup is complete.
18. The computing system of claim 17 , wherein the method further comprises:
in response to the indication that the backup is not complete, storing progress information, wherein
the progress information indicates data of the dataset that has been backed up.
19. The computing system of claim 17 , wherein
the determining whether the selected data chunk was backed up in the previous partial backup of the plurality of partial backups comprises
determining whether the previous partial backup comprises
the backup image of the data of the selected data chunk, or
a reference to a backup image of the data of the selected data chunk in another previous partial backup of the plurality of partial backups, and
the partial backup comprises
a backup image of at least one data chunk of the plurality of data chunks, and
one or more references to backup images of at least one other data chunk in the another previous partial backup, and
the selected data chunk is one of a new data chunk or an existing data chunk.
20. The computing system of claim 17 , wherein the method further comprises:
retrieving progress information; and
causing the backup operation to be initiated at a point in the dataset indicated by the progress information.