Systems and methods to confirm replication data accuracy for data backup in data storage systems
View Patent ↗A data storage system, according to certain aspects, automatically determines the accuracy of replication data when performing data backup operations. For instance, the system performs data backup using replication data rather than source data to reduce the processing load on the source system. The backup data is then associated with the source data as if the backup had been performed on the source data. If the replication system fails, then backing up replication data results in backup data that does not accurately reflect the source data. The system automatically determines the accuracy of replication data during data backup.
1. A method of performing data backup in a data storage system, the method comprising:
receiving instructions to back up source data stored in one or more primary storage devices associated with a client computing device, the source data being primary data generated by at least one software application executing on the client computing device and stored in a native format of the at least one software application;
replicating the source data to one or more replication storage devices different than the one or more primary storage devices to generate replication data, the replication data stored in the native format of the at least one software application, wherein the source data and the replication data are substantially synchronized with respect to one another;
based on a stored storage policy associated with the client computing device, initiating a backup operation in which a point in time backup copy of the primary data is to be created on one or more secondary storage devices different than the one or more primary storage devices and the one or more replication storage devices;
automatically determining with one or more processors whether the replication data stored in the one or more replication storage devices is an accurate replication of the source data;
automatically copying with one or more processors the replication data to the one or more secondary storage devices to create the point in time backup copy when the replication data is accurate;
consulting the stored storage policy to determine whether the stored storage policy permits back up from the source data when the replication data is inaccurate;
automatically copying with one or more processors the source data to the one or more secondary storage devices to create the point in time backup copy when the replication data is inaccurate and the stored storage policy permits back up from the source data, the point in time backup copy stored in a backup format different than the native format for the at least one software application; and
associating the point in time backup copy with the source data.
2. The method of claim 1 wherein determining whether the replication data is accurate comprises comparing one or more entries in a replication log with one or more corresponding entries in a source log.
3. The method of claim 2 wherein the replication data is accurate when the one or more entries in the replication log and the one or more corresponding entries in the source log are the same.
4. The method of claim 2 wherein the comparing is performed by a replication agent.
5. The method of claim 2 wherein the comparing is performed by a storage manager.
6. The method of claim 1 wherein determining whether the replication data is accurate comprises comparing at least a portion of the source data with at least a corresponding portion of the replication data.
7. The method of claim 6 wherein the replication data is accurate when the at least a portion of the source data and the at least a corresponding portion of the replication data are the same.
8. The method of claim 6 wherein the comparing is performed by a replication agent.
9. The method of claim 6 wherein the comparing is performed by a storage manager.
10. The method of claim 1 wherein determining whether the replication data is accurate comprises determining whether a replication operation was successful based at least in part on a length of time to process source log to replication log transactions.
11. The method of claim 10 wherein the replication data is accurate when the length of time is less than a processing time limit.
12. The method of claim 10 wherein a replication agent queries a storage manager whether the replication operation was successful.
13. The method of claim 10 wherein the storage manager determines whether the replication operation was successful.
14. A system to create secondary copies of data associated with user computing devices, the system comprising:
computer hardware including one or more computer processors; and
computer-readable storage comprising computer-readable instructions that, when executed by the one or more processors, cause the computer hardware to perform operations defined by the computer-readable instructions, the computer-readable instructions configured to:
receive instructions to back up source data stored in one or more primary storage devices associated with a client computing device, the source data being primary data generated by at least one software application executing on the client computing device and stored in a native format of the at least one software application;
replicate the source data to one or more replication storage devices different than the one or more primary storage devices to generate replication data, the replication data stored in the native format of the at least one software application, wherein the source data and the replication data are substantially synchronized with respect to one another;
based on a stored storage policy associated with the client computing device, initiate a backup operation in which a point in time backup copy of the primary data is to be created on one or more secondary storage devices different than the one or more primary storage devices and the one or more replication storage devices;
automatically determine whether the replication data stored in the one or more replication storage devices is an accurate replication of the source data;
copy the replication data to one or more secondary storage devices to create the point in time backup copy when the replication data is accurate;
consult the stored storage policy to determine whether the stored storage policy permits back up from the source data when the replication data is inaccurate;
automatically copy the source data to the one or more secondary storage devices to create the point in time backup copy when the replication data is inaccurate and the stored storage policy permits back up from the source data, the point in time backup copy stored in a backup format different than the native format for the at least one software application; and
associate the point in time backup copy with the source data.
15. The system of claim 14 wherein determining whether the replication data is accurate comprises comparing one or more entries in a replication log with one or more corresponding entries in a source log.
16. The system of claim 15 wherein the replication data is accurate when the one or more entries in the replication log and the one or more corresponding entries in the source log are the same.
17. The system of claim 14 wherein determining whether the replication data is accurate comprises comparing at least a portion of the source data with at least a corresponding portion of the replication data.
18. The system of claim 17 wherein the replication data is accurate when the at least a portion of the source data and the at least a corresponding portion of the replication data are the same.
19. The system of claim 14 wherein determining whether the replication data is comprises determining whether a replication operation was successful based at least in part on a length of time to process source log to replication log transactions.
20. The system of claim 19 wherein the replication data is accurate when the length of time is less than a processing time limit.