Incremental copy performance between data stores
View Patent ↗Systems and methods are disclosed for copying a data object to a target storage pool using a hybrid of storage pools, in which at least one of the storage pools is particularly efficient at identifying data that should be used for copying the data object to the target storage pool, and at least one of the storage pools is particularly efficient at retrieving the data that should be sent to the target storage pool. The system comprises a performance storage pool for storing data and having relatively high performance for retrieving stored data; a deduplicating storage pool for storing deduplicated data and storing metadata about data objects in the system and which has relatively high performance for identifying and specifying differences in a data object over time; and a controller for causing the performance storage pool to retrieve differences and provide the data to the target storage pool.
1. A computing device for copying a data object to a target storage pool using a plurality of storage pools, wherein at least one of the storage pools is particularly efficient at identifying data that should be used for copying the data object to the target storage pool, and at least one of the storage pools is particularly efficient at retrieving the data that should be sent to the target storage pool, the computing device comprising:
a performance storage pool comprising one or more storage devices for storing data and having relatively high performance for retrieving stored data;
a deduplicating storage pool comprising one or more storage devices for storing deduplicated data, said deduplicating storage pool further storing metadata about data objects in the computing device and which has relatively high performance for identifying and specifying differences in a data object over time; and
a processor in communication with the performance storage pool and the deduplicating storage pool, and configured to run a module stored in memory configured to cause the processor to:
in response to a command to copy a data object to the target storage pool, cause the deduplicating storage pool to identify and specify differences between a first version of a data object generated at a first instant in time and a second version of said data object generated at a second instant in time;
cause the specification of differences in the data object to be provided to the target storage pool;
cause the performance storage pool to retrieve data specified in the specification of differences that is not already stored at the target storage pool; and
cause the data retrieved by the performance storage pool to be provided to the target storage pool,
thereby synchronizing the target storage pool to have the second version of the data object.
2. The computing device of claim 1 , wherein the deduplicating storage pool is configured to send the specification of differences to the target storage pool.
3. The computing device of claim 1 , wherein the deduplicating storage pool is configured to send instructions to the performance storage pool to retrieve the data specified in the specification of differences not already stored at the target storage pool.
4. The computing device of claim 1 , wherein the performance storage pool is responsive to the deduplicating storage pool and is configured to send data specified in the specification of differences directly to the target storage pool.
5. The computing device of claim 1 , wherein the specification of differences identifies changes in the data object between the second instant in time and the first instant in time, and further specifies where differences include data contents that are already stored at the target.