Data replication system
View Patent ↗Systems and methods are provided for an asynchronous data replication system in which the remote replication reduces bandwidth requirements by copying deduplicated differences in business data from a local storage site to a remote, backup storage site, the system comprising: a local performance storage pool for storing data; a local deduplicating storage pool for storing deduplicated data, said local deduplicating storage pool further storing metadata about data objects in the system and which has metadata analysis logic for identifying and specifying differences in a data object over time; a remote performance storage pool for storing a copy of said data, available for immediate use as a backup copy of said data to provide business continuity to said data; a remote deduplicating storage pool for storing deduplicated data; and a controller for synchronizing the remote performance storage pool to have the second version of the data object using deduplicated data.
1. An asynchronous data replication system for providing a remote copy of data, in which remote replication is provided with reduced bandwidth requirements by copying deduplicated differences in business data from a local storage site to a remote, backup storage site, the system comprising:
a local performance storage pool for storing data;
a local deduplicating storage pool for storing deduplicated data, said local deduplicating storage pool further storing metadata about data objects in the system and which has metadata analysis logic for identifying and specifying differences in a data object over time;
a remote performance storage pool for storing a copy of said data, available for immediate use as a backup copy of said data to provide business continuity to said data;
a remote deduplicating storage pool for storing deduplicated data, said remote deduplicating storage pool being in communication with said local deduplicating storage pool and with said remote performance storage pool; and
a controller for, in response to a remote replication command, causing the local deduplicating storage pool to identify and specify differences between a first version of a data object at a first instant in time and a second version of said data object at a second instant in time, for causing the specification of differences in the data object to be provided to the remote deduplicating storage pool, for causing the local performance storage pool to retrieve any data specified in the differences specification that is not already stored at the remote deduplicating storage pool, for causing the data retrieved by the local performance storage pool to be provided to the remote deduplicating storage pool, and for causing the remote deduplicating storage pool to provide a synchronized copy of said data to said remote performance storage pool;
thereby synchronizing the remote performance storage pool to have the second version of the data object.
2. The system of claim 1 , wherein the remote performance storage pool is kept available for providing prompt access to the data object within a finite length of time, the length of time being independent of the size of the data and also of the latency of the data link between the local site and the remote site.
3. The system of claim 1 , wherein the controller is configured to provide one of synchronized, iterative, and pipelined replication.
4. The system of claim 1 , wherein the controller is configured to transfer operational control of the business data to the remote site, thereby providing failover capability.
5. The system of claim 1 , wherein the controller is configured to cause the remote performance storage pool to transfer data back to the local performance storage pool via the remote deduplicating storage pool and the local deduplicating storage pool, thereby providing sync-back capability.
6. The system of claim 1 , wherein the local deduplicating storage pool and the remote deduplicating storage pool are each configured to create an organized arrangement of hash structures, wherein each structure, for a subset of the hash structures, includes a hash signature for a corresponding content segment and is associated with a reference to the corresponding content segment, wherein the logical organization of the arrangement represents the logical organization of the content segments as they are represented within the data object.
7. The system of claim 1 , further comprising the local deduplicating storage pool being configured to identify and specify differences between a first version of a data object at a first instant in time and a second version of said data object at a second instant in time, and for causing the specification of differences in the data object to be provided to the remote deduplicating storage pool, and further comprising the local performance storage pool configured to retrieve any data specified in the differences specification that is not already stored at the remote deduplicating storage pool.
8. The system of claim 1 , wherein the controller is configured to cause a partial data fingerprint to be generated using a fingerprinting function at the local deduplicating storage pool, to cause the partial data fingerprint to be received at the remote deduplicating storage pool, and to cause the partial data fingerprint to be compared with an independently-generated fingerprint generated from the data object at the remote deduplicating storage pool, the independently-generated fingerprint reflecting byte regions sparsely sampled from throughout the data object and thereby efficiently providing an indication of the contents of the data object, so that comparing data fingerprints for two data objects can determine if the data objects are different without requiring hashing of all bytes in the two compared data objects.