Block-level data replication
Certain embodiments described herein relate to an improved block-level replication system. One or more components in an information management system may receive a request to perform a block-level replication between a source storage device and a destination storage device, and depending on the specific replication mode requested, (i) store block-level changes directly to the destination storage device or (ii) first to a recovery point store and then later to the destination storage device.
1. A method of performing block-level data replication in dehydration mode, the method comprising:
determining that a threshold condition for performing replication of data stored on a source storage device onto a destination storage device in dehydration mode is satisfied;
adding a first dehydrated entry to a queue for storing entries corresponding to data modifications performed on the source storage device, wherein the first dehydrated entry is associated with metadata associated with a first write operation performed on a client computing device associated with the source storage device;
identifying, based at least in part on the metadata associated with the first dehydrated entry, a location of data corresponding to the first dehydrated entry on the source storage device;
determining that the data corresponding to the first dehydrated entry has not changed since the addition of the first dehydrated entry to the queue;
causing the data corresponding to the first dehydrated entry to be written to the destination storage device;
adding a second dehydrated entry to the queue, wherein the second dehydrated entry is associated with metadata associated with a second write operation performed on the client computing device;
identifying, based at least in part on the metadata associated with the second dehydrated entry, a location of data corresponding to the second dehydrated entry on the source storage device;
determining that the data corresponding to the second dehydrated entry has changed since the addition of the second dehydrated entry to the queue; and
refraining from causing the data corresponding to the second dehydrated entry to be written to the destination storage device.
2. The method of claim 1 , wherein the first or second dehydrated entry added to the queue does not include a copy of at least some of the data corresponding to the first or second dehydrated entry, respectively.
3. The method of claim 1 , wherein the metadata associated with the first or second dehydrated entry is only a portion of all metadata associated with the first or second dehydrated entry, respectively.
4. The method of claim 1 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a level of input/output (I/O) activity on the client computing device exceeding a threshold level.
5. The method of claim 1 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a performance indicator associated with a network between the source storage device and the destination storage device being below a threshold level.
6. The method of claim 1 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a performance value associated with a recovery point store associated with the source storage device being below a threshold level.
7. The method of claim 1 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a rate at which recovery points are written to a recovery point store associated with the source storage device being slower than a rate at which entries are added to the queue.
8. The method of claim 1 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a cache associated with the queue being full or having reached a threshold capacity level.
9. A networked information management system configured to perform block-level data replication in dehydration mode, the networked information management system comprising:
a source storage device configured to store primary data;
a destination storage device configured to store copies of the primary data; and
a storage computing device comprising physical hardware and configured to:
determine that a threshold condition for performing replication of data stored on the source storage device onto the destination storage device in dehydration mode is satisfied;
add a first dehydrated entry to a queue for storing entries corresponding to data modifications performed on the source storage device, wherein the first dehydrated entry is associated with metadata associated with a first write operation performed on a client computing device associated with the source storage device;
identify, based at least in part on the metadata associated with the first dehydrated entry, a location of data corresponding to the first dehydrated entry on the source storage device;
determine that the data corresponding to the first dehydrated entry has not changed since the addition of the first dehydrated entry to the queue;
cause the data corresponding to the first dehydrated entry to be written to the destination storage device;
add a second dehydrated entry to the queue, wherein the second dehydrated entry is associated with metadata associated with a second write operation performed on the client computing device;
identify, based at least in part on the metadata associated with the second dehydrated entry, a location of data corresponding to the second dehydrated entry on the source storage device;
determine that the data corresponding to the second dehydrated entry has changed since the addition of the second dehydrated entry to the queue; and
refrain from causing the data corresponding to the second dehydrated entry to be written to the destination storage device.
10. The networked information management system of claim 9 , wherein the first or second dehydrated entry added to the queue does not include a copy of at least some of the data corresponding to the first or second dehydrated entry respectively.
11. The networked information management system of claim 9 , wherein the metadata associated with the first or second dehydrated entry is only a portion of all metadata associated with the first or second dehydrated entry, respectively.
12. The networked information management system of claim 9 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a level of input/output (I/O) activity on the client computing device exceeding a threshold level.
13. The networked information management system of claim 9 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a performance indicator associated with a network between the source storage device and the destination storage device being below a threshold level.
14. The networked information management system of claim 9 , wherein the determination that the threshold condition for performing data replication in dehydration mode is satisfied is made based on a cache associated with the queue being full or having reached a threshold capacity level.
15. A non-transitory computer-readable medium storing instructions, that, when executed by at least one computing device comprising one or more processors and computer memory, cause the at least one computing device to perform operations comprising:
determining that a threshold condition for performing replication of data stored on a source storage device onto a destination storage device in dehydration mode is satisfied;
adding a first dehydrated entry to a queue for storing entries corresponding to data modifications performed on the source storage device, wherein the first dehydrated entry is associated with metadata associated with a first write operation performed on a client computing device associated with the source storage device;
identifying, based at least in part on the metadata associated with the first dehydrated entry, a location of data corresponding to the first dehydrated entry on the source storage device;
determining that the data corresponding to the first dehydrated entry has not changed since the addition of the first dehydrated entry to the queue;
causing the data corresponding to the first dehydrated entry to be written to the destination storage device;
adding a second dehydrated entry to the queue, wherein the second dehydrated entry is associated with metadata associated with a second write operation performed on the client computing device;
identifying, based at least in part on the metadata associated with the second dehydrated entry, a location of data corresponding to the second dehydrated entry on the source storage device;
determining that the data corresponding to the second dehydrated entry has changed since the addition of the second dehydrated entry to the queue; and
refraining from causing the data corresponding to the second dehydrated entry to be written to the destination storage device.
16. The non-transitory computer-readable medium of claim 15 , wherein the first or second dehydrated entry added to the queue does not include a copy of at least some of the data corresponding to the first or second dehydrated entry respectively.
17. The non-transitory computer-readable medium of claim 15 , wherein the metadata associated with the first or second dehydrated entry is only a portion of all metadata associated with the first or second dehydrated entry, respectively.