IP Library Granted Patent US 11,137,929
Granted Patent B2
US 11,137,929 · App. 16/448,681 · Granted Oct 5, 2021

Storage system configured to support cascade replication

Inventors: Xiangping Chen (Sherborn, MA); Aharon Blitzer (Shoham, IL)
Assignee: EMC IP Holding Company LLC
G06F3/065G06F3/067G06F3/0617G06F3/0665G06F11/1448
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,137,929
App. No.
16/448,681
Granted
Oct 5, 2021
Kind
B2
Abstract

An apparatus is configured to initiate a first replication session to replicate data of a first consistency group in a first storage system to a second consistency group in a second storage system, to create an additional consistency group linked to the second consistency group in the second storage system, and to initiate a second replication session to replicate data of the additional consistency group to another consistency group in a third storage system. The additional consistency group linked to the second consistency group in some embodiments is periodically updated against the second consistency group. For example, in one or more embodiments the second consistency group is updated based at least in part on an active snapshot set of the first replication session, and the additional consistency group is updated based at least in part on the second consistency group.

Claims (71)

1. An apparatus comprising:

at least one processing device comprising a processor coupled to a memory;

said at least one processing device being configured:

to initiate a first replication session to replicate data of a first consistency group in a first storage system to a second consistency group in a second storage system;

to create an additional consistency group linked to the second consistency group in the second storage system;

to initiate a second replication session to replicate data of the additional consistency group to another consistency group in a third storage system;

to update the second consistency group based at least in part on an active snapshot set of the first replication session;

to update the additional consistency group based at least in part on the second consistency group; and

to replicate data of the additional consistency group to the other consistency group in the third storage system;

wherein replicating data of the additional consistency group to the other consistency group in the third storage system comprises:

generating a current snapshot set for the additional consistency group;

scheduling a differential scan of the current snapshot set relative to a previous snapshot set generated for the additional consistency group; and

performing the scheduled differential scan in a particular manner that is determined based at least in part on node ancestor relationships in one or more snapshot trees maintained for the additional consistency group.

2. The apparatus of claim 1 wherein said at least one processing device is implemented at least in part within one or more of the storage systems.

3. The apparatus of claim 2 wherein said at least one processing device comprises a storage controller of at least one of storage systems.

4. The apparatus of claim 1 wherein each of the consistency groups comprises a plurality of logical storage volumes.

5. The apparatus of claim 1 wherein the first replication session comprises one of a synchronous replication session and an asynchronous replication session, and the second replication session comprises an asynchronous replication session.

6. The apparatus of claim 1 wherein updating the additional consistency group based at least in part on the second consistency group comprises periodically updating the additional consistency group against the second consistency group.

7. The apparatus of claim 1 wherein updating the additional consistency group based at least in part on the second consistency group comprises one of:

performing a snap-and-reassign operation for the additional consistency group using the second consistency group; and

refreshing the additional consistency group using the second consistency group.

8. The apparatus of claim 1 wherein replicating data of the additional consistency group to the other consistency group in the third storage system further comprises:

for each of one or more snapshot trees maintained for the additional consistency group:

determining if a first node corresponding to the previous snapshot set is an ancestor of a second node corresponding to the current snapshot set; and

selecting the particular manner in which to perform the scheduled differential scan for the snapshot tree responsive to a result of the determination.

9. The apparatus of claim 8 wherein the scheduled differential scan is performed in a given replication cycle of an asynchronous replication session and further wherein results of performing the scheduled differential scan are transmitted from the second storage system to the third storage system in the given replication cycle.

10. The apparatus of claim 8 wherein determining if a first node corresponding to the previous snapshot set is an ancestor of a second node corresponding to the current snapshot set comprises:

inspecting a path from the second node towards a root node of the snapshot tree;

responsive to the first node being part of the path, determining that the first node is an ancestor of the second node; and

responsive to the first node not being part of the path, determining that the first node is not an ancestor of the second node.

11. The apparatus of claim 8 wherein selecting a particular manner in which to perform the scheduled differential scan for the snapshot tree responsive to a result of the determination comprises:

performing a first type of differential scan comprising aggregating node metadata of a path from the second node to the first node responsive to the first node being an ancestor of the second node; and

performing a second type of differential scan different than the first type of differential scan responsive to the first node not being an ancestor of the second node.

12. The apparatus of claim 1 wherein the at least one processing device is further configured:

to create a further consistency group linked to the other consistency group in the third storage system; and

to initiate a third replication session to replicate data of the further consistency group to another consistency group in a fourth storage system.

13. The apparatus of claim 1 wherein the first and second storage systems are part of a first data center, and the third storage system is part of a second data center remote from the first data center.

14. A method comprising:

initiating a first replication session to replicate data of a first consistency group in a first storage system to a second consistency group in a second storage system;

creating an additional consistency group linked to the second consistency group in the second storage system;

initiating a second replication session to replicate data of the additional consistency group to another consistency group in a third storage system;

updating the second consistency group based at least in part on an active snapshot set of the first replication session;

updating the additional consistency group based at least in part on the second consistency group; and

replicating data of the additional consistency group to the other consistency group in the third storage system;

wherein replicating data of the additional consistency group to the other consistency group in the third storage system comprises:

generating a current snapshot set for the additional consistency group;

scheduling a differential scan of the current snapshot set relative to a previous snapshot set generated for the additional consistency group; and

performing the scheduled differential scan in a particular manner that is determined based at least in part on node ancestor relationships in one or more snapshot trees maintained for the additional consistency group; and

wherein the method is implemented by at least one processing device comprising a processor coupled to a memory.

15. The method of claim 14 wherein updating the additional consistency group based at least in part on the second consistency group comprises periodically updating the additional consistency group against the second consistency group.

16. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes said at least one processing device:

to initiate a first replication session to replicate data of a first consistency group in a first storage system to a second consistency group in a second storage system;

to create an additional consistency group linked to the second consistency group in the second storage system;

to initiate a second replication session to replicate data of the additional consistency group to another consistency group in a third storage system;

to update the second consistency group based at least in part on an active snapshot set of the first replication session;

to update the additional consistency group based at least in part on the second consistency group; and

to replicate data of the additional consistency group to the other consistency group in the third storage system;

wherein replicating data of the additional consistency group to the other consistency group in the third storage system comprises:

generating a current snapshot set for the additional consistency group;

scheduling a differential scan of the current snapshot set relative to a previous snapshot set generated for the additional consistency group; and

performing the scheduled differential scan in a particular manner that is determined based at least in part on node ancestor relationships in one or more snapshot trees maintained for the additional consistency group.

17. The computer program product of claim 16 wherein updating the additional consistency group based at least in part on the second consistency group comprises periodically updating the additional consistency group against the second consistency group.

18. The computer program product of claim 16 wherein replicating data of the additional consistency group to the other consistency group in the third storage system further comprises:

for each of one or more snapshot trees maintained for the additional consistency group:

determining if a first node corresponding to the previous snapshot set is an ancestor of a second node corresponding to the current snapshot set; and

selecting the particular manner in which to perform the scheduled differential scan for the snapshot tree responsive to a result of the determination.

19. The computer program product of claim 18 wherein the scheduled differential scan is performed in a given replication cycle of an asynchronous replication session and further wherein results of performing the scheduled differential scan are transmitted from the second storage system to the third storage system in the given replication cycle.

20. The computer program product of claim 18 wherein determining if a first node corresponding to the previous snapshot set is an ancestor of a second node corresponding to the current snapshot set comprises:

inspecting a path from the second node towards a root node of the snapshot tree;

responsive to the first node being part of the path, determining that the first node is an ancestor of the second node; and

responsive to the first node not being part of the path, determining that the first node is not an ancestor of the second node.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053311/0169) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060438/0742 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (050724/0571) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 060436/0088 →
RELEASE OF SECURITY INTEREST AT REEL 050406 FRAME 421 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
Reel/Frame 058213/0825 →
SECURITY INTEREST Recorded Jun 5, 2020
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 053311/0169 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Oct 15, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 050724/0571 →
SECURITY AGREEMENT Recorded Sep 17, 2019
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 050406/0421 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2019
From: CHEN, XIANGPING; BLITZER, AHARON
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 049551/0989 →