IP Library Granted Patent US 10,521,317
Granted Patent B1
US 10,521,317 · App. 15/794,613 · Granted Dec 31, 2019

Compressing data to be replicated utilizing a compression method selected based on network behavior

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,521,317
App. No.
15/794,613
Granted
Dec 31, 2019
Kind
B1
Abstract

An apparatus comprises a first storage system comprising a plurality of storage devices. The first storage system is configured to participate in a replication process with a second storage system. The first storage system is further configured to identify data to be replicated to the second storage system as part of the replication process, to obtain information characterizing network behavior of at least one network connecting the first storage system to the second storage system, to select a compression method from a set of available compression methods based on the obtained information characterizing the network behavior of said at least one network, to compress the data to be replicated to the second storage system utilizing the selected compression method, and to provide the compressed data to the second storage system.

Claims (60)

1. An apparatus comprising:

a first storage system comprising a plurality of storage devices;

the first storage system being configured to participate in a replication process with a second storage system;

the first storage system being further configured:

to identify data to be replicated to the second storage system as part of the replication process;

to obtain information characterizing network behavior of at least one network connecting the first storage system to the second storage system;

to select a compression method from a set of available compression methods based on the obtained information characterizing the network behavior of said at least one network;

to compress the data to be replicated to the second storage system utilizing the selected compression method; and

to provide the compressed data to the second storage system;

wherein obtaining the information characterizing the network behavior of said at least one network comprises determining a given rank from a hierarchy of ranks, the given rank characterizing at least one of a specified compression rate and a specified compression ratio to utilize for compressing the data to be replicated to the second storage system; and

wherein selecting the compression method from the set of available compression methods comprises performing a table look-up in at least one logic table to select a given compression method having at least one of a given compression rate and a given compression ratio corresponding to at least one of the specified compression rate and the specified compression ratio of the given rank.

2. The apparatus of claim 1 wherein the first and second storage systems are associated with respective source and target sites of the replication process and wherein the source site comprises a production site data center and the target site comprises a disaster recovery site data center.

3. The apparatus of claim 1 wherein obtaining the information characterizing the network behavior of said at least one network comprises monitoring a plurality of network metrics of said at least one network.

4. The apparatus of claim 3 wherein the plurality of network metrics are compared with a plurality of network metric thresholds to determine, for at least one of the plurality of network metrics, the given rank from a hierarchy of ranks.

5. The apparatus of claim 4 wherein the plurality of network metrics comprise:

a round trip time (RTT) network metric characterizing a time required for a signal pulse or packet to travel from the first storage system to the second storage system and back again over said at least one network;

a re-transmissions and packet loss network metric characterizing a number of packet re-transmissions required to continue traffic on said at least one network; and

a congestion window size network metric characterizing outstanding outbound data from the first storage system for transmission over said at least one network.

6. The apparatus of claim 5 wherein the given rank comprises a highest rank of the hierarchy of ranks having a highest compression ratio when at least one of:

the re-transmission and packet loss network metric indicates that the number of packet-retransmissions exceeds a specified retransmissions threshold; and

the RTT metric indicates that the RTT exceeds a specified RTT threshold.

7. The apparatus of claim 5 wherein the given rank comprises a lowest rank of the hierarchy of ranks having a highest compression rate when a current network throughput on said at least one network is less than available bandwidth on said at least one network, the current network throughput being determined based on the congestion window size network metric.

8. The method of claim 5 wherein the given rank comprises one of a successive number of ranks of the hierarchy of ranks associated with successive increased compression rates as the RTT network metric indicates that the RTT exceeds corresponding successive specified RTT thresholds.

9. The apparatus of claim 1 wherein the entries of the at least one logic table are ordered by at least one of compression rate and compression ratio of the available compression methods.

10. The apparatus of claim 1 wherein the entries of the at least one logic table are ordered to correspond to the hierarchy of ranks.

11. The apparatus of claim 1 wherein the set of available compression methods comprise two or more compression methods utilizing different compression algorithms.

12. The apparatus of claim 1 wherein the set of available compression methods comprise:

a first compression method utilizing a given compression algorithm with a first set of configuration parameters; and

at least a second compression method utilizing the given compression algorithm with a second set of configuration parameters.

13. The apparatus of claim 1 wherein compressing the data to be replicated to the second storage system utilizing the selected compression method comprises appending a compression header to the compressed data, the compression header identifying the selected compression method.

14. A method comprising:

configuring a first storage system comprising a plurality of storage devices to participate in a replication process with a second storage system; and

as part of the replication process, the first storage system:

identifying data to be replicated to the second storage system as part of the replication process;

obtaining information characterizing network behavior of at least one network connecting the first storage system to the second storage system;

selecting a compression method from a set of available compression methods based on the obtained information characterizing the network behavior of said at least one network;

compressing the data to be replicated to the second storage system utilizing the selected compression method; and

providing the compressed data to the second storage system;

wherein obtaining the information characterizing the network behavior of said at least one network comprises determining a given rank from a hierarchy of ranks, the given rank characterizing at least one of a specified compression rate and a specified compression ratio to utilize for compressing the data to be replicated to the second storage system;

wherein selecting the compression method from the set of available compression methods comprises performing a table look-up in at least one logic table to select a given compression method having at least one of a given compression rate and a given compression ratio corresponding to at least one of the specified compression rate and the specified compression ratio of the given rank; and

wherein the method is implemented by at least one processing device of the first storage system.

15. The method of claim 14 wherein:

obtaining the information characterizing the network behavior of said at least one network comprises monitoring a plurality of network metrics of said at least one network; and

the plurality of network metrics are compared with a plurality of network metric thresholds to determine the given rank from a hierarchy of ranks.

16. The method of claim 14 wherein the entries of the at least one logic table being are ordered by at least one of compression rate and compression ratio of the available compression methods.

17. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device of a first storage system comprising a plurality of storage devices causes the first storage system:

configuring a first storage system comprising a plurality of storage devices to participate in a replication process with a second storage system; and

as part of the replication process, the first storage system:

identifying data to be replicated to the second storage system as part of the replication process;

obtaining information characterizing network behavior of at least one network connecting the first storage system to the second storage system;

selecting a compression method from a set of available compression methods based on the obtained information characterizing the network behavior of said at least one network;

compressing the data to be replicated to the second storage system utilizing the selected compression method; and

providing the compressed data to the second storage system;

wherein obtaining the information characterizing the network behavior of said at least one network comprises determining a given rank from a hierarchy of ranks, the given rank characterizing at least one of a specified compression rate and a specified compression ratio to utilize for compressing the data to be replicated to the second storage system; and

wherein selecting the compression method from the set of available compression methods comprises performing a table look-up in at least one logic table to select a given compression method having at least one of a given compression rate and a given compression ratio corresponding to at least one of the specified compression rate and the specified compression ratio of the given rank.

18. The computer program product of claim 17 wherein:

obtaining the information characterizing the network behavior of said at least one network comprises monitoring a plurality of network metrics of said at least one network; and

the plurality of network metrics are compared with a plurality of network metric thresholds to determine the given rank from a hierarchy of ranks.

19. The computer program product of claim 17 wherein the entries of the at least one logic table are ordered by at least one of compression rate and compression ratio of the available compression methods.

20. The computer program product of claim 17 wherein the entries of the at least one logic table are ordered to correspond to the hierarchy of ranks.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (053546/0001) Recorded Jun 23, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL MARKETING L.P. (ON BEHALF OF ITSELF AND AS SUCCESSOR-IN-INTEREST TO CREDANT TECHNOLOGIES, INC.); DELL INTERNATIONAL L.L.C.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO FORCE10 NETWORKS, INC. AND WYSE TECHNOLOGY L.L.C.); EMC IP HOLDING COMPANY LLC
Reel/Frame 071642/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (044535/0109) Recorded May 20, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; DELL MARKETING CORPORATION (SUCCESSOR-IN-INTEREST TO WYSE TECHNOLOGY L.L.C.)
Reel/Frame 060753/0414 →
RELEASE OF SECURITY INTEREST AT REEL 044535 FRAME 0001 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
Reel/Frame 058298/0475 →
SECURITY AGREEMENT Recorded Apr 22, 2020
From: CREDANT TECHNOLOGIES INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 053546/0001 →
SECURITY AGREEMENT Recorded Mar 21, 2019
From: CREDANT TECHNOLOGIES, INC.; DELL INTERNATIONAL L.L.C.; DELL MARKETING L.P.; DELL PRODUCTS L.P.; DELL USA L.P.; EMC CORPORATION; FORCE10 NETWORKS, INC.; WYSE TECHNOLOGY L.L.C.; EMC IP HOLDING COMPANY LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 049452/0223 →
PATENT SECURITY AGREEMENT (NOTES) Recorded Nov 29, 2017
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 044535/0109 →
PATENT SECURITY AGREEMENT (CREDIT) Recorded Nov 29, 2017
From: DELL PRODUCTS L.P.; EMC CORPORATION; EMC IP HOLDING COMPANY LLC; WYSE TECHNOLOGY L.L.C.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH, AS COLLATERAL AGENT
Reel/Frame 044535/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2017
From: IPPATAPU, VENKATA L.R.; DORMAN, KENNETH
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 043960/0470 →