System and Method for Optimizing Data Transfer using Selective Compression
A system and method for optimizing transfer of data using selective compression, the system comprising an analyzer at a source system, the method comprising the steps of the calculating a cost ratio for a transfer of a volume of data, the cost ratio comprising a time to transfer the volume of data with compression, divided by a time to transfer the volume of data without compression, and compressing at the source system, the volume of data, if the cost ratio is less than 1.
1 . A system for optimizing data transfers across a network to a destination system, the system comprising:
a source system; and
an analyzer configured to collect a plurality of metrics from the source system and the network;
the analyzer further configured to calculate a cost ratio for a transfer of a volume of data, via the network to the destination system, the cost ratio comprising a time to transfer the volume of data with compression, divided by a time to transfer the volume of data without compression.
2 . The system of claim 1 , wherein the plurality of metrics are further collected from the destination system.
3 . The system of claim 1 , wherein the plurality of metrics are selected from a group consisting of CPU load, memory usage, hard disk read speed, and network transfer speed.
4 . A method for optimizing data transfers over a network between a source system and a destination system, the method comprising the steps:
a. with an analyzer, collecting a plurality of metrics from the source system and the network;
b. receiving at the source system, a volume of data for transfer to the destination system, the volume of data comprising text files and binary files;
c. with the analyzer, calculating a first transfer cost to transfer the volume of data via the network to the destination system with first compressing the volume of data;
d. with the analyzer, calculating a second transfer cost to transfer the volume of data via the network to the destination system without compressing the volume of data;
e. constantly determining at the source system, a cost ratio, the cost ratio calculated by dividing the first transfer cost by the second transfer cost; and
f. compressing at the source system, the volume of data, if the cost ratio is less than 1.
5 . The method of claim 4 , further comprising the step of routing a compressed volume of data from the source system to the destination system via the network.
6 . The method of claim 4 , wherein step (a) further comprises collecting, at the source system, a plurality of metrics from the destination system.
7 . The method of claim 6 , wherein the first transfer cost further comprises the cost of decompressing a compressed volume of data at the destination system.
8 . The method of claim 4 , wherein the volume of data is split into a plurality of chunks.
9 . The method of claim 8 , wherein the each plurality of chunks is analyzed to determine, at the source system, a chunk cost ratio, wherein the chunk cost ratio is calculated by dividing the first transfer cost by the second transfer cost for the each plurality of chunks.