Hybrid data reduction

1. An information handling system comprising:

at least one processor; and

a memory coupled to the at least one processor;

wherein the information handling system is configured to:

receive data comprising a plurality of data chunks;

perform deduplication on the plurality of data chunks to produce a plurality of unique data chunks;

determine a compression ratio for respective pairs of the unique data chunks;

determine a weighted graph based on the unique data chunks, wherein the weighted graph includes nodes consisting of the unique data chunks and further includes weighted edges between respective pairs of unique data chunks that are based on the compression ratio for that pair of unique data chunks, and wherein weights of the weighted edges are determined based on a monotonic function such that larger compression ratios correspond to smaller weights;

determine a desired compression order for the plurality of unique data chunks based on the weighted graph;

combine the plurality of unique data chunks in the desired compression order; and

perform data compression on the combined plurality of unique data chunks.

2. The information handling system of claim 1 , wherein the compression ratio is determined for every pair of unique data chunks.

3. The information handling system of claim 1 , wherein the compression ratio for the respective pairs of the unique data chunks is determined by concatenating each pair of unique data chunks and performing a test compression of the concatenated pair.

4. The information handling system of claim 1 , wherein the weights are determined such that each weight is a reciprocal of the corresponding compression ratio.

5. The information handling system of claim 4 , further configured to:

determine a minimum spanning tree for the weighted graph; and

determine the desired compression order based on the minimum spanning tree.

6. The information handling system of claim 4 , further configured to:

determine a shortest Hamiltonian path for the weighted graph; and

determine the desired compression order based on the shortest Hamiltonian path.

7. A method comprising:

receiving, at an information handling system, data comprising a plurality of data chunks;

the information handling system performing deduplication on the plurality of data chunks to produce a plurality of unique data chunks;

the information handling system determining a compression ratio for respective pairs of the unique data chunks;

the information handling system determining a weighted graph based on the unique data chunks, wherein the weighted graph includes nodes consisting of the unique data chunks and further includes weighted edges between respective pairs of unique data chunks that are based on the compression ratio for that pair of unique data chunks, and wherein weights of the weighted edges are determined based on a monotonic function such that larger compression ratios correspond to smaller weights;

the information handling system determining a desired compression order for the plurality of unique data chunks based on the weighted graph;

the information handling system combining the plurality of unique data chunks in the desired compression order; and

the information handling system performing data compression on the combined plurality of unique data chunks.

8. The method of claim 7 , wherein the data compression has a particular compression algorithm associated therewith, and the method further comprises dividing the data into the plurality of data chunks based on a sliding window size of the particular compression algorithm.

9. The method of claim 8 , further comprising receiving a user selection of the sliding window size.

10. The method of claim 7 , further comprising:

the information handling system determining the desired compression order based on an approximation of a shortest or longest Hamiltonian path of the weighted graph.

11. An article of manufacture comprising a non-transitory, computer-readable medium having computer-executable code thereon that is executable by a processor of an information handling system for:

receiving data comprising a plurality of data chunks;

performing deduplication on the plurality of data chunks to produce a plurality of unique data chunks;

determining a compression ratio for respective pairs of the unique data chunks;

determine a weighted graph based on the unique data chunks, wherein the weighted graph includes nodes consisting of the unique data chunks and further includes weighted edges between respective pairs of unique data chunks that are based on the compression ratio for that pair of unique data chunks, and wherein weights of the weighted edges are determined based on a monotonic function such that larger compression ratios correspond to smaller weights;

determining a desired compression order for the plurality of unique data chunks based on the weighted graph;

combining the plurality of unique data chunks in the desired compression order; and

performing data compression on the combined plurality of unique data chunks.

12. The article of claim 11 , wherein the compression ratio is determined for every pair of unique data chunks.

13. The article of claim 11 , wherein the compression ratio for the respective pairs of the unique data chunks is determined by concatenating each pair of unique data chunks and performing a test compression of the concatenated pair.

14. The article of claim 11 , wherein the weights are determined such that each weight is a reciprocal of the corresponding compression ratio.

15. The article of claim 14 , wherein the computer-executable code is further for:

determining a minimum spanning tree for the weighted graph; and

determining the desired compression order based on the minimum spanning tree.

16. The article of claim 14 , wherein the computer-executable code is further for:

determining a shortest Hamiltonian path for the weighted graph; and

determining the desired compression order based on the shortest Hamiltonian path.