Adaptive computing for data compression
Intelligently compressing data in a storage array that includes a plurality of storage devices, including: prioritizing, in dependence upon an expected benefit to be gained from compressing each data element, one or more data elements; receiving an amount of processing resources available for compressing the one or more of the data elements; and selecting, in dependence upon the prioritization of the one or more data elements and the amount of processing resources available for compressing one or more of the data elements, a data compression algorithm to utilize on one or more of the data elements.
1. A method of adaptive computing for data compression, the method comprising:
ranking portions of data in dependence upon an expected amount of time to uncompress each respective portion of data including determining the expected amount of time to uncompress each respective portion of data based on historical performance of at least one data compression algorithm;
selecting, in dependence upon the ranking of the portions of data in dependence upon the expected amount of time to uncompress each respective portion of data and upon an amount of processing resources available for compressing the portions of data, one or more portions of data and a data compression algorithm; and
compressing, in accordance with the selected data compression algorithm, the selected one or more portions of data to better utilize the amount of processing resources compared to a lower ranked portion of data.
2. The method of claim 1 , wherein ranking the portions of data is further dependent upon an expected benefit to the amount of storage to be gained from data compression, and wherein the method further comprises determining, for each of the portions of data, an amount of time that the portion of data is expected to remain stored, wherein the expected benefit is determined in dependence upon the amount of time that the data element is expected to remain stored.
3. The method of claim 2 , further comprising determining, for each of the portions of data, an expected compression ratio to be achieved by compressing the portion of data, wherein the expected benefit is determined in dependence upon the expected compression ratio to be achieved by compressing the portion of data.
4. The method of claim 1 further comprising determining, for one or more compression algorithms, an amount of processing resources required to compress one or more of the portions of data utilizing the compression algorithm.
5. A storage system controller for adaptive computing for data compression, the storage system controller including a computer processor and a computer memory, the computer memory including computer program instructions that, when executed, cause the storage system controller to carry out the steps of:
ranking portions of data in dependence upon an expected amount of time to uncompress each respective portion of data including determining the expected amount of time to uncompress each respective portion of data based on historical performance of at least one data compression algorithm;
selecting, in dependence upon the ranking of the portions of data in dependence upon the expected amount of time to uncompress each respective portion of data and upon an amount of processing resources available for compressing the plurality of data elements, one or more portions of data and a data compression algorithm; and
compressing, in accordance with the selected data compression algorithm, the selected one or more portions of data to better utilize the amount of processing resources compared to a lower ranked portion of data.
6. The storage system controller of claim 5 , wherein ranking the portions of data is further dependent upon an expected benefit to the amount of storage to be gained from data compression, and further comprising computer program instructions that, when executed, cause the storage system controller to carry out the step of determining, for each of the portions of data, an amount of time that the portion of data is expected to remain stored in storage system, wherein the expected benefit is determined in dependence upon the amount of time that the portion of data is expected to remain stored in the storage system.
7. The storage system controller of claim 6 , further comprising computer program instructions that, when executed, cause the storage system controller to carry out the step of determining, for each of the portions of data, an expected compression ratio to be achieved by compressing the portion of data, wherein the expected benefit is determined in dependence upon the expected compression ratio to be achieved by compressing the portion of data.
8. The storage system controller of claim 6 , further comprising computer program instructions that, when executed, cause the storage system controller to carry out the step of determining, for one or more compression algorithms, an amount of processing resources required to compress one or more of the portions of data utilizing the compression algorithm.
9. A computer program product for adaptive computing for data compression, the computer program product disposed on a computer readable storage medium, the computer program product comprising computer program instructions that, when executed, cause an apparatus to carry out the steps of:
ranking portions of data in dependence upon an expected amount of time to uncompress each respective portion of data including determining the expected amount of time to uncompress each respective portion of data based on historical performance of at least one data compression algorithm;
selecting, in dependence upon the ranking of the portions of data in dependence upon the expected amount of time to uncompress each respective portion of data and upon an amount of processing resources available for compressing the portions of data, one or more portions of data and a data compression algorithm; and
compressing, in accordance with the selected data compression algorithm, the selected one or more portions of data to better utilize the amount of processing resources compared to a lower ranked portion of data.
10. The computer program product of claim 9 , wherein ranking the portions of data is further dependent upon an expected benefit to the amount of storage to be gained from data compression, and further comprising computer program instructions that, when executed, cause the apparatus to carry out the step of determining, for each of the portions of data, an amount of time that the portion of data is expected to remain stored in the storage array, wherein the expected benefit is determined in dependence upon the amount of time that the portion of data is expected to remain stored in the storage array.
11. The computer program product of claim 10 , further comprising computer program instructions that, when executed, cause the apparatus to carry out the step of determining, for each of the portions of data, an expected compression ratio to be achieved by compressing the portion of data, wherein the expected benefit is determined in dependence upon the expected compression ratio to be achieved by compressing the portion of data.
12. The computer program product of claim 9 further comprising computer program instructions that, when executed, cause the apparatus to carry out the step of determining, for one or more compression algorithms, an amount of processing resources required to compress one or more of the portions of data utilizing the compression algorithm.