Storage system and data processing method using data compression
A storage system includes an interface and a data compression system configured to compress reception data from the interface before the data is stored in a storage device. The data compression system is configured to compress the reception data using a first compression algorithm to generate first compressed data, use the number of appearances of each of predetermined code categories included in the first compressed data to estimate a decompression time when a second compression algorithm is used, select a second compression method including compression using the second compression algorithm when the decompression time is equal to or less than a threshold value, and select a first compression method that does not include the compression using the second compression algorithm when the decompression time is greater than the threshold value.
1. A storage system comprising:
an interface; and
a data compression system configured to compress reception data from the interface before the data is stored in a storage device, wherein
the data compression system is configured to
compress the reception data using a first compression algorithm to generate first compressed data,
use the number of appearances of each of predetermined code categories included in the first compressed data to estimate a decompression time when a second compression algorithm is used,
select a second compression method including compression using the second compression algorithm when the decompression time is equal to or less than a threshold value, and
select a first compression method that does not include the compression using the second compression algorithm when the decompression time is greater than the threshold value.
2. The storage system according to claim 1 , wherein
the data compression system is configured to
hold information on a decompression processing time of each of the code categories, and
estimate the decompression time based on a product-sum of the decompression processing time and the number of appearances of the code categories.
3. The storage system according to claim 1 , wherein
the first compression algorithm is a dictionary compression algorithm.
4. The storage system according to claim 3 , wherein
the code categories include different code categories indicating copy codes having different matching lengths and/or distances.
5. The storage system according to claim 1 , wherein
the second compression algorithm is an entropy coding algorithm or a Huffman coding algorithm.
6. The storage system according to claim 1 , wherein
in the first compression method, the first compressed data is output.
7. The storage system according to claim 1 , wherein
the second compression method includes generation of the first compressed data using the first compression algorithm and compression of the first compressed data using the second compression algorithm.
8. The storage system according to claim 7 , wherein
when the decompression time is greater than the threshold value, the compression using the second compression algorithm is omitted.
9. The storage system according to claim 1 , wherein
in the first compression method, the reception data is compressed using a third compression algorithm different from the first compression algorithm and the second compression algorithm.
10. The storage system according to claim 1 , further comprising:
a data decompression system, wherein
the data compression system is configured to estimate the decompression time using a predetermined function having a predetermined parameter, and
the data decompression system is configured to
decompress the data compressed using the second compression method to restore the reception data,
measure a decompression time of the data compressed using the second compression algorithm in the restoration of the reception data, and
correct the predetermined parameter based on the measured decompression time.
11. A data processing method in a storage system, comprising:
acquiring reception data from outside;
compressing the reception data using a first compression algorithm to generate first compressed data;
using the number of appearances of each of predetermined code categories included in the first compressed data to estimate a decompression time when a second compression algorithm is used;
selecting a second compression method including compression using the second compression algorithm when the decompression time is equal to or less than a threshold value; and
selecting a first compression method that does not include the compression using the second compression algorithm when the decompression time is greater than the threshold value.