Deferred adaptive compression using computational storage for energy savings
Provided are a method, system, and computer program product for performing deferred adaptive compression via a computational storage. On a drive that is initially empty, all data is written as uncompressed. In response to a first threshold level of storage space utilization being reached on the drive, compression of existing data on the drive is initiated. In response to a second threshold level of storage space utilization being reached on the drive, operations are performed for compressing incoming data and then writing the compressed incoming data to the drive, wherein the second threshold level is higher than the first threshold level.
1 . A method for performing deferred adaptive compression via a computational storage, the method comprising:
on a drive that is initially empty, writing all data as uncompressed;
in response to a first threshold level of storage space utilization being reached on the drive, initiating compression of existing data on the drive; and
in response to a second threshold level of storage space utilization being reached on the drive, compressing incoming data, and then writing the compressed incoming data to the drive, wherein the second threshold level is higher than the first threshold level, wherein delay is introduced while responding for variability avoidance in response time while compression or decompression is not being performed in the computational storage, wherein an amount of delay that is introduced is based on pre-measured compression latencies for generic data, and wherein delay is not introduced while responding while compression or decompression is being performed in the computational storage.
2 . The method of claim 1 , the method further comprising:
in response to the storage space utilization falling below a third threshold level of space utilization that is lower than the first threshold level of space utilization, stopping compression of data on the drive.
3 . The method of claim 2 , the method further comprising:
monitoring the drive by the computational storage to reduce computational needs by performing compression only when necessary.
4 . The method of claim 1 , wherein energy savings are generated via the deferred adaptive compression in the computational storage.
5 . The method of claim 1 , wherein if the first threshold level is reached, compressing existing data using access metrics, and compressing via a background process when the drive is not busy.
6 . The method of claim 1 , wherein variability avoidance in indicating free space is performed by indicating an amount of free space available on the drive by calculating the amount of free space if all the data on the drive were to be compressed, even though all the data on the drive is not actually compressed.
7 . A system comprising:
a memory; and
a processor coupled to the memory, wherein the processor performs operations, the operations comprising:
on a drive that is initially empty, writing all data as uncompressed;
in response to a first threshold level of storage space utilization being reached on the drive, initiating compression of existing data on the drive; and
in response to a second threshold level of storage space utilization being reached on the drive, compressing incoming data, and then writing the compressed incoming data to the drive, wherein the second threshold level is higher than the first threshold level, wherein delay is introduced while responding for variability avoidance in response time while compression or decompression is not being performed in a computational storage, wherein an amount of delay that is introduced is based on pre-measured compression latencies for generic data, and wherein delay is not introduced while responding while compression or decompression is being performed in the computational storage.
8 . The system of claim 7 , the operations further comprising:
in response to the storage space utilization falling below a third threshold level of space utilization that is lower than the first threshold level of space utilization, stopping compression of data on the drive.
9 . The system of claim 8 , the operations further comprising:
monitoring the drive by the computational storage to reduce computational needs by performing compression only when necessary.
10 . The system of claim 7 , wherein energy savings are generated via deferred adaptive compression in the computational storage.
11 . The system of claim 7 , wherein if the first threshold level is reached, compressing existing data using access metrics, and compressing via a background process when the drive is not busy.
12 . The system of claim 7 , wherein variability avoidance in indicating free space is performed by indicating an amount of free space available on the drive by calculating the amount of free space if all the data on the drive were to be compressed, even though all the data on the drive is not actually compressed.
13 . A computer program product for performing deferred adaptive compression via a computational storage, the computer program product comprising:
one or more computer readable storage media; and
program instructions stored on the one or more computer readable storage media to perform operations comprising:
on a drive that is initially empty, writing all data as uncompressed;
in response to a first threshold level of storage space utilization being reached on the drive, initiating compression of existing data on the drive; and
in response to a second threshold level of storage space utilization being reached on the drive, compressing incoming data, and then writing the compressed incoming data to the drive, wherein the second threshold level is higher than the first threshold level, wherein delay is introduced while responding for variability avoidance in response time while compression or decompression is not being performed in the computational storage, wherein an amount of delay that is introduced is based on pre-measured compression latencies for generic data, and wherein delay is not introduced while responding while compression or decompression is being performed in the computational storage.
14 . The computer program product of claim 13 , the operations further comprising:
in response to the storage space utilization falling below a third threshold level of space utilization that is lower than the first threshold level of space utilization, stopping compression of data on the drive.
15 . The computer program product of claim 14 , the operations further comprising:
monitoring the drive by the computational storage to reduce computational needs by performing compression only when necessary.
16 . The computer program product of claim 13 , wherein energy savings are generated via the deferred adaptive compression in the computational storage.
17 . The computer program product of claim 13 , wherein if the first threshold level is reached, compressing existing data using access metrics, and compressing via a background process when the drive is not busy.
18 . The computer program product of claim 13 , wherein variability avoidance in indicating free space is performed by indicating an amount of free space available on the drive by calculating the amount of free space if all the data on the drive were to be compressed, even though all the data on the drive is not actually compressed.