Method, electronic device and computer program product for processing data
Embodiments of the present disclosure relate to a method, electronic device and computer program product for processing data. The method comprises determining a first hotness associated with a first compressed data block stored on a first storage device. The method also comprises: determining, based on the hotness, whether the first compressed data is stored to the second storage device, a type of the second storage device being different from a type of the first storage device. The method further comprises: in response to determining that the first compressed data block is stored to the second storage device, generating, based on a second compression level of the compression algorithm, a second compressed data block from the first compressed data block for storing to the second storage device, wherein the second compression level corresponds to the second storage device.
1. A method of processing data, comprising:
identifying a first hotness associated with a first compressed data block stored on a first storage device,
wherein the first hotness indicates access frequency of the first compressed data block for a predetermined period of time, and
wherein a first compression level of a compression algorithm for the first compressed data block corresponds to the first storage device;
making a first determination, based on the first hotness, that the first compressed data block is to be stored on a second storage device,
wherein a second type of the second storage device is different than a first type of the first storage device;
generating, based on the first determination, a second compressed data block from the first compressed data block to be stored on to the second storage device;
making a second determination that a sum of a first time length and a second time length exceeds a time threshold,
wherein the first time length is how long the first compressed data block has been stored on the first storage device, and
wherein the second time length is how long the second compressed data block has been stored on the second storage device; and
migrating, based on the second determination, one selected from the group consisting of the first compressed data block and the second compressed data block to a cloud storage device.
2. The method of claim 1 , wherein the first determination comprises:
comparing the first hotness with a first threshold hotness; and
in response to the first hotness being larger than the first threshold hotness, determining that the first compressed data block is to be stored on the second storage device.
3. The method of claim 1 , wherein generating the second compressed data block comprises:
in response to determining that the first compressed data block is to be stored on the second storage device, decompressing the first compressed data block; and
compressing the decompressed first compressed data block using the compression algorithm with a second compression level to generate the second compressed data block,
wherein the second compression level corresponds to the second storage device and a compression degree for the second compression level is higher than a compression degree for the first compression level.
4. The method of claim 1 , further comprising:
determining a second hotness related to the second compressed data block;
comparing the second hotness with a second threshold hotness; and
in response to the second hotness being less than the second threshold hotness:
storing the second compressed data block to the first storage device.
5. The method of claim 3 , further comprising:
receiving, from a user, a source data block to be stored;
generating metadata for the source data block;
compressing the source data block using the compression algorithm with the first compression level to generate the first compressed data block;
compressing the metadata using the compression algorithm with the second compression level to generate a third compressed data block; and
storing the first compressed data block and the third compressed data block, respectively, to the first storage device and the second storage device.
6. An electronic device comprising:
a processor; and
a memory storing computer program instructions, the processor running the computer program instructions in a memory to control the electronic device to perform a method, the method comprising:
identifying a first hotness associated with a first compressed data block stored on a first storage device,
wherein the first hotness indicates access frequency of the first compressed data block for a predetermined period of time, and
wherein a first compression level of a compression algorithm for the first compressed data block corresponds to the first storage device;
making a first determination, based on the first hotness, that the first compressed data block is to be stored on a second storage device,
wherein a second type of the second storage device is different than a first type of the first storage device;
generating, based on the first determination, a second compressed data block from the first compressed data block to be stored on the second storage device;
making a second determination that a sum of a first time length and a second time length exceeds a time threshold,
wherein the first time length is how long the first compressed data block has been stored on the first storage device, and
wherein the second time length is how long the second compressed data block has been stored on the second storage device; and
migrating, based on the second determination, one selected from the group consisting of the first compressed data block and the second compressed data block to a cloud storage device.
7. The electronic device of claim 6 , wherein the first determination comprises:
comparing the first hotness with a first threshold hotness; and
in response to the first hotness being larger than the first threshold hotness, determining that the first compressed data block is to be stored on the second storage device.
8. The electronic device of claim 6 , wherein generating the second compressed data block comprises:
in response to determining that the first compressed data block is to be stored on the second storage device, decompressing the first compressed data block; and
compressing the decompressed first compressed data block using the compression algorithm with a second compression level to generate the second compressed data block,
wherein the second compression level corresponds to the second storage device and a compression degree for the second compression level is higher than a compression degree for the first compression level.
9. The electronic device of claim 6 , wherein the method further comprises:
determining a second hotness related to the second compressed data block;
comparing the second hotness with a second threshold hotness; and
in response to the second hotness being less than the second threshold hotness:
storing the second compressed data block to the first storage device.
10. The electronic device of claim 8 , wherein the method further comprises:
receiving, from a user, a source data block to be stored;
generating metadata for the source data block;
compressing the source data block using the compression algorithm with the first compression level to generate the first compressed data block;
compressing the metadata using the compression algorithm with the second compression level to generate a third compressed data block; and
storing the first compressed data block and the third compressed data block respectively to the first storage device and the second storage device.
11. A computer program product being tangibly stored on a non-volatile computer-readable medium and comprising machine-executable instructions which, when executed, cause a machine to perform a method, the method comprising:
identifying a first hotness associated with a first compressed data block stored on a first storage device,
wherein the first hotness indicates access frequency of the first compressed data block for a predetermined period of time, and
wherein a first compression level of a compression algorithm for the first compressed data block corresponds to the first storage device;
making a first determination, based on the first hotness, that the first compressed data block is to be stored on a second storage device,
wherein a second type of the second storage device is different than a first type of the first storage device;
generating, based on the first determination, a second compressed data block from the first compressed data block to be stored on the second storage device;
making a second determination that a sum of a first time length and a second time length exceeds a time threshold,
wherein the first time length is how long the first compressed data block has been stored on the first storage device, and
wherein the second time length is how long the second compressed data block has been stored on the second storage device; and
migrating, based on the second determination, one selected from the group consisting of the first compressed data block and the second compressed data block to a cloud storage device.
12. The computer program product of claim 11 , wherein the first determination comprises:
comparing the first hotness with a first threshold hotness; and
in response to the first hotness being larger than the first threshold hotness, determining that the first compressed data block is to be stored on the second storage device.
13. The computer program product of claim 11 , wherein generating the second compressed data block comprises:
in response to determining that the first compressed data block is to be stored on the second storage device, decompressing the first compressed data block; and
compressing the decompressed first compressed data block using the compression algorithm with a second compression level to generate the second compressed data block,
wherein the second compression level corresponds to the second storage device and a compression degree for the second compression level is higher than a compression degree for the first compression level.
14. The computer program product of claim 11 , wherein the method further comprises:
determining a second hotness related to the second compressed data block;
comparing the second hotness with a second threshold hotness; and
in response to the second hotness being less than the second threshold hotness:
storing the second compressed data block to the first storage device.
15. The computer program product of claim 13 , wherein the method further comprises:
receiving, from a user, a source data block to be stored;
generating metadata for the source data block;
compressing the source data block using the compression algorithm with the first compression level to generate the first compressed data block;
compressing the metadata using the compression algorithm with the second compression level to generate a third compressed data block; and
storing the first compressed data block and the third compressed data block, respectively, to the first storage device and the second storage device.