Method, device, and computer program product for processing compressed data
Techniques for processing compressed data involve: determining, based on parsing of a header of a compressed data packet, a size of original data corresponding to compressed data, wherein the compressed data packet comprises the header, compressed metadata, and the compressed data. The techniques further involve: allocating, based on the size of the original data, a shared buffer space for receiving and converting the compressed metadata and the compressed data; and storing the compressed data packet in the shared buffer space. The shared buffer space can be used for the receiving and conversion processing of compressed data at the same time, without allocating a separate buffer space for each processing, thereby improving the memory efficiency. Since the allocated shared buffer space is used for both receiving processing and conversion processing, the complexity of configuration of a memory pool is also reduced.
1. A method for processing compressed data, comprising:
determining, based on parsing of a header of a compressed data packet, a size of original data corresponding to compressed data, wherein the compressed data packet comprises the header, compressed metadata, and the compressed data;
allocating, based on the size of the original data, a shared buffer space for receiving and converting the compressed metadata and the compressed data to recover an original layout of the compressed data and the compressed metadata, wherein the shared buffer space comprises a first portion and a second portion;
storing the compressed data packet in the shared buffer space at least in part by storing the compressed data packet in the first portion of the shared buffer space and reserving the second portion of the shared buffer space; and
recovering the original layout of the compressed data and the compressed metadata using the second portion reserved in the shared buffer space at least in part by directing input-output vector (IOV) entries of an IOV to a plurality of compressed-data buffers (CDBs) in a CDB array and directing each CDB of the plurality of CDBs to a corresponding data buffer.
2. The method according to claim 1 , wherein allocating the shared buffer space comprises:
allocating in the shared buffer space a first page of a first size for page alignment; and
allocating in the shared buffer space a second page of a second size for storing the compressed metadata and the compressed data, wherein the first size is greater than the second size.
3. The method according to claim 2 , wherein storing the compressed data packet in the first portion of the shared buffer space comprises:
storing the compressed data packet in the first portion of the shared buffer space in a reverse-order manner.
4. The method according to claim 1 , wherein the compressed data packet comprises the compressed metadata and the compressed data that are merged through compact processing.
5. The method according to claim 1 , further comprising:
decompressing the compressed data packet to obtain the original data; and
storing the decompressed original data in the shared buffer space.
6. The method according to claim 5 , further comprising:
performing an integrity check on the decompressed original data; and
writing the original data to a cache in response to passing the integrity check.
7. A device for processing compressed data, comprising:
a processor, and
a memory coupled to the processor and storing instructions, wherein the instructions, when executed by the processor, cause the device to execute the following actions:
determining, based on parsing of a header of a compressed data packet, a size of original data corresponding to compressed data, wherein the compressed data packet comprises the header, compressed metadata, and the compressed data;
allocating, based on the size of the original data, a shared buffer space for receiving and converting the compressed metadata and the compressed data to recover an original layout of the compressed data and the compressed metadata, wherein the shared buffer space comprises a first portion and a second portion;
storing the compressed data packet in the shared buffer space at least in part by storing the compressed data packet in the first portion of the shared buffer space and reserving the second portion of the shared buffer space; and
recovering the original layout of the compressed data and the compressed metadata using the second portion reserved in the shared buffer space at least in part by directing input-output vector (IOV) entries of an IOV to a plurality of compressed-data buffers (CDBs) in a CDB array and directing each CDB of the plurality of CDBs to a corresponding data buffer.
8. The device according to claim 7 , wherein allocating the shared buffer space comprises:
allocating in the shared buffer space a first page of a first size for page alignment; and
allocating in the shared buffer space a second page of a second size for storing the compressed metadata and the compressed data, wherein the first size is greater than the second size.
9. The device according to claim 8 , wherein storing the compressed data packet in the first portion of the shared buffer space comprises:
storing the compressed data packet in the first portion of the shared buffer space in a reverse-order manner.
10. The device according to claim 7 , wherein the compressed data packet comprises the compressed metadata and the compressed data that are merged through compact processing.
11. The device according to claim 7 , wherein the actions further comprise:
decompressing the compressed data packet to obtain the original data; and
storing the decompressed original data in the shared buffer space.
12. The device according to claim 11 , wherein the actions further comprise:
performing an integrity check on the decompressed original data; and
writing the original data to a cache in response to passing the integrity check.
13. A computer program product having a non-transitory computer readable medium which stores a set of instructions for processing compressed data; the set of instructions, when carried out by computerized circuitry, causing the computerized circuitry to perform a method of:
determining, based on parsing of a header of a compressed data packet, a size of original data corresponding to compressed data, wherein the compressed data packet comprises the header, compressed metadata, and the compressed data;
allocating, based on the size of the original data, a shared buffer space for receiving and converting the compressed metadata and the compressed data to recover an original layout of the compressed data and the compressed metadata, wherein the shared buffer space comprises a first portion and a second portion;
storing the compressed data packet in the shared buffer space at least in part by storing the compressed data packet in the first portion of the shared buffer space and reserving the second portion of the shared buffer space; and
recovering the original layout of the compressed data and the compressed metadata using the second portion reserved in the shared buffer space at least in part by directing input-output vector (IOV) entries of an IOV to a plurality of compressed-data buffers (CDBs) in a CDB array and directing each CDB of the plurality of CDBs to a corresponding data buffer.