Method, device, and computer program product for managing data transfer
Embodiments of the present disclosure relate to a method, a device, and a computer program product for managing data transfer. A method for managing data transfer is provided, including: if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system; and determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the memory and the persistent memory, the first transfer technology transferring data through direct access to the memory, and the second transfer technology transferring data through the central processing unit. Therefore, the embodiments of the present disclosure can improve the data transfer performance of the storage system.
1. A method for managing data transfer, comprising:
if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system, wherein the utilization rate is obtained through a data storage system bus; and
determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the memory and the persistent memory, the first transfer technology transferring data through direct access to the memory, and the second transfer technology transferring data through the central processing unit, wherein determining the target transfer technology comprises if determining that the utilization rate is lower than a threshold utilization rate, determining the second transfer technology as the target transfer technology, wherein the first transfer technology is an input-output accelerated direct memory access technology, the input-output accelerated direct memory access technology using parallel channels to transfer data, and wherein the second transfer technology is a central processing unit memory replication technology, the central processing unit memory replication technology transferring data in a serial manner.
2. The method according to claim 1 , wherein determining the target transfer technology further comprises:
if determining that the utilization rate is higher than or equal to the threshold utilization rate,
obtaining a size of the data block to be transferred, and
determining the target transfer technology based on the size of the data block.
3. The method according to claim 2 , wherein determining the target transfer technology based on the size of the data block comprises:
if determining that the size of the data block is larger than a threshold size, determining the first transfer technology as the target transfer technology, wherein the threshold size is determined by reading a threshold size table storing a plurality of preset threshold sizes for different data storage systems; and
if determining that the size of the data block is smaller than or equal to the threshold size, determining the second transfer technology as the target transfer technology.
4. The method according to claim 2 , wherein the threshold size is preset based on at least one of a hardware configuration of the data storage system, central processing unit performance, and a size distribution of the data block.
5. The method according to claim 1 , wherein the data storage system is a storage system for deduplication process comprising a data stream buffer and a slice.
6. The method according to claim 1 , further comprising: in response to determining that the received request to transfer the data block between the memory and the persistent memory of the data storage system is not the request from a data domain, directly determining to use the central processing unit memory replication technology to transfer data associated with the request.
7. An electronic device, comprising:
at least one processor; and
at least one memory storing computer program instructions, the at least one memory and the computer program instructions being configured to cause, together with the at least one processor, the electronic device to perform actions comprising:
if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system, wherein the utilization rate is obtained through a data storage system bus; and
determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the at least one memory and the persistent memory, the first transfer technology transferring data through direct access to the at least one memory, and the second transfer technology transferring data through the central processing unit, wherein determining the target transfer technology comprises if determining that the utilization rate is lower than a threshold utilization rate, determining the second transfer technology as the target transfer technology, wherein the first transfer technology is an input-output accelerated direct memory access technology, the input-output accelerated direct memory access technology using parallel channels to transfer data, and wherein the second transfer technology is a central processing unit memory replication technology, the central processing unit memory replication technology transferring data in a serial manner.
8. The electronic device according to claim 7 , wherein determining the target transfer technology further comprises:
if determining that the utilization rate is higher than or equal to the threshold utilization rate,
obtaining a size of the data block to be transferred, and
determining the target transfer technology based on the size of the data block.
9. The electronic device according to claim 8 , wherein determining the target transfer technology based on the size of the data block comprises:
if determining that the size of the data block is larger than a threshold size, determining the first transfer technology as the target transfer technology, wherein the threshold size is determined by reading a threshold size table storing a plurality of preset threshold sizes for different data storage systems; and
if determining that the size of the data block is smaller than or equal to the threshold size, determining the second transfer technology as the target transfer technology.
10. The electronic device according to claim 7 , wherein the data storage system is a storage system for deduplication process comprising a data stream buffer and a slice.
11. A computer program product tangibly stored in a non-transitory computer storage medium and including machine-executable instructions, which when executed by a device, cause the device to perform actions, the actions comprising:
if determining that a request to transfer a data block between a memory and a persistent memory of a data storage system is received, obtaining a utilization rate of a central processing unit of the data storage system, wherein the utilization rate is obtained through a data storage system bus; and
determining, from a first transfer technology and a second transfer technology and at least based on the utilization rate of the central processing unit, a target transfer technology for transferring a data block between the memory and the persistent memory, the first transfer technology transferring data through direct access to the memory, and the second transfer technology transferring data through the central processing unit, wherein determining the target transfer technology comprises if determining that the utilization rate is lower than a threshold utilization rate, determining the second transfer technology as the target transfer technology, wherein the first transfer technology is an input-output accelerated direct memory access technology, the input-output accelerated direct memory access technology using parallel channels to transfer data, and wherein the second transfer technology is a central processing unit memory replication technology, the central processing unit memory replication technology transferring data in a serial manner.
12. The computer program product according to claim 11 , wherein determining the target transfer technology further comprises; and
if determining that the utilization rate is higher than or equal to the threshold utilization rate, obtaining a size of the data block to be transferred, and
determining the target transfer technology based on the size of the data block.
13. The computer program product according to claim 12 , wherein determining the target transfer technology based on the size of the data block comprises:
if determining that the size of the data block is larger than a threshold size, determining the first transfer technology as the target transfer technology, wherein the threshold size is determined by reading a threshold size table storing a plurality of preset threshold sizes for different data storage systems; and
if determining that the size of the data block is smaller than or equal to the threshold size, determining the second transfer technology as the target transfer technology.
14. The computer program product according to claim 11 , wherein the data storage system is a storage system for deduplication process comprising a data stream buffer and a slice.