Method, electronic device, and computer program product for data processing
Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for data processing. According to an exemplary implementation of the present disclosure, a method for data processing includes: determining a type of target data associated with an access request, the type including at least one of: computation data type, recovery data type, and hot data type; selecting, based on the type, a target access mode of a storage device associated with the target data from a direct access mode and a block device mode; and causing the storage device to access the target data in the target access mode. As a result, good management of quality of service can be achieved for storage devices.
1. A method for data processing, comprising:
determining a type of target data associated with an access request, the type of the target data comprising at least one of a computation data type, a recovery data type, or a hot data type;
selecting, based on the type of the target data, a target access mode of a storage device associated with the target data from a direct access mode and a block device mode; and
causing the storage device to access the target data in the target access mode, wherein selecting the target access mode comprises:
if the type is the computation data type, selecting the direct access mode as the target access mode; and
if the type is the recovery data type and the hot data type, selecting the block device mode as the target access mode, wherein selecting the block device mode as the target access mode comprises determining a synchronous block device mode combined with direct memory access as the target access mode if the type is the recovery data type.
2. The method according to claim 1 , wherein
the computation data type is a type of data that affects a computation speed of a task being performed,
the recovery data type is a type of data used to restore an interrupted task, and
the hot data type is a type of data whose access frequency exceeds a threshold frequency.
3. The method according to claim 1 , wherein the computation data type comprises at least one of:
a register data type,
a metadata type, or
an index table type.
4. The method according to claim 1 , wherein selecting the block device mode as the target access mode further comprises:
if the type is the hot data type, determining an asynchronous block device mode combined with direct memory access as the target access mode.
5. The method according to claim 1 , wherein the target access mode is the block device mode, and the method further comprises:
determining a priority of the access request based on at least one of the type, a service level associated with a user who initiated the access request, and a platform that initiated the access request;
determining a queue corresponding to the access request based on the priority; and
putting the access request into the queue.
6. The method according to claim 5 , wherein causing the storage device to access the target data in the target access mode comprises:
acquiring the access request from the queue during polling of the queue; and
causing the storage device to access the target data with a predetermined bandwidth during a predetermined time slice in the target access mode, the predetermined time slice and the predetermined bandwidth being determined based on the priority.
7. An electronic device, comprising:
at least one processing unit; and
at least one memory coupled to the at least one processing unit and storing instructions, which when executed by the at least one processing unit, cause the device to perform actions, the actions comprising:
determining a type of target data associated with an access request, the type of the target data comprising at least one of a computation data type, a recovery data type, or a hot data type;
selecting, based on the type of the target data, a target access mode of a storage device associated with the target data from a direct access mode and a block device mode; and
causing the storage device to access the target data in the target access mode, wherein selecting the target access mode comprises:
if the type is the computation data type, selecting the direct access mode as the target access mode; and
if the type is the recovery data type and the hot data type, selecting the block device mode as the target access mode, wherein selecting the block device mode as the target access mode comprises:
if the type is the recovery data type, determining a synchronous block device mode combined with direct memory access as the target access mode; and
if the type is the hot data type, determining an asynchronous block device mode combined with direct memory access as the target access mode.
8. The device according to claim 7 , wherein
the computation data type is a type of data that affects a computation speed of a task being performed,
the recovery data type is a type of data used to restore an interrupted task, and
the hot data type is a type of data whose access frequency exceeds a threshold frequency.
9. The device according to claim 7 , wherein the computation data type comprises at least one of:
a register data type,
a metadata type, or
an index table type.
10. The device according to claim 7 , wherein selecting the block device mode as the target access mode further comprises:
if the type is the hot data type, determining an asynchronous block device mode combined with direct memory access as the target access mode.
11. The device according to claim 7 , wherein the target access mode is the block device mode, and the method further comprises:
determining a priority of the access request based on at least one of the type, a service level associated with a user who initiated the access request, and a platform that initiated the access request;
determining a queue corresponding to the access request based on the priority; and
putting the access request into the queue.
12. The device according to claim 11 , wherein causing the storage device to access the target data in the target access mode comprises:
acquiring the access request from the queue during polling of the queue; and
causing the storage device to access the target data with a predetermined bandwidth during a predetermined time slice in the target access mode, the predetermined time slice and the predetermined bandwidth being determined based on the priority.
13. A non-transitory computer-readable medium including machine-executable instructions, which when executed by a machine, cause the machine to perform actions, the actions comprising:
determining a type of target data associated with an access request, the type of the target data comprising at least one of a computation data type, a recovery data type, or a hot data type;
selecting, based on the type of the target data, a target access mode of a storage device associated with the target data from a direct access mode and a block device mode; and
causing the storage device to access the target data in the target access mode, wherein selecting the target access mode comprises:
if the type is the computation data type, selecting the direct access mode as the target access mode; and
if the type is the recovery data type and the hot data type, selecting the block device mode as the target access mode, wherein selecting the block device mode as the target access mode comprises determining a synchronous block device mode combined with direct memory access as the target access mode if the type is the recovery data type.
14. The computer-readable medium according to claim 13 , wherein
the computation data type is a type of data that affects a computation speed of a task being performed,
the recovery data type is a type of data used to restore an interrupted task, and
the hot data type is a type of data whose access frequency exceeds a threshold frequency.
15. The computer-readable medium according to claim 13 , wherein the computation data type comprises at least one of:
a register data type,
a metadata type, or
an index table type.
16. The computer-readable medium according to claim 13 , wherein selecting the block device mode as the target access mode further comprises:
if the type is the hot data type, determining an asynchronous block device mode combined with direct memory access as the target access mode.
17. The computer-readable medium according to claim 13 , wherein the target access mode is the block device mode, and the method further comprises:
determining a priority of the access request based on at least one of the type, a service level associated with a user who initiated the access request, and a platform that initiated the access request;
determining a queue corresponding to the access request based on the priority; and
putting the access request into the queue.