Allocation of accelerator resources based on job type
A resource use method, an electronic device, and a computer program product are provided in embodiments of the present disclosure. The method includes determining a plurality of jobs requesting to use accelerator resources to accelerate data processing. The plurality of jobs are initiated by at least one virtual machine. The method further includes allocating available accelerator resources to the plurality of jobs based on job types of the plurality of jobs. The method further includes causing the plurality of jobs to be executed using the allocated accelerator resources. With the embodiments of the present disclosure, accelerator resources can be dynamically allocated, thereby improving the overall performance of a system.
1. A resource usage method, comprising:
determining a plurality of jobs requesting to use accelerator resources to accelerate data processing, the plurality of jobs being initiated by at least one virtual machine;
allocating available accelerator resources to the plurality of jobs based on job types of the plurality of jobs, including in response to the plurality of jobs having a plurality of job types, determining corresponding proportions of the available accelerator resources allocated to the plurality of job types, and allocating the available accelerator resources to the plurality of jobs according to the determined proportions, wherein determining the corresponding proportions of the available accelerator resources includes
determining a weight of each job type and a number of jobs of each job type among the plurality of jobs, and determining a proportion of the available accelerator resources allocated to each job type based on the weight of each job type and the number of jobs of each job type; and
causing the plurality of jobs to be executed using the allocated accelerator resources.
2. The method according to claim 1 , further comprising:
monitoring the execution performance of jobs of at least one job type among the plurality of job types;
increasing, if it is determined that the execution performance does not meet performance requirements, the weight of the at least one job type; and
updating the proportion of the available accelerator resources allocated to each job type based on the increased weight and the number.
3. The method according to claim 1 , wherein the plurality of job types comprise at least two of the following: a job type for data backup, a job type for data recovery, a job type for data copy, and a job type for garbage collection, and
the weight of any one of the job type for data backup and the job type for data recovery is higher than the weight of any one of the job type for data copy and the job type for garbage collection.
4. The method according to claim 1 , wherein allocating the available accelerator resources to the plurality of jobs comprises:
allocating, if it is determined that the plurality of jobs have the same job type, the available accelerator resources to the plurality of jobs.
5. The method according to claim 1 , further comprising:
selecting, from a resource pool comprising a plurality of accelerator devices, failure-free accelerator devices as the available accelerator resources.
6. The method according to claim 1 , wherein determining the plurality of jobs comprises:
determining, in response to a plurality of requests for the plurality of jobs being generated at the at least one virtual machine, the plurality of jobs based on the plurality of requests, each request indicating a job type of a corresponding job among the plurality of jobs and comprising data to be processed.
7. The method according to claim 1 , wherein the accelerator resources are one or more quick assist technology (QAT) cards.
8. An electronic device, comprising:
a processor; and
a non-transitory memory coupled to the processor and having instructions stored therein, which when executed by the processor, cause the processor to perform actions comprising:
determining a plurality of jobs requesting to use accelerator resources to accelerate data processing, the plurality of jobs being initiated by at least one virtual machine;
allocating available accelerator resources to the plurality of jobs based on job types of the plurality of jobs, including in response to the plurality of jobs having a plurality of job types, determining corresponding proportions of the available accelerator resources allocated to the plurality of job types, and allocating the available accelerator resources to the plurality of jobs according to the determined proportions, wherein determining the corresponding proportions of the available accelerator resources includes
determining a weight of each job type and a number of jobs of each job type among the plurality of jobs, and determining a proportion of the available accelerator resources allocated to each job type based on the weight of each job type and the number of jobs of each job type; and
causing the plurality of jobs to be executed using the allocated accelerator resources.
9. The device according to claim 8 , wherein the actions further comprise:
monitoring the execution performance of jobs of at least one job type among the plurality of job types;
increasing, if it is determined that the execution performance does not meet performance requirements, the weight of the at least one job type; and
updating the proportion of the available accelerator resources allocated to each job type based on the increased weight and the number.
10. The device according to claim 8 , wherein the plurality of job types comprise at least two of the following: a job type for data backup, a job type for data recovery, a job type for data copy, and a job type for garbage collection, and
the weight of any one of the job type for data backup and the job type for data recovery is higher than the weight of any one of the job type for data copy and the job type for garbage collection.
11. The device according to claim 8 , wherein allocating the available accelerator resources to the plurality of jobs comprises:
allocating, if it is determined that the plurality of jobs have the same job type, the available accelerator resources to the plurality of jobs.
12. The device according to claim 8 , wherein the actions further comprise:
selecting, from a resource pool comprising a plurality of accelerator devices, failure-free accelerator devices as the available accelerator resources.
13. The device according to claim 8 , wherein determining the plurality of jobs comprises:
determining, in response to a plurality of requests for the plurality of jobs being generated at the at least one virtual machine, the plurality of jobs based on the plurality of requests, each request indicating a job type of a corresponding job among the plurality of jobs and comprising data to be processed.
14. The device according to claim 8 , wherein the accelerator resources are one or more quick assist technology (QAT) cards.
15. A computer program product tangibly stored in a non-transitory computer-readable medium and comprising machine-executable instructions, which when executed, cause a machine to perform actions, the actions comprising:
determining a plurality of jobs requesting to use accelerator resources to accelerate data processing, the plurality of jobs being initiated by at least one virtual machine;
allocating available accelerator resources to the plurality of jobs based on job types of the plurality of jobs, including in response to the plurality of jobs having a plurality of job types, determining corresponding proportions of the available accelerator resources allocated to the plurality of job types, and allocating the available accelerator resources to the plurality of jobs according to the determined proportions, wherein determining the corresponding proportions of the available accelerator resources includes
determining a weight of each job type and a number of jobs of each job type among the plurality of jobs, and determining a proportion of the available accelerator resources allocated to each job type based on the weight of each job type and the number of jobs of each job type; and
causing the plurality of jobs to be executed using the allocated accelerator resources.