Method, device, and computer program product for managing storage system
Embodiments of the present disclosure relate to a method, an electronic device, and a computer program product for managing a storage system. The method includes: determining, at a first device of the storage system, whether a load of a first accelerator resource of the first device exceeds a load threshold; sending, if it is determined that the load exceeds the load threshold, a job processing request to a second device in a candidate device list to cause the second device to process a target job of the first device using a second accelerator resource of the second device, the candidate device list indicating devices in the storage system that can be used to assist the first device in job processing; receiving, from the second device, latency information related to remote processing latency of processing the target job using the second accelerator resource; and updating the candidate device list based on the latency information. The embodiments of the present disclosure can optimize the system performance.
1. A method for managing a storage system, including:
determining, at a first device of the storage system, whether a load of a first accelerator resource of the first device exceeds a load threshold;
in response to determining that the load exceeds the load threshold, sending a job processing request to a second device in a candidate device list to cause the second device to process a target job of the first device using a second accelerator resource of the second device, the candidate device list indicating devices in the storage system that can be used to assist the first device in job processing;
receiving, from the second device, latency information related to remote processing latency of processing the target job using the second accelerator resource; and
updating the candidate device list based on the latency information.
2. The method according to claim 1 , wherein updating the candidate device list includes:
determining, based on the latency information, whether the remote processing latency exceeds a latency threshold; and
removing the second device from the candidate device list if it is determined that the remote processing latency exceeds the latency threshold.
3. The method according to claim 2 , further including:
setting a timer for the second device in response to the second device being removed from the candidate device list; and
adding the second device back to the candidate device list in response to an expiration of the timer.
4. The method according to claim 2 , wherein the load threshold is determined based on the latency threshold.
5. The method according to claim 1 , wherein the remote processing latency includes a time period between a first moment when the first device sends the request and a second moment when the latency information is received.
6. The method according to claim 1 , wherein determining whether the load of the first accelerator resource exceeds the load threshold includes:
determining a number of jobs of the first device that are to be processed by the first accelerator resource; and
determining that the load of the first accelerator resource exceeds the load threshold if the number exceeds a number threshold.
7. The method according to claim 1 , wherein the first device is connected to devices in a candidate node list via a high-speed network interface.
8. The method according to claim 1 , wherein the first accelerator resource and the second accelerator resource each include a Quick Assist Technology (QAT) card.
9. A non-transitory machine readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform actions, the actions including:
determining, at a first device of a storage system, whether a load of a first accelerator resource of the first device exceeds a load threshold;
in response to determining that the load exceeds the load threshold, sending a job processing request to a second device in a candidate device list to cause the second device to process a target job of the first device using a second accelerator resource of the second device, the candidate device list indicating devices in the storage system that can be used to assist the first device in job processing;
receiving, from the second device, latency information related to remote processing latency of processing the target job using the second accelerator resource; and
updating the candidate device list based on the latency information.
10. The machine readable medium according to claim 9 , wherein updating the candidate device list includes:
determining, based on the latency information, whether the remote processing latency exceeds a latency threshold; and
removing the second device from the candidate device list if it is determined that the remote processing latency exceeds the latency threshold.
11. The machine readable medium according to claim 10 , wherein the actions further include:
setting a timer for the second device in response to the second device being removed from the candidate device list; and
adding the second device back to the candidate device list in response to an expiration of the timer.
12. The machine readable medium according to claim 10 , wherein the load threshold is determined based on the latency threshold.
13. The machine readable medium according to claim 9 , wherein the remote processing latency includes a time period between a first moment when the first device sends the request and a second moment when the latency information is received.
14. The machine readable medium according to claim 9 , wherein determining whether the load of the first accelerator resource exceeds the load threshold includes:
determining a number of jobs of the first device that are to be processed by the first accelerator resource; and
determining that the load of the first accelerator resource exceeds the load threshold if the number exceeds a number threshold.
15. The machine readable medium according to claim 9 , wherein the first device is connected to devices in a candidate node list via a high-speed network interface.
16. The machine readable medium according to claim 9 , wherein the first accelerator resource and the second accelerator resource each include a Quick Assist Technology (QAT) card.
17. An electronic device operating as a first device of a storage system, the electronic device comprising:
a processor; and
a memory coupled to processor storing instructions, which when executed by the processor, cause the processor to perform actions, the actions including:
determining whether a load of a first accelerator resource of the first device exceeds a load threshold;
in response to determining that the load exceeds the load threshold, sending a job processing request to a second device in a candidate device list to cause the second device to process a target job of the first device using a second accelerator resource of the second device, the candidate device list indicating devices in the storage system that can be used to assist the first device in job processing;
receiving, from the second device, latency information related to remote processing latency of processing the target job using the second accelerator resource; and
updating the candidate device list based on the latency information.
18. The electronic device according to claim 17 , wherein updating the candidate device list includes:
determining, based on the latency information, whether the remote processing latency exceeds a latency threshold; and
removing the second device from the candidate device list if it is determined that the remote processing latency exceeds the latency threshold.
19. The electronic device according to claim 18 , wherein the actions further include:
setting a timer for the second device in response to the second device being removed from the candidate device list; and
adding the second device back to the candidate device list in response to an expiration of the timer.
20. The electronic device according to claim 18 , wherein the load threshold is determined based on the latency threshold.