IP Library Granted Patent US 11,789,777
Granted Patent B2
US 11,789,777 · App. 17/077,434 · Granted Oct 17, 2023

Resource utilization method, electronic device, and computer program product

Inventors: Tao Chen (Beijing, CN); Bing Liu (Tianjin, CN)
Assignee: EMC IP HOLDING COMPANY LLC
G06F9/5011G06F3/0604G06F3/067G06F3/0613G06F3/0631G06F9/4881G06F11/0757G06F2209/508G06F2209/5022
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,789,777
App. No.
17/077,434
Granted
Oct 17, 2023
Kind
B2
Abstract

Embodiments of the present disclosure provide a resource utilization method, an electronic device, and a computer program product. A resource utilization method comprises: at a first node of a storage system, determining whether a local processing delay of a first accelerator resource of the first node exceeds a first threshold delay or not; if it is determined that the local processing delay exceeds the first threshold delay, determining at least one remote processing delay respectively corresponding to at least one second node of the storage system, wherein each remote processing delay comprises a processing delay of a second accelerator resource of a corresponding second node and a round-trip time between the first node and the corresponding second node; and at least based on the at least one remote processing delay, selecting a second accelerator resource, from the second accelerator resources of the at least one second node, to execute a target job of the first node. In this way, the calling of the accelerator resources across nodes may be implemented, thereby not only improving the processing efficiency of the jobs but also increasing the overall utilization rate of system resources.

Claims (52)

1. A resource utilization method, comprising:

determining, at a first node of a storage system, whether a local processing delay of a first accelerator resource of the first node exceeds a first threshold delay;

determining at least one remote processing delay respectively corresponding to at least one second node of the storage system, each remote processing delay of the at least one remote processing delay comprising a processing delay of a second accelerator resource of a corresponding second node of the at least one second node and a round-trip time between the first node and the corresponding second node, in response to determining that the local processing delay exceeds the first threshold delay; and

executing a target job of the first node by selecting, at least based on the at least one remote processing delay, a second accelerator resource, from at least one second accelerator resources of the at least one second node.

2. The method according to claim 1 , wherein the local processing delay of the first node exceeds the round-trip time.

3. The method according to claim 1 , wherein the first node and the at least one second node are connected through a high-speed network interface.

4. The method according to claim 1 , the method further comprises:

comparing a priority of a job to be executed at the first node with a threshold priority;

in response to that the priority of the job to be executed is lower than the threshold priority, determining the job to be executed as the target job; and

in response to that the priority of the job to be executed exceeds the threshold priority, selecting the first accelerator resource of the first node to execute the job to be executed.

5. The method according to claim 1 , wherein the at least one second node comprises a plurality of second nodes, wherein the at least one remote processing delay comprises a plurality of remote processing delays, and wherein the executing the target job of the first node by selecting the second accelerator resource comprises:

comparing the plurality of remote processing delays respectively corresponding to the plurality of second nodes with a second threshold delay;

based on a result of the comparison, determining a remote processing delay that does not exceed the second threshold delay from the plurality of remote processing delays; and

executing the target job of the first node by selecting the second accelerator resource of the second node corresponding to the determined remote processing delay.

6. The method according to claim 1 , wherein the at least one second node comprises a plurality of second nodes, wherein the at least one remote processing delay comprises a plurality of remote processing delays, and wherein the executing the target job of the first node by selecting the second accelerator resource comprises:

selecting the lowest remote processing delay from the plurality of remote processing delays respectively corresponding to the plurality of second nodes; and

executing the target job of the first node by selecting the second accelerator resource of the second node corresponding to the selected remote processing delay.

7. The method according to claim 1 , wherein the executing the target job further comprises:

executing the target job by utilizing the selected second accelerator resource through a remote program call interface.

8. The method according to claim 1 , wherein the first accelerator resources and the second accelerator resources comprise quick assist technology (QAT) cards.

9. An electronic device, comprising:

a processor; and

a memory coupled to the processor, the memory having instructions stored therein, which when executed by the processor, causing the processor to perform actions, the actions comprising:

determining, at a first node of a storage system, whether a local processing delay of a first accelerator resource of the first node exceeds a first threshold delay;

determining at least one remote processing delay respectively corresponding to at least one second node of the storage system, each remote processing delay of the at least one remote processing delay comprising a processing delay of a second accelerator resource of a corresponding second node of the at least one second node and a round-trip time between the first node and the corresponding second node, in response to determining that the local processing delay exceeds the first threshold delay; and

executing a target job of the first node by selecting, at least based on the at least one remote processing delay, a second accelerator resource, from at least one second accelerator resources of the at least one second node.

10. The device according to claim 9 , wherein the local processing delay of the first node exceeds the round-trip time.

11. The device according to claim 9 , wherein the first node and the at least one second node are connected through a high-speed network interface.

12. The device according to claim 9 , the actions further comprise:

comparing a priority of a job to be executed at the first node with a threshold priority;

in response to that the priority of the job to be executed is lower than the threshold priority, determining the job to be executed as the target job; and

in response to that the priority of the job to be executed exceeds the threshold priority, selecting the first accelerator resource of the first node to execute the job to be executed.

13. The device according to claim 9 , wherein the at least one second node comprises a plurality of second nodes, wherein the at least one remote processing delay comprises a plurality of remote processing delays, and wherein the executing the target job of the first node by selecting the second accelerator resource comprises:

comparing the plurality of remote processing delays respectively corresponding to the plurality of second nodes with a second threshold delay;

based on a result of the comparison, determining a remote processing delay that does not exceed the second threshold delay from the plurality of remote processing delays; and

executing the target job of the first node by selecting the second accelerator resource of the second node corresponding to the determined remote processing delay.

14. The device according to claim 9 , wherein the at least one second node comprises a plurality of second nodes, wherein the at least one remote processing delay comprises a plurality of remote processing delays, and wherein the executing the target job of the first node by selecting the second accelerator resource comprises:

selecting the lowest remote processing delay from the plurality of remote processing delays respectively corresponding to the plurality of second nodes; and

executing the target job of the first node by selecting the second accelerator resource of the second node corresponding to the selected remote processing delay.

15. The device according to claim 9 , wherein the executing the target job further comprise:

executing the target job by utilizing the selected second accelerator resource through a remote program call interface.

16. The device according to claim 9 , wherein the first accelerator resources and the second accelerator resources comprise quick assist technology (QAT) cards.

17. A computer program product, tangibly stored in a computer-readable medium and comprising computer-executable instructions, which when executed by a processor, cause the processor to:

determine, at a first node of a storage system, whether a local processing delay of a first accelerator resource of the first node exceeds a first threshold delay;

determine at least one remote processing delay respectively corresponding to at least one second node of the storage system, wherein each remote processing delay of the of the at least one remote processing delay comprises a processing delay of a second accelerator resource of a corresponding second node of the at least one second node and a round-trip time between the first node and the corresponding second node, in response to determining that the local processing delay exceeds the first threshold delay; and

executing a target job of the first node by select, at least based on the at least one remote processing delay, a second accelerator resource, from at least one second accelerator resources of the at least one second node.

18. The computer program product according to claim 17 , wherein the local processing delay of the first node exceeds the round-trip time.

19. The computer program product according to claim 17 , wherein the first node and the at least one second node are connected through a high-speed network interface.

20. The computer program product according to claim 17 , wherein the actions further comprise:

comparing a priority of a job to be executed at the first node with a threshold priority;

in response to that the priority of the job to be executed is lower than the threshold priority, determining the job to be executed as the target job; and

in response to that the priority of the job to be executed exceeds the threshold priority, selecting the first accelerator resource of the first node to execute the job to be executed.

Assignments (9)
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0523) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 060332/0664 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0434) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 060332/0740 →
RELEASE OF SECURITY INTEREST IN PATENTS PREVIOUSLY RECORDED AT REEL/FRAME (054475/0609) Recorded Jun 10, 2022
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
To: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
Reel/Frame 062021/0570 →
RELEASE OF SECURITY INTEREST AT REEL 054591 FRAME 0471 Recorded Nov 2, 2021
From: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
To: DELL PRODUCTS L.P.; EMC IP HOLDING COMPANY LLC
Reel/Frame 058001/0463 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS COLLATERAL AGENT
Reel/Frame 054475/0609 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 054475/0434 →
SECURITY INTEREST Recorded Nov 18, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A., AS NOTES COLLATERAL AGENT
Reel/Frame 054475/0523 →
SECURITY AGREEMENT Recorded Nov 13, 2020
From: EMC IP HOLDING COMPANY LLC; DELL PRODUCTS L.P.
To: CREDIT SUISSE AG, CAYMAN ISLANDS BRANCH
Reel/Frame 054591/0471 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2020
From: CHEN, TAO; LIU, BING
To: EMC IP HOLDING COMPANY LLC
Reel/Frame 054139/0502 →