Granted Patent B2

US 12,430,186 · App. 17/525,300 · Granted Sep 30, 2025

Inventors: Shrikant Kelkar (San Jose, CA); Gargi Adhav (San Jose, CA); Lakshmi Sharma (Saratoga, CA); Manoj Jayadevan (Cupertino, CA); Parveen Patel (Cupertino, CA); Parthasarathy Ranganathan (San Jose, CA)

Assignee: Google LLC

G06F9/5088G06F9/3877G06F9/48G06F9/4806G06F9/4843G06F9/485G06F9/4856G06F9/4881G06F9/50G06F9/505G06F9/5061G06F9/5083

Abstract

Claims (36)

1. A method comprising:

generating, by an accelerated services manager (ASM) executing on one or more processors of a local hardware (HW) accelerator card, a first set of acceleration services provided by one or more accelerators of the local HW accelerator card;

receiving, by the ASM, from another ASM executing on a remote HW accelerator card, a second set of acceleration services provided by one or more accelerators of the remote HW accelerator card;

providing, by one or more processors of a local hardware (HW) accelerator card, via a communication interface, a listing of acceleration services from the local HW accelerator card, the listing of acceleration services including the first set of acceleration services and the second set of acceleration services;

receiving, by the one or more processors, a workload instruction from a processor of a computing device, the workload instruction defining a workload for processing by at least one of the acceleration services of the second set of acceleration services;

forwarding, by the ASM, the workload instruction to the remote HW accelerator card; and

after determining a failure to process the workload instruction by the remote HW accelerator card, sending, by the ASM, an updated workload instruction to a different HW accelerator card for processing by at least one acceleration service of the different HW accelerator.

2. The method of claim 1 , further comprising:

receiving, by the one or more processors, a processed workload from the remote HW accelerator card, the processed workload being the workload after processing by the at least one of the acceleration services of the second set of acceleration services.

3. The method of claim 2 , further comprising:

forwarding, by the one or more processors, the processed workload to the processor of the computing device.

4. The method of claim 1 , wherein forwarding the workload instruction to the remote HW accelerator card comprises sending the workload instruction to the other ASM.

5. The method of claim 1 , wherein prior to receiving the second set of acceleration services, the ASM requests a listing of the second set of acceleration services from the other ASM.

6. The method of claim 1 , wherein the ASM identifies and prunes unhealthy acceleration services from the listing of acceleration services.

7. The method of claim 6 , wherein identifying the unhealthy acceleration services includes:

determining, by the ASM, the failure to process the workload instruction by the at least one of the acceleration services of the second set of acceleration services.

8. The method of claim 7 , wherein pruning the unhealthy acceleration services includes:

marking the at least one of the acceleration services of the second set of acceleration services as unhealthy; or

removing the at least one of the acceleration services of the second set of acceleration services from the listing of acceleration services.

9. The method of claim 1 , wherein the workload instruction further defines processing by at least one acceleration service of at least one other remote HW accelerator card.

10. A system comprising:

a communication interface;

a local hardware (HW) accelerator card including one or more processors and one or more accelerators, the one or more processors configured to:

generate, by an accelerated services manager (ASM) executing on the one or more processors a first set of acceleration services provided by the one or more accelerators;

receiving, by the ASM, from another ASM executing on a remote HW accelerator card, a second set of acceleration services provided by one or more accelerators of the remote HW accelerator card;

provide, via the communication interface, a listing of acceleration services from the local HW accelerator card, the listing of acceleration services including the first set of acceleration services and the second set of acceleration services;

receive a workload instruction from a processor of a computing device, the workload instruction defining a workload for processing by at least one of the acceleration services of the second set of acceleration services;

forward, by the ASM, the workload instruction to the remote HW accelerator card; and

send, by the ASM after determining a failure to process the workload instruction by the remote HW accelerator card, an updated workload instruction to a different HW accelerator card for processing by at least one acceleration service of the different HW accelerator.

11. The system of claim 10 , wherein the one or more processors are further configured to:

receive a processed workload from the remote HW accelerator card, the processed workload being the workload after processing by the at least one of the acceleration services of the second set of acceleration services.

12. The system of claim 11 , wherein the one or more processors are further configured to:

forward the processed workload to the processor of the computing device.

13. The system of claim 10 , wherein forwarding the workload instruction to the remote HW accelerator card comprises sending the workload instruction to the other ASM.

14. The system of claim 10 , wherein prior to receiving the second set of acceleration services, the ASM requests a listing of the second set of acceleration services from the other ASM.

15. The system of claim 10 , wherein the ASM identifies and prunes unhealthy acceleration services from the listing of acceleration services.

Assignments (1)

Continuity (1)

References Cited (23)