IP Library Granted Patent US 12675344
Granted Patent B1
US 12675344 · App. 17/978,918 · Granted Jul 7, 2026

Application programming interface to obtain kernel node context information

Inventors: Houston Thompson Hoffman (San Jose, CA); David Anthony Fontaine (Mountain View, CA); Sally Tessa Stevenson (Broomfield, CO)
Assignee: NVIDIA Corporation
G06F9/545
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12675344
App. No.
17/978,918
Granted
Jul 7, 2026
Kind
B1
Abstract

Apparatuses, systems, and techniques to execute CUDA programs. In at least one embodiment, an application programming interface is performed to provide one or more indicators of context information corresponding to one or more kernels. The application programming interface can be used to provide indicators of context information for context-free kernels and context.

Claims (37)

1 . One or more processors, comprising: circuitry to:

receive an application programming interface (API) call to provide one or more indicators of context information corresponding to one or more kernels; and

in response to receipt of the API call:

store a data structure into a memory location specified by a parameter of the API call;

extract a value of a field of the data structure; and

in response to determining that the extracted field has a predetermined value, provide one or more indicators of context information of one or more context-free kernels corresponding to one or more nodes of a graph.

2 . The one or more processors of claim 1 , wherein at least one of the one or more kernels is a context-free kernel.

3 . The one or more processors of claim 1 , wherein the one or more kernels are to be indicated by one or more nodes of a graph.

4 . The one or more processors of claim 1 , wherein the context information is based, at least in part, on a context of graphics processing unit (GPU).

5 . The one or more processors of claim 1 , wherein the context information is associated with the one or more kernels at a time when the one or more kernels are performed.

6 . The one or more processors of claim 1 , wherein the context information is associated with the one or more kernels at a time when the one or more kernels are created.

7 . The one or more processors of claim 1 , wherein the one or more kernels include a set of kernel parameters comprising the context information.

8 . The one or more processors of claim 1 , wherein the field of the data structure is a pointer usable to indicate a kernel bound to a context when the kernel is created.

9 . A computer-implemented method comprising:

receiving an application programming interface (API) call to provide one or more indicators of context information corresponding to one or more kernels; and

in response to receipt of the API call:

storing a data structure into a memory location specified by a parameter of the API call;

extracting a value of a field of the data structure; and

in response to determining that the extracted field has a predetermined value, providing one or more indicators of context information of one or more context-free kernels corresponding to one or more nodes of a graph.

10 . The computer-implemented method of claim 9 , wherein the predetermined value is a value that does not correspond to a valid kernel object.

11 . The computer-implemented method of claim 9 , wherein the one or more kernels are to be indicated by the one or more nodes of the graph.

12 . The computer-implemented method of claim 9 , wherein the context information is based, at least in part, on a context of graphics processing unit (GPU).

13 . The computer-implemented method of claim 9 , wherein the context information is associated with the one or more kernels at a time when the one or more kernels are performed.

14 . The computer-implemented method of claim 9 , wherein the context information is associated with the one or more kernels at a time when the API is to be performed.

15 . The computer-implemented method of claim 9 , wherein the API receives, as input, one or more attributes of the one or more kernels usable to perform the one or more kernels.

16 . A computer system comprising:

one or more processors and memory storing executable instructions that, if performed by the one or more processors, are to:

receive an application programming interface (API) call to provide one or more indicators of context information corresponding to one or more kernels; and

in response to receipt of the API call:

store a data structure into a memory location specified by a parameter of the API call;

extract a value of a field of the data structure; and

in response to determining that the extracted field has a predetermined value, provide one or more indicators of context information of one or more context-free kernels corresponding to one or more nodes of a graph.

17 . The computer system of claim 16 , wherein at least one of the one or more kernels is a context-free kernel.

18 . The computer system of claim 16 , wherein the one or more kernels are to be indicated by one or more nodes of a graph.

19 . The computer system of claim 16 , wherein the context information is based, at least in part, on a context of graphics processing unit (GPU).

20 . The computer system of claim 16 , wherein the context information is associated with the one or more kernels at a time when the one or more kernels are performed.

21 . The computer system of claim 16 , wherein the context information is associated with the one or more kernels at a time when the one or more kernels are instantiated.