High-speed resume for GPU applications
Described herein are devices, systems and methods to utilize non-volatile memory to save and retrieve data that is used to accelerate the load and resume of GPU accelerated applications. Non-volatile memory and GPU logic are configured to enable the GPU to directly access the non-volatile memory to enable data to be read without requiring the data to traverse the CPU and CPU memory. This data access path creates a faster method for loading data into GPU local memory.
1. A graphics processor device comprising:
one or more graphics processing resources:
a volatile memory coupled with the one or more graphics processing resources; and
a non-volatile memory coupled with the volatile memory and the one or more graphics processing resources, the one or more graphics processing resources to:
receive a request to create a resource for use by the one or more graphics processing resources during acceleration of an application to be accelerated by the one or more graphics processing resources;
determine whether the resource is to be stored to the non-volatile memory;
store the resource to the non-volatile memory in response to a determination that the resource is to be stored to the non-volatile memory; and
store the resource to the volatile memory in response to a determination that the resource is not to be stored to the non-volatile memory.
2. The graphics processor device as in claim 1 , wherein the one or more graphics processing resources are additionally to store the resource to the non-volatile memory and the volatile memory in response to the determination that the resource is to be stored to the non-volatile memory.
3. The graphics processor device as in claim 1 , wherein to store the resource to the non-volatile memory additionally includes to store the resource to the volatile memory.
4. The graphics processor device as in claim 1 , wherein the determination that the resource is to be stored to the non-volatile memory is based on a determination of whether the resource is a static resource or a dynamic resource.
5. The graphics processor device as in claim 4 , wherein the resource is a static resource and includes static texture data.
6. The graphics processor device as in claim 4 , wherein the resource is a dynamic resource and includes a constant buffer, a dynamic vertex buffer, or a dynamic texture.
7. The graphics processor device as in claim 1 , wherein the application to be accelerated by the one or more graphics processing resources is a first application and the determination that the resource is to be stored to the non-volatile memory is based on a first data size associated with a first set of resources for the first application, the first set of resources stored on the non-volatile memory.
8. The graphics processor device as in claim 7 , the one or more graphics processing resources additionally to receive a request to create a resource for use by the one or more graphics processing resources to accelerate a second application, the determination that the resource is to be stored to the non-volatile memory is based on a second data size associated with a second set of resources for the second application, the second set of resources stored on the non-volatile memory.
9. The graphics processor device as in claim 8 , wherein the second data size differs from the first data size.
10. The graphics processor device as in claim 8 , wherein the first set of resources for the first application include texture data.
11. The graphics processor device as in claim 8 , wherein the second set of resources for the second application include data associated with a machine learning model.
12. A method comprising:
on a graphics processor device comprising one or more graphics processing resources:
receiving a request to create a resource for use by the one or more graphics processing resources;
determining whether the resource is to be stored to a non-volatile memory, wherein the non-volatile memory is directly addressable by the graphics processor device;
storing the resource to the non-volatile memory in response to a determination that the resource is to be stored to the non-volatile memory; and
storing the resource to a volatile memory coupled with the graphics processor device in response to a determination that the resource is not to be stored to the non-volatile memory.
13. The method as in claim 12 , additionally comprising storing the resource to the non-volatile memory and the volatile memory in response to determining that the resource is to be stored to the non-volatile memory.
14. The method as in claim 12 , wherein to store the resource to the non-volatile memory additionally includes to store the resource to the volatile memory.
15. The method as in claim 12 , determining whether the resource is to be stored to the non-volatile memory includes determining whether the resource is a static resource or a dynamic resource.
16. The method as in claim 15 , wherein the resource is a static resource and includes static texture data or the resource is a dynamic resource and includes a constant buffer, a dynamic vertex buffer, or a dynamic texture.
17. A graphics processor comprising:
one or more graphics processing resources;
a volatile memory coupled with the one or more graphics processing resources; and
an interface to couple a non-volatile memory to the one or more graphics processing resources and the volatile memory, the one or more graphics processing resources to:
receive a request to create a resource for use by the one or more graphics processing resources;
determine whether the resource is to be stored to the non-volatile memory;
store the resource to the non-volatile memory in response to a determination that the resource is to be stored to the non-volatile memory; and
store the resource to the volatile memory in response to a determination that the resource is not to be stored to the non-volatile memory.
18. The graphics processor as in claim 17 , wherein the one or more graphics processing resources are additionally to store the resource to the non-volatile memory and the volatile memory in response to the determination that the resource is to be stored to the non-volatile memory.
19. The graphics processor as in claim 17 , wherein to store the resource to the non-volatile memory additionally includes to store the resource to the volatile memory.
20. The graphics processor as in claim 17 , wherein the determination that the resource is to be stored to the non-volatile memory is based on a determination of whether the resource is a static resource or a dynamic resource, wherein the resource is a static resource and includes static texture data or the resource is a dynamic resource and includes a constant buffer, a dynamic vertex buffer, or a dynamic texture.