Systems and methods of allocating GPU memory
The server, initializes, for a third-party application executing on the server, an entirety of available GPU memory of a client device, including pre-allocating a plurality of blocks of GPU memory. During execution of the third-party application, the server receives a first request from the third-party application to store first data in the GPU memory of the client device, and, in response to the first request, frees a portion of a respective pre-allocated block of the plurality of pre-allocated blocks of GPU memory and stores the first data in the portion of the respective pre-allocated block. The server pre-allocates a new block of GPU memory of the client device, the new block comprising a complementary portion of the respective pre-allocated block such that, after pre-allocating the new block of GPU memory, the entirety of available GPU memory of the client device remains allocated.
1 . A method, comprising:
at a server system hosting a virtual machine executing a third-party application, the server system in communication with a physical client device:
initializing, for the third-party application, an entirety of available GPU memory of the client device, including pre-allocating a plurality of blocks of GPU memory;
during execution of the third-party application:
receiving a first request from the third-party application to store first data in the GPU memory of the client device;
in response to the first request:
freeing a portion of a respective pre-allocated block of the plurality of pre-allocated blocks of GPU memory;
storing the first data in the portion of the respective pre-allocated block; and
pre-allocating a new block of GPU memory of the client device, the new block comprising a complementary portion of the respective pre-allocated block such that, after pre-allocating the new block of GPU memory, the entirety of available GPU memory of the client device remains allocated.
2 . The method of claim 1 , further comprising:
storing a map of pre-allocated blocks, the map including an identifier and size of each of the plurality of pre-allocated blocks; and
in response to the first request from the third-party application to store the first data in the GPU memory of the client device, updating the map to include the pre-allocated new block of memory.
3 . The method of claim 1 , wherein the pre-allocated blocks have a maximum size.
4 . The method of claim 1 , wherein the pre-allocated blocks do not include data for the third-party application.
5 . The method of any of claims 1-4 , further including determining a position, within the respective pre-allocated block, of the portion of the respective pre-allocated block in which the first data is stored using a known management scheme of the physical client device.
6 . The method of any of claims 1-4 , wherein pre-allocating the plurality of blocks of GPU memory comprises iteratively pre-allocating blocks of decreasing size until the entirety of the GPU memory is pre-allocated.
7 . The method of any of claims 1-4 , further comprising:
receiving a second request from the third-party application to store second data in the GPU memory of the client device;
in response to the second request:
determining that the second data is larger than any currently pre-allocated blocks of GPU memory;
in accordance with the determination that the second data is larger than any currently pre-allocated blocks of GPU memory, moving the first data to a different pre-allocated block; and
storing the second data in GPU memory freed by moving the first data to the different pre-allocated block.
8 . The method of any of claims 1-4 , wherein the physical client device does not include a memory manager for the GPU memory.
9 . A non-transitory computer-readable storage medium storing one or more programs for execution by a server system executing a third-party application, the server system in communication with a client device, the one or more programs including instructions for:
initializing, for the third-party application, an entirety of available GPU memory of the client device, including pre-allocating a plurality of blocks of GPU memory;
during execution of the third-party application:
receiving a first request from the third-party application to store first data in the GPU memory of the client device;
in response to the first request:
freeing a portion of a respective pre-allocated block of the plurality of pre-allocated blocks of GPU memory;
storing the first data in the portion of the respective pre-allocated block; and
pre-allocating a new block of GPU memory of the client device, the new block comprising a complementary portion of the respective pre-allocated block such that, after pre-allocating the new block of GPU memory, the entirety of available GPU memory of the client device remains allocated.
10 . A server system hosting a virtual machine executing a third-party application, the server system in communication with a physical client device, comprising:
one or more processors; and
memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for:
initializing, for the third-party application, an entirety of available GPU memory of the client device, including pre-allocating a plurality of blocks of GPU memory;
during execution of the third-party application:
receiving a first request from the third-party application to store first data in the GPU memory of the client device;
in response to the first request:
freeing a portion of a respective pre-allocated block of the plurality of pre-allocated blocks of GPU memory;
storing the first data in the portion of the respective pre-allocated block; and
pre-allocating a new block of GPU memory of the client device, the new block comprising a complementary portion of the respective pre-allocated block such that, after pre-allocating the new block of GPU memory, the entirety of available GPU memory of the client device remains allocated.