Data access management in a hybrid memory server
Once or more embodiments manage access to data by accelerator systems in an out-of-core processing environment. In one embodiment, a request from an accelerator system is received for access to a given data set. An access context associated with the given data set is determined. The accelerator system is dynamically configured, based on the access context that has been determined, based on the access context that has been determined, to one of access the given data set directly from the server system; locally store a portion of the given data set in a memory; and locally store all of the given data set in the memory.
1. A method, on an accelerator system in an out-of-core processing environment, for accessing data by accelerator systems, the method comprising:
sending a request to a server system for access to a given data set being managed by the server system;
receiving, based on sending the request, an access configuration from the server system for accessing the given data set managed by the server system; and
determining, based on the access configuration, that the given data set is to be accessed by one of
accessing the given data set directly from the server system,
locally storing a portion of the given data set in a memory and locally accessing the portion of the given data set, and
locally storing all of the given data set in the memory and locally accessing the given data set.
2. The method of claim 1 , wherein the request is associated with an access context, the accessing context indicating to the server system one or more characteristics of an access operation associated with at least one of the accelerator system and a user system when accessing the given data set.
3. The method of claim 1 , wherein the access configuration is one or a plurality of access configurations available for the accelerator system based on the access context that has been determined, wherein different access configurations are selected for one or more different access contexts.
4. The method of claim 3 , wherein at least a first access configuration in the plurality of different access configurations configures the accelerator system differently than a second access configuration in the plurality of different access configurations.
5. The method of claim 1 , wherein in response to determining that the given data set is to be accessed by locally storing one of the portion or all of the given data set,
maintaining a security counter for the given data set; and
removing the one of the portion or all of the given data set from the memory when a value of the security count satisfies a given threshold value.
6. The method of claim 1 , further comprising:
establishing a fully encrypted communication link with the server system in response to a user associated with the request for access to the given data set requesting a fully encrypted communication link.
7. The method of claim 1 , further comprising:
establishing a partially encrypted communication link with the server system to receive information associated with the given data set in response to determining that the given data set is to be accessed by locally storing one of a portion or all of the given data set, the partially encrypted communication link comprising a lower encryption strength than a fully encrypted communication link.
8. An accelerator processing system in an out-of-core processing environment comprising the accelerator processing system, the accelerator system comprising:
a memory;
a processing core communicatively coupled to the memory; and
a data manager communicatively coupled to the memory and the processing core, wherein the data manager is configured to perform a method comprising:
sending a request to a server system for access to a given data set being managed by the server system;
receiving, based on sending the request, an access configuration from the server system for accessing the given data set; and
determining, based on the access configuration, that the given data set is to be accessed by one of
accessing the given data set directly from the server system,
locally storing a portion of the given data set in a memory and locally accessing the portion of the given data set, and
locally storing all of the given data set in the memory and locally accessing the given data set.
9. The accelerator processing system of claim 8 , wherein the request is associated with an access context, the accessing context indicating to the server system one or more characteristics of an access operation associated with at least one of the accelerator system and a user system when accessing the given data set.
10. The accelerator processing system of claim 8 , wherein the access configuration is one or a plurality of access configurations available for the accelerator system based on the access context that has been determined, wherein different access configurations are selected for one or more different access contexts.
11. The accelerator processing system of claim 10 , wherein at least a first access configuration in the plurality of different access configurations configures the accelerator system differently than a second access configuration in the plurality of different access configurations.
12. The accelerator processing system of claim 8 , wherein in response to determining that the given data set is to be accessed by locally storing one of the portion or all of the given data set, the method further comprising
maintaining a security counter for the given data set; and
removing the one of the portion or all of the given data set from the memory when a value of the security count satisfies a given threshold value.
13. The accelerator processing system of claim 8 , wherein the method further comprises:
establishing a fully encrypted communication link with the server system in response to a user associated with the request for access to the given data set requesting a fully encrypted communication link.
14. A computer program product for accessing to data in an out-of-core processing environment, the computer program product comprising:
a non-transitory storage medium readable by a processing circuit of an accelerator system of the out-of-core processing environment and storing instructions for execution by the processing circuit for performing a method comprising:
sending a request to a server system for access to a given data set being managed by the server system;
receiving, based on sending the request, an access configuration from the server system for accessing the given data set; and
determining, based on the access configuration, that the given data set is to be accessed by one of
accessing the given data set directly from the server system,
locally storing a portion of the given data set in a memory and locally accessing the portion of the given data set, and
locally storing all of the given data set in the memory and locally accessing the given data set.
15. The computer program product of claim 14 , wherein the request is associated with an access context, the accessing context indicating to the server system one or more characteristics of an access operation associated with at least one of the accelerator system and a user system when accessing the given data set.
16. The computer program product of claim 14 , wherein the access configuration is one or a plurality of access configurations available for the accelerator system based on the access context that has been determined, wherein different access configurations are selected for one or more different access contexts.
17. The computer program product of claim 16 , wherein at least a first access configuration in the plurality of different access configurations configures the accelerator system differently than a second access configuration in the plurality of different access configurations.
18. The computer program product of claim 14 , wherein in response to determining that the given data set is to be accessed by locally storing one of the portion or all of the given data set,
maintaining a security counter for the given data set; and
removing the one of the portion or all of the given data set from the memory when a value of the security count satisfies a given threshold value.
19. The computer program product of claim 14 , wherein the method further comprises:
establishing a fully encrypted communication link with the server system in response to a user associated with the request for access to the given data set requesting a fully encrypted communication link.
20. The computer program product of claim 14 , wherein the method further comprises:
establishing a partially encrypted communication link with the server system to receive information associated with the given data set in response to determining that the given data set is to be accessed by locally storing one of a portion or all of the given data set, the partially encrypted communication link comprising a lower encryption strength than a fully encrypted communication link.