Pre-registering memory regions for remote direct memory access in a distributed file system

1. A method comprising:

pre-registering, at a client device, one or more input/output (IO) buffers for a remote direct memory access (RDMA) interface at the client device, wherein pre-registering comprises specifying multiple levels of access for the one or more IO buffers due to a level of access for the IO buffers determined in view of a level of access subsequently used by an application executed by the client device, wherein the level of access is unknown at a time the IO buffers are pre-registered;

responsive to pre-registering the one or more IO buffers at the client device, providing the application executed by the client device with access to a distributed file system through the RDMA interface;

determining whether data of a requested file in the distributed file system has been designated for caching;

responsive to determining that the data of the requested file in the distributed file system has been designated for caching, designating a first IO buffer among the IO buffers as a cache for the data of the file; and

receiving, via the RDMA interface and from the distributed file system, the data of the file for the first IO buffer.

2. The method of claim 1 , wherein the one or more IO buffers are pre-registered during initialization of the RDMA interface.

3. The method of claim 1 , wherein the one or more IO buffers comprise a plurality of IO buffers that comprise a first set of IO buffers designated for caching data received from the distributed file system and a second set of IO buffers that are not designated for caching the data received from the distributed file system, and wherein the first set of IO buffers comprises the first IO buffer.

4. The method of claim 3 , wherein the data of the file received for the first IO buffer is used for a subsequent request to access the file from the client device, and wherein the method further comprises determining that the data of the file in the first IO buffer relative to the data of the file in the distributed file system has not changed prior to using the data of the file in the first IO buffer.

5. The method of claim 1 , further comprising:

receiving a request to access the file in the distributed file system from the application at the client device, wherein the request to access the file comprises a system call or a file operation of an operating system, and wherein the system call or the file operation accesses a virtual file system.

6. A system comprising:

a remote direct memory access (RDMA) interface at a client device;

a memory, at the client device, comprising multiple memory regions; and

a processing device, at the client device, to communicate with the RDMA interface and the memory, the processing device to:

pre-register a plurality of input/output (IO) buffers for the RDMA interface at the client device;

responsive to pre-registering the plurality of IO buffers at the client device, provide an application executed by the client device with access to a distributed file system through the RDMA interface;

determine whether data of a requested file in the distributed file system has been designated for caching;

responsive to determining that the data of the requested file in the distributed file system has been designated for caching;

designate a first IO buffer among the plurality of IO buffers as a cache for the data of the file, wherein the first IO buffer is included in a first set of IO buffers of the plurality of IO buffers that are designated for caching data received from the distributed file system; and

receive, via the RDMA interface and from the distributed file system, the data of the file for the first IO buffer; and

responsive to determining that the data of the requested file in the distributed file system has not been designated for caching, cause the data of the file to be stored in a second IO buffer among the plurality of IO buffers, wherein the second IO buffer is included in a second set of IO buffers of the plurality of IO buffers that are not designated for caching data received from the distributed file system.

7. The system of claim 6 , wherein at least one of the plurality of IO buffers is pre-registered during initialization of the RDMA interface.

8. The system of claim 6 , wherein the data of the file received for the first IO buffer is used for a subsequent request to access the file from the client device, and wherein the processing device is further to:

determine that the data of the file in the first IO buffer relative to the data of the file in the distributed file system has not changed prior to using the data of the file in the first IO buffer.

9. The system of claim 6 , wherein pre-registering comprises specifying multiple levels of access for the plurality of IO buffers due to a level of access for the plurality of IO buffers, wherein the level of access for the plurality of IO buffers is determined in view of a level of access subsequently used by the application not yet being known at a time the plurality of IO buffers are pre-registered.

10. A non-transitory, computer readable medium having instructions that, when executed by a processing device, cause the processing device to:

pre-register, at a client device, a plurality of input/output (IO) buffers for a remote direct memory access (RDMA) interface at the client device;

responsive to pre-registering the plurality of IO buffers at the client device, provide an application executed by the client device with access to a distributed file system through the RDMA interface;

determine whether data of a requested file in the distributed file system has been designated for caching;

responsive to determining that the data of the requested file in the distributed file system has been designated for caching;

designate a first IO buffer among the plurality of IO buffers as a cache for the data of the file, wherein the first IO buffer is included in a first set of IO buffers of the plurality of IO buffers that are designated for caching data received from the distributed file system; and

receive, via the RDMA interface and from the distributed file system, the data of the file for the first IO buffer; and

responsive to determining that the data of the requested file in the distributed file system has not been designated for caching, cause the data of the file to be stored in a second IO buffer among the plurality of IO buffers, wherein the second IO buffer is included in a second set of IO buffers of the plurality of IO buffers that are not designated for caching data received from the distributed file system.

11. The non-transitory, computer readable medium of claim 10 , wherein at least one of the plurality of IO buffers is pre-registered during initialization of the RDMA interface.

12. The non-transitory, computer readable medium of claim 10 , wherein the data of the file received for the first IO buffer is used for a subsequent request to access the file from the client device, and wherein the processing device is further to:

determine that the data of the file in the first IO buffer relative to the data of the file in the distributed file system has not changed prior to using the data of the file in the first IO buffer.

13. The non-transitory, computer readable medium of claim 10 , wherein pre-registering comprises specifying multiple levels of access for the plurality of IO buffers, wherein the level of access for the plurality of IO buffers is determined in view of a level of access for the plurality of IO buffers due to a level of access subsequently used by the application not yet being known at a time the plurality of IO buffers are pre-registered.

14. The non-transitory, computer readable medium of claim 10 , wherein the processing device is further to:

receive a request to access the file in the distributed file system from the application at the client device, wherein the request to access the file comprises a system call or a file operation of an operating system, and wherein the system call or the file operation accesses a virtual file system.