Forwarding metadata proxy server for asynchronous metadata operations
In one example, a method is performed by a client agent and includes receiving a metadata request from an application, generating a remote procedure call (RPC) that identifies metadata requested by the application, transmitting the RPC to a metadata server (MDS) proxy, receiving, from the MDS proxy, an acknowledgement that the RPC has been received and logged, receiving metadata identified in the RPC, and providing the metadata to the application.
1. A method, comprising:
performing, with a client agent, operations comprising:
receiving a metadata request from an application;
generating a remote procedure call (RPC) that identifies metadata requested by the application;
performing, after the RPC is generated, a check to determine if asynchronous transmission of the RPC to a metadata server (MDS) proxy can proceed;
transmitting the RPC to the metadata server (MDS) proxy;
receiving, from the MDS proxy, an acknowledgement that the RPC has been received and logged;
receiving metadata identified in the RPC; and
providing the metadata to the application.
2. The method as recited in claim 1 , wherein the metadata request concerns an operation to be performed by the application.
3. The method as recited in claim 1 , wherein the operations further comprise:
asynchronously transmitting the RPC to the MDS proxy when it is determined that there is no impediment to such transmission; or
holding the RPC when it is determined that there is an impediment to asynchronous transmission of the RPC.
4. The method as recited in claim 1 , wherein a file lease mechanism is used to determine if asynchronous transmission of the RPC to the MDS proxy can proceed.
5. The method as recited in claim 1 , wherein the metadata is received from an MDS by way of the MDS proxy.
6. The method as recited in claim 1 , wherein a latency perceived by the application is an amount of time that has elapsed between transmission of the RPC to the MDS proxy, and receipt of the acknowledgement from the MDS proxy.
7. The method as recited in claim 1 , wherein the operations further comprise exposing a file system interface to the application.
8. The method as recited in claim 1 , wherein the RPC is initiated with incomplete data.
9. The method as recited in claim 1 , wherein the RPC is an asynchronous RPC.
10. A non-transitory storage medium having stored therein instructions that are executable by one or more hardware processors to:
perform, with a client agent, operations comprising:
receiving a metadata request from an application;
generating a remote procedure call (RPC) that identifies metadata requested by the application;
performing, after the RPC is generated, a check to determine if asynchronous transmission of the RPC to a metadata server (MDS) proxy can proceed;
transmitting the RPC to the metadata server (MDS) proxy;
receiving, from the MDS proxy, an acknowledgement that the RPC has been received and logged;
receiving metadata identified in the RPC; and
providing the metadata to the application.
11. The non-transitory storage medium as recited in claim 10 , wherein the metadata request concerns an operation to be performed by the application.
12. The non-transitory storage medium as recited in claim 10 , wherein the operations further comprise:
asynchronously transmitting the RPC to the MDS proxy when it is determined that there is no impediment to such transmission; or
holding the RPC when it is determined that there is an impediment to asynchronous transmission of the RPC.
13. The non-transitory storage medium as recited in claim 10 , wherein a file lease mechanism is used to determine if asynchronous transmission of the RPC to the MDS proxy can proceed.
14. The non-transitory storage medium as recited in claim 10 , wherein the metadata is received from an MDS by way of the MDS proxy.
15. The non-transitory storage medium as recited in claim 10 , wherein a latency perceived by the application is an amount of time that has elapsed between transmission of the RPC to the MDS proxy, and receipt of the acknowledgement from the MDS proxy.
16. The non-transitory storage medium as recited in claim 10 , wherein the operations further comprise exposing a file system interface to the application.
17. The non-transitory storage medium as recited in claim 10 , wherein the RPC is initiated with incomplete data.
18. The non-transitory storage medium as recited in claim 10 , wherein the RPC is an asynchronous RPC.
19. A system, comprising:
one or more hardware processors; and
a non-transitory storage medium having stored therein instructions that are executable by the one or more hardware processors to:
perform, with a client agent, operations comprising:
receiving a metadata request from an application;
generating a remote procedure call (RPC) that identifies metadata requested by the application;
performing, after the RPC is generated, a check to determine if asynchronous transmission of the RPC to a metadata server (MDS) proxy can proceed;
transmitting the RPC to the metadata server (MDS) proxy;
receiving, from the MDS proxy, an acknowledgement that the RPC has been received and logged;
receiving metadata identified in the RPC; and
providing the metadata to the application.
20. The system as recited in claim 19 , wherein the operations further comprise:
asynchronously transmitting the RPC to the MDS proxy when it is determined that there is no impediment to such transmission; or
holding the RPC when it is determined that there is an impediment to asynchronous transmission of the RPC.