Forwarding metadata proxy server for asynchronous metadata operations
View Patent ↗In one example, a method is performed by an MDS proxy and includes receiving a remote procedure call (RPC) from a client agent, recording the RPC in a log, sending an acknowledgement of the RPC to the client agent, and scheduling the RPC for transmission to a metadata server (MDS). A time elapsed between transmission of the RPC by the client agent and receipt, by the client agent of the acknowledgement transmitted by the MDS proxy, defines a perceived latency from a perspective of the client agent.
1. A method, comprising:
performing the following processes with a metadata server (MDS) proxy:
receiving a remote procedure call (RPC) from a client agent;
recording the RPC in a log;
sending an acknowledgement of the RPC to the client agent;
scheduling the RPC for transmission to a metadata server (MDS);
forwarding the scheduled RPC to the MDS by way of an RPC client;
receiving, from the MDS, metadata corresponding to the RPC; and
transmitting the metadata to the client agent.
2. The method as recited in claim 1 , wherein a time elapsed between transmission of the RPC by the client agent and receipt, by the client agent of the acknowledgement transmitted by the MDS proxy, comprises a perceived latency from a perspective of the client agent.
3. The method as recited in claim 1 , wherein the RPC concerns a filesystem request received by an application.
4. The method as recited in claim 1 , wherein the MDS proxy and the client agent are physically and/or logically co-located.
5. The method as recited in claim 1 , wherein
the MDS proxy exposes an interface to the client agent and communicates with the client agent by way of that interface.
6. The method as recited in claim 1 , wherein the MDS proxy asynchronously forwards the scheduled RPC to the MDS after the RPC is completed and registered in the MDS proxy.
7. The method as recited in claim 1 , wherein the RPC is received from the client agent asynchronously with respect to an RPC previously, or subsequently, received by the MDS proxy from the client agent.
8. The method as recited in claim 1 , wherein the RPC concerns one of the following metadata operations: create new file; rename; delete; or query file attributes.
9. The method as recited in claim 1 , wherein processes performed by the MDS proxy further comprise receiving a plurality of asynchronous RPCs.
10. The method as recited in claim 1 , wherein the acknowledgement of the RPC is transmitted by the MDS proxy to the client agent immediately after the MDS proxy receives the RPC.
11. An MDS proxy comprising:
one or more hardware processors; and
a non-transitory storage medium having stored therein computer-executable instructions which, when executed by the one or more hardware processors, perform the following processes:
receiving a remote procedure call (RPC) from a client agent;
recording the RPC in a log;
sending an acknowledgement of the RPC to the client agent;
scheduling the RPC for transmission to a metadata server (MDS);
forwarding the scheduled RPC to the MDS by way of an RPC client;
receiving, from the MDS, metadata corresponding to the RPC; and
transmitting the metadata to the client agent.
12. The MDS proxy as recited in claim 11 , wherein a time elapsed between transmission of the RPC by the client agent and receipt, by the client agent of the acknowledgement transmitted by the MDS proxy, comprises a perceived latency from a perspective of the client agent.
13. The MDS proxy as recited in claim 11 , wherein the RPC concerns a filesystem request received by an application.
14. The MDS proxy as recited in claim 11 , wherein the MDS proxy and the client agent are physically and/or logically co-located.
15. The MDS proxy as recited in claim 11 , wherein
the MDS proxy exposes an interface to the client agent and communicates with the client agent by way of that interface.
16. The MDS proxy as recited in claim 11 , wherein the MDS proxy asynchronously forwards the scheduled RPC to the MDS after the RPC is completed and registered in the MDS proxy.
17. The MDS proxy as recited in claim 11 , wherein the RPC is received from the client agent asynchronously with respect to an RPC previously, or subsequently, received by the MDS proxy from the client agent.
18. The MDS proxy as recited in claim 11 , wherein the RPC concerns one of the following metadata operations: create new file; rename; delete; or query file attributes.
19. The MDS proxy as recited in claim 11 , wherein processes performed by the MDS proxy further comprise receiving a plurality of asynchronous RPCs.
20. The MDS proxy as recited in claim 11 , wherein the acknowledgement of the RPC is transmitted by the MDS proxy to the client agent immediately after the MDS proxy receives the RPC.