Management of file system requests in a distributed storage system
View Patent ↗A first computing device is part of a distributed electronic storage system (DESS) that also comprises one or more second computing devices. The first computing device comprises client process circuitry and DESS interface circuitry. The DESS interface circuitry is operable to: receive, from client process circuitry of the first computing device, a first client file system request that requires accessing a storage resource on one or more of the second computing devices; determine resources required for servicing of the first client file system request; generate a plurality of DESS file system requests for the first file system request; and transmit the plurality of DESS file system requests onto the one or more network links. How many such DESS file system requests are generated is determined based on the resources required for servicing the first client file system request.
1. A system comprising:
a first computing device of a distributed electronic storage system (DESS) that comprises the first computing device and one or more second computing devices that are communicatively coupled during operation via one or more network links, the first computing device comprising:
client process circuitry operable to generate client file system requests for a file system of the DESS; and
DESS interface circuitry operable to:
receive, from the client process circuitry, a first client file system request and a second client file system request, wherein the first client file system request and the second client file system request require accessing a storage resource on one or more of the second computing devices;
determine resources required for servicing of the first client file system request;
determine characteristics of the second client file system request;
determine a rate of client file system requests according to the receipt of the first client file system request, the second client file system request, and one or more previous client file system requests;
predicting a state of the DESS according to the resources required for servicing the current first client file system request, the characteristics of the second client file system request, and the rate of client file system requests;
generate a plurality of DESS file system requests for the first file system request, wherein how many of the DESS file system requests are in the plurality of DESS file system requests is determined based on the predicted state of the DESS; and
transmit the plurality of DESS file system requests onto the one or more network links.
2. The system of claim 1 , wherein the determination of resources required for servicing the first client file system request comprises a determination of an amount of information to be read or written during servicing of the client file system request.
3. The system of claim 1 , wherein:
the first client file system request is a request to write data to the file system; and
the determination of resources required for servicing the first client file system request comprises a determination of the size of the information to be written.
4. The system of claim 1 , wherein:
the DESS interface circuitry is operable to determine a level of congestion of the DESS; and
how many of the DESS file system requests are in the plurality of DESS file system requests is determined based on the level of congestion of the DESS.
5. The system of claim 4 , wherein the determination of the level of congestion of the DESS comprises a determination of a load on one or more resources of the DESS.
6. The system of claim 5 , wherein the one or more resources comprises one or more of: processor resources, memory resources, storage resources, and networking resources.
7. The system of claim 1 , wherein how many of the DESS file system requests are in the plurality of DESS file system requests is determined based on whether the second client file system request is a data request or metadata request.
8. The system of claim 1 , wherein the characteristics of the second client file system request comprise the size of the second client file system request.
9. One or more non-transitory machine-readable storage medium having code stored thereon, that, when executed by a first computing device of a distributed electronic storage system (DESS) that comprises the first computing device and one or more second computing devices communicatively coupled during operation via one or more network links, configures the first computing device to comprise DESS interface circuitry that is operable to:
receive, from client process circuitry of the first computing device, a first client file system request and a second client file system request, wherein the first client file system request and the second client file system request require accessing a storage resource on one or more of the second computing devices;
determine resources required for servicing of the first client file system request;
determine characteristics of the second client file system request;
determine a rate of client file system requests according to the receipt of the first client file system request, the second client file system request, and one or more previous client file system requests;
predicting a state of the DESS according to the resources required for servicing the current first client file system request, the characteristics of the second client file system request, and the rate of client file system requests;
generate a plurality of DESS file system requests corresponding to the first file system request, wherein how many of the DESS file system requests are in the plurality of DESS file system requests is determined based on the predicted state of the DESS; and
transmit the plurality of DESS file system requests onto the one or more network links.
10. The one or more non-transitory machine-readable medium of claim 9 , wherein the determination of resources required for servicing the first client file system request comprises a determination of an amount of information to be read or written during servicing of the client file system request.
11. The one or more non-transitory machine-readable medium of claim 9 , wherein:
the first client file system request is a request to write data to the file system; and
the determination of resources required for servicing the first client file system request comprises a determination of the size of the information to be written.
12. The one or more non-transitory machine-readable medium of claim 9 , wherein:
the DESS interface circuitry is operable to determine a level of congestion of the DESS; and
how many of the DESS file system requests are in the plurality of DESS file system requests is determined based on the level of congestion of the DESS.
13. The one or more non-transitory machine-readable medium of claim 12 , wherein the determination of the level of congestion of the DESS comprises a determination of a load on one or more resources of the DESS.
14. The one or more non-transitory machine-readable medium of claim 13 , wherein the one or more resources comprises one or more of: processor resources, memory resources, storage resources, and networking resources.
15. The one or more non-transitory machine-readable medium of claim 9 , wherein how many of the DESS file system requests are in the plurality of DESS file system requests is determined based on whether the second client file system request is a data request or metadata request.
16. The one or more non-transitory machine-readable medium of claim 9 , wherein the characteristics of the second client file system request comprise the size of the second client file system request.