Hybrid segment-oriented file server and WAN accelerator
View Patent ↗In a network including WAN accelerators and segment-oriented file servers, a method comprises responding to a client request to manipulate a file via a network file protocol by receiving a first request at a first WAN accelerator, wherein the request is a request to open a file located at a file server that is a segment-oriented file server, sending a local request for the file, corresponding to the first request, from the WAN accelerator to the file server, using a segment-aware network request protocol, returning at least a portion of the requested file in the form of a representation of a data map corresponding to the at least a portion of the requested file stored on the file server and using a data map for reconstruction of the requested file.
1. A non-transitory storage medium storing instructions that, when executed by a hardware-based WAN accelerator coupled between one or more LAN clients and one or more file servers separated from the one or more LAN clients by a WAN, cause the hardware-based WAN accelerator to perform a method comprising:
receiving write requests from a client that are write requests for a file resident on a file server;
converting the write request data into changes to a data map associated with the file and segments of data referenced by the data map, wherein the data map comprises a collection of names of the segments of data, and wherein the collection of names specifies at least some of the content stored in the file;
conveying the changed data map to the file server using a file server protocol and receiving an acknowledgement of the commit of the data map from the file server, wherein the file server stores the changed data map;
conveying the changed segments of data to the file server and receiving an acknowledgement of the commit of the changed segments of data; and
signaling to the client making the write requests or other LAN clients that the file has been committed to the file server, wherein the signaling occurs after receiving the acknowledgement of the commit of the data map from the file server, but before receiving an acknowledgement of the commit of the changed segments of data.
2. The non-transitory storage medium of claim 1 , further comprising logic for providing a second client with the file being written by providing the data map from the file server and the segments of data from a local segment store.
3. The non-transitory storage medium of claim 1 , wherein multiple occurrences of a given segment of data in a file is represented by multiple occurrences of the name of the segment of data in the data map associated with the file.
4. A method, comprising:
the hardware-based WAN accelerator receiving write requests from a client that are write requests for a file resident on a file server;
the hardware-based WAN accelerator converting the write request data into changes to a data map associated with the file and segments of data referenced by the data map, wherein the data map comprises a collection of names of the segments of data, and wherein the collection of names specifies at least some of the content stored in the file;
the hardware-based WAN accelerator conveying the changed data map to the file server using a file server protocol and receiving an acknowledgement of the commit of the data map from the file server, wherein the file server stores the changed data map;
the hardware-based WAN accelerator conveying the changed segments of data to the file server and receiving an acknowledgement of the commit of the changed segments of data; and
the hardware-based WAN accelerator signaling to the client making the write requests or other LAN clients that the file has been committed to the file server, wherein the signaling occurs after receiving the acknowledgement of the commit of the data map from the file server, but before receiving an acknowledgement of the commit of the changed segments of data.
5. The method of claim 4 , further comprising providing a second client with the file being written by providing the data map from the file server and the segments of data from a local segment store.
6. The method of claim 4 , wherein multiple occurrences of a given segment of data in a file is represented by multiple occurrences of the name of the segment of data in the data map associated with the file.
7. An apparatus, comprising:
a processor; and
a non-transitory storage medium storing instructions that, when executed by the processor, cause the processor to perform a method, comprising:
receiving write requests from a client that are write requests for a file resident on a file server;
converting the write request data into changes to a data map associated with the file and segments of data referenced by the data map, wherein the data map comprises a collection of names of the segments of data, and wherein the collection of names specifies at least some of the content stored in the file;
conveying the changed data map to the file server using a file server protocol and receiving an acknowledgement of the commit of the data map from the file server, wherein the file server stores the changed data map;
conveying the changed segments of data to the file server and receiving an acknowledgement of the commit of the changed segments of data; and
signaling to the client making the write requests or other LAN clients that the file has been committed to the file server, wherein the signaling occurs after receiving the acknowledgement of the commit of the data map from the file server, but before receiving an acknowledgement of the commit of the changed segments of data.
8. The hardware-based WAN accelerator of claim 7 , wherein the method further comprises providing a second client with the file being written by providing the data map from the file server and the segments of data from a local segment store.
9. The hardware-based WAN accelerator of claim 7 , wherein multiple occurrences of a given segment of data in a file is represented by multiple occurrences of the name of the segment of data in the data map associated with the file.