Consolidated write system and method
A method, computer program product, and computing system for receiving a plurality of discrete write requests on a first computing device until the end of a consolidation window; combining the plurality of discrete write requests received into a consolidated write request; and transmitting the consolidated write request to a second computing device.
1. A computer-implemented method comprising:
receiving a plurality of discrete write requests on a first computing device until a first occurrence of at least the end of a consolidation window and the plurality of discrete write requests received equals a discrete write request quantity limit;
combining the plurality of discrete write requests received into a consolidated write request;
transmitting the consolidated write request to a second computing device;
monitoring a total number of write requests received on the first computing device during an extended sampling window; and
dynamically adjusting the discrete write request quantity limit based on at least a comparison between the plurality of discrete write requests combined due to the discrete write request quantity limit in the total number of write requests compared to the plurality of discrete write requests combined due to the end of the consolidation window in the total number of write requests.
2. The computer-implemented method of claim 1 wherein the first computing device is a first storage appliance and the second storage device is a second storage appliance.
3. The computer-implemented method of claim 1 further comprising:
receiving the consolidated write request on the second computing device;
processing the consolidated write request to regenerate the plurality of discrete write requests; and
executing the plurality of discrete write requests on the second computing device.
4. The computer-implemented method of claim 1 wherein combining the plurality of discrete write requests into a consolidated write request includes:
confirming that the quantity of discrete write requests included in the plurality of discrete write requests does not exceed a discrete write request quantity limit.
5. The computer-implemented method of claim 4 wherein monitoring the total number of write requests received on the first computing device during an extended sampling window includes determining an average write request statistic.
6. The computer-implemented method of claim 5 further comprising:
adjusting the discrete write request quantity limit based, at least in part, upon the average write request statistic.
7. The computer-implemented method of claim 1 wherein combining the plurality of discrete write requests into a consolidated write request includes:
confirming that the size of the consolidated write request does not exceed a consolidated write request size limit.
8. A computer program product residing on a non-transitory computer readable medium having a plurality of instructions stored thereon which, when executed by a processor, cause the processor to perform operations comprising:
receiving a plurality of discrete write requests on a first computing device until a first occurrence of at least the end of a consolidation window and the plurality of discrete write requests received equals a discrete write request quantity limit;
combining the plurality of discrete write requests received into a consolidated write request;
transmitting the consolidated write request to a second computing device;
monitoring a total number of write requests received on the first computing device during an extended sampling window; and
dynamically adjusting the discrete write request quantity limit based on at least a comparison between the plurality of discrete write requests combined due to the discrete write request quantity limit in the total number of write requests compared to the plurality of discrete write requests combined due to the end of the consolidation window in the total number of write requests.
9. The computer program product of claim 8 wherein the first computing device is a first storage appliance and the second storage device is a second storage appliance.
10. The computer program product of claim 8 further comprising:
receiving the consolidated write request on the second computing device;
processing the consolidated write request to regenerate the plurality of discrete write requests; and
executing the plurality of discrete write requests on the second computing device.
11. The computer program product of claim 8 wherein combining the plurality of discrete write requests into a consolidated write request includes:
confirming that the quantity of discrete write requests included in the plurality of discrete write requests does not exceed a discrete write request quantity limit.
12. The computer program product of claim 11
wherein monitoring the total number of write requests received on the first computing device during an extended sampling window includes determining an average write request statistic.
13. The computer program product of claim 12 further comprising:
adjusting the discrete write request quantity limit based, at least in part, upon the average write request statistic.
14. The computer program product of claim 8 wherein combining the plurality of discrete write requests into a consolidated write request includes:
confirming that the size of the consolidated write request does not exceed a consolidated write request size limit.
15. A computing system including a processor and memory configured to perform operations comprising:
receiving a plurality of discrete write requests on a first computing device until a first occurrence of at least the end of a consolidation window and the plurality of discrete write requests received equals a discrete write request quantity limit;
combining the plurality of discrete write requests received into a consolidated write request;
transmitting the consolidated write request to a second computing device;
monitoring a total number of write requests received on the first computing device during an extended sampling window; and
dynamically adjusting the discrete write request quantity limit based on at least a comparison between the plurality of discrete write requests combined due to the discrete write request quantity limit in the total number of write requests compared to the plurality of discrete write requests combined due to the end of the consolidation window in the total number of write requests.
16. The computing system of claim 15 wherein the first computing device is a first storage appliance and the second storage device is a second storage appliance.
17. The computing system of claim 15 further comprising:
receiving the consolidated write request on the second computing device;
processing the consolidated write request to regenerate the plurality of discrete write requests; and
executing the plurality of discrete write requests on the second computing device.
18. The computing system of claim 15 wherein combining the plurality of discrete write requests into a consolidated write request includes:
confirming that the quantity of discrete write requests included in the plurality of discrete write requests does not exceed a discrete write request quantity limit.
19. The computing system of claim 18 wherein monitoring the total number of write requests received on the first computing device during an extended sampling window includes determining an average write request statistic.
20. The computing system of claim 19 further comprising:
adjusting the discrete write request quantity limit based, at least in part, upon the average write request statistic.
21. The computer-implemented method of claim 15 wherein combining the plurality of discrete write requests into a consolidated write request includes:
confirming that the size of the consolidated write request does not exceed a consolidated write request size limit.