Servicing write operations in a cloud-based storage system
Coalescing write operations in a cloud-based storage system including receiving, from a storage controller application of the cloud-based storage system, a first plurality of write operations, wherein each of the first plurality of write operations comprises a respective write to a storage volume; coalescing the first plurality of write operations into a plurality of coalesced write operations, wherein each of the coalesced write operations are configured to effect two or more of the first plurality of write operations; and performing the plurality of coalesced write operations on the storage volume.
1. A method comprising:
receiving, by a cloud-based storage system, a plurality of write operations;
coalescing, by the cloud-based storage system and for two or more of the write operations that represent an instruction to write an amount of data that is smaller than a predetermined size threshold, the two or more write operations into one or more coalesced write operations, wherein one or more of the plurality of write operations that represents an instruction to write data that is equal to or larger than the predetermined size threshold is not included in the coalesced write operations; and
performing, by the cloud-based storage system, the plurality of coalesced write operations and the one or more write operation that are not included in the coalesced write operations.
2. The method of claim 1 , wherein performing the plurality of coalesced write operations comprises sending, to the storage volume, a single input/output control command for each coalesced write operation of the coalesced write operations.
3. The method of claim 1 , wherein receiving the first plurality of write operations comprises adding the first plurality of write operations to a queue.
4. The method of claim 3 further comprising determining, based on a state of the queue, to coalesce the first plurality of write operations.
5. The method of claim 4 , wherein determining to coalesce the first plurality of write operations is further based on an Input/Output Operations per Second (IOPS) threshold.
6. The method of claim 1 , further comprising:
receiving a second plurality of write operations;
determining not to coalesce the second plurality of write operations; and
performing the second plurality of write operations on the storage volume.
7. The method of claim 1 , wherein each of the first plurality of write operations comprises a write message, and wherein coalescing the first plurality of write operations comprises coalescing, into each of the plurality of coalesced write operations, two or more write messages.
8. An apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
receiving, by a cloud-based storage system, a plurality of write operations;
coalescing, by the cloud-based storage system and for two or more of the write operations that represent an instruction to write an amount of data that is smaller than a predetermined size threshold, the two or more write operations into one or more coalesced write operations, wherein one or more of the plurality of write operations that represents an instruction to write data that is equal to or larger than the predetermined size threshold is not included in the coalesced write operations; and
performing, by the cloud-based storage system, the plurality of coalesced write operations and the one or more write operation that are not included in the coalesced write operations.
9. The apparatus of claim 8 , wherein performing the plurality of coalesced write operations comprises sending, to the storage volume, a single input/output control command for each coalesced write operation of the coalesced write operations.
10. The apparatus of claim 8 , wherein receiving the first plurality of write operations comprises adding the first plurality of write operations to a queue.
11. The apparatus of claim 10 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of determining, based on a state of the queue, to coalesce the first plurality of write operations.
12. The apparatus of claim 11 , wherein determining to coalesce the first plurality of write operations is further based on an Input/Output Operations per Second (IOPS) threshold.
13. The apparatus of claim 8 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:
receiving a second plurality of write operations;
determining not to coalesce the second plurality of write operations; and
performing the second plurality of write operations on the storage volume.
14. The apparatus of claim 8 , wherein each of the first plurality of write operations comprises a write message, and wherein coalescing the first plurality of write operations comprises coalescing, into each of the plurality of coalesced write operations, two or more write messages.
15. A computer program product disposed upon a non-transitory computer readable medium, the computer program product comprising computer program instructions that, when executed, cause a computer to carry out the steps of:
receiving, by a cloud-based storage system, a plurality of write operations;
coalescing, by the cloud-based storage system and for two or more of the write operations that represent an instruction to write an amount of data that is smaller than a predetermined size threshold, the two or more write operations into one or more coalesced write operations, wherein one or more of the plurality of write operations that represents an instruction to write data that is equal to or larger than the predetermined size threshold is not included in the coalesced write operations; and
performing, by the cloud-based storage system, the plurality of coalesced write operations and the one or more write operation that are not included in the coalesced write operations.
16. The computer program product of claim 15 , wherein performing the plurality of coalesced write operations comprises sending, to the storage volume, a single input/output control command for each coalesced write operation of the coalesced write operations.
17. The computer program product of claim 15 , wherein receiving the first plurality of write operations comprises adding the first plurality of write operations to a queue.
18. The computer program product of claim 17 further comprising computer program instructions that, when executed, cause the computer to carry out the steps of determining, based on a state of the queue, to coalesce the first plurality of write operations.
19. The computer program product of claim 18 , wherein determining to coalesce the first plurality of write operations is further based on an Input/Output Operations per Second (IOPS) threshold.
20. The computer program product of claim 15 further comprising computer program instructions that, when executed, cause the computer to carry out the steps of:
receiving a second plurality of write operations;
determining not to coalesce the second plurality of write operations; and
performing the second plurality of write operations on the storage volume.