Coalescing write operations in a cloud-based storage system
Coalescing write operations in a cloud-based storage system including receiving, from a storage controller application of the cloud-based storage system, a first plurality of write operations, wherein each of the first plurality of write operations comprises a respective write to a storage volume; coalescing the first plurality of write operations into a plurality of coalesced write operations, wherein each of the coalesced write operations are configured to effect two or more of the first plurality of write operations; and performing the plurality of coalesced write operations on the storage volume.
1. A method comprising:
receiving, from a storage controller application of a cloud-based storage system, a first plurality of write operations, wherein each of the first plurality of write operations comprises a respective write to a storage volume associated with an Input/Output Operations per Second (IOPS) threshold defining a size limit and a number of operations per second that may be performed on the storage volume;
coalescing the first plurality of write operations into a plurality of coalesced write operations, wherein each of the first plurality of write operations is less than the size limit associated with the storage volume, and wherein coalescing the first plurality of write operations into the plurality of coalesced write operations comprises transforming the first plurality of write operations into coalesced write operations less than the size limit directed to adjacent addresses; and
performing the plurality of coalesced write operations on the storage volume.
2. The method of claim 1 , wherein performing the plurality of coalesced write operations comprises sending, to the storage volume, a single input/output control command for each coalesced write operation of the coalesced write operations.
3. The method of claim 1 , wherein receiving the first plurality of write operations comprises adding the first plurality of write operations to a queue.
4. The method of claim 3 further comprising determining,
based on a state of the queue and on the IOPS threshold, to coalesce the first plurality of write operations.
5. The method of claim 4 , wherein determining to coalesce the first plurality of write operations is further based on a determination that a size of the plurality of coalesced write operations is less than the size limit of the IOPS threshold.
6. The method of claim 1 , further comprising:
performing a second plurality of write operations on the storage volume upon determining not to coalesce the second plurality of write operations.
7. The method of claim 1 , wherein each of the first plurality of write operations comprises a non-volatile random access memory (NVRAM) write message, and wherein coalescing the first plurality of write operations comprises coalescing, into each of the plurality of coalesced write operations, two or more NVRAM write messages.
8. An apparatus comprising a computer processor, a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the apparatus to perform:
receiving, from a storage controller application of a cloud-based storage system, a first plurality of write operations, wherein each of the first plurality of write operations comprises a respective write to a storage volume associated with an Input/Output Operations per Second (IOPS) threshold defining a size limit and a number of operations per second that may be performed on the storage volume;
coalescing the first plurality of write operations into a plurality of coalesced write operations, wherein each of the first plurality of write operations is less than the size limit associated with the storage volume, and wherein coalescing the first plurality of write operations into the plurality of coalesced write operations comprises transforming the first plurality of write operations into coalesced write operations less than the size limit directed to adjacent addresses; and
performing the plurality of coalesced write operations on the storage volume.
9. The apparatus of claim 8 , wherein performing the plurality of coalesced write operations comprises sending, to the storage volume, a single input/output control command for each coalesced write operation of the coalesced write operations.
10. The apparatus of claim 8 , wherein receiving the first plurality of write operations comprises adding the first plurality of write operations to a queue.
11. The apparatus of claim 10 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to perform determining, based on a state of the queue and on the IOPS threshold, to coalesce the first plurality of write operations.
12. The apparatus of claim 11 , wherein determining to coalesce the first plurality of write operations is further based on a determination that a size of the plurality of coalesced write operations is less than the size limit of the IOPS threshold.
13. The apparatus of claim 8 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to perform:
performing a second plurality of write operations on the storage volume upon determining not to coalesce the second plurality of write operations.
14. The apparatus of claim 8 , wherein each of the first plurality of write operations comprises a non-volatile random access memory (NVRAM) write message, and wherein coalescing the first plurality of write operations comprises coalescing, into each of the plurality of coalesced write operations, two or more NVRAM write messages.
15. A computer program product disposed upon a non-transitory computer readable medium, the computer program product comprising computer program instructions that, when executed, cause a computer to perform:
receiving, from a storage controller application of a cloud-based storage system, a first plurality of write operations, wherein each of the first plurality of write operations comprises a respective write to a storage volume associated with an Input/Output Operations per Second (IOPS) threshold defining a size limit and a number of operations per second that may be performed on the storage volume;
coalescing the first plurality of write operations into a plurality of coalesced write operations, wherein each of the first plurality of write operations is less than the size limit associated with the storage volume, and wherein coalescing the first plurality of write operations into the plurality of coalesced write operations comprises transforming the first plurality of write operations into coalesced write operations less than the size limit directed to adjacent addresses; and
performing the plurality of coalesced write operations on the storage volume.
16. The computer program product of claim 15 , wherein performing the plurality of coalesced write operations comprises sending, to the storage volume, a single input/output control command for each coalesced write operation of the coalesced write operations.
17. The computer program product of claim 15 , wherein receiving the first plurality of write operations comprises adding the first plurality of write operations to a queue.
18. The computer program product of claim 17 further comprising computer program instructions that, when executed, cause the computer to perform determining, based on a state of the queue and on the IOPS threshold, to coalesce the first plurality of write operations.
19. The computer program product of claim 18 , wherein determining to coalesce the first plurality of write operations is further based on a determination that a size of the plurality of coalesced write operations is less than the size limit of the IOPS threshold.
20. The computer program product of claim 15 further comprising computer program instructions that, when executed, cause the computer to perform:
performing a second plurality of write operations on the storage volume upon determining not to coalesce the second plurality of write operations.