Online system checkpoint alert and handling
View Patent ↗Described embodiments provide systems and methods for low disk space notification. Data modules maintain space usage counters for normal stripes and for checkpoint stripes. The data modules also monitor in use space counters; free space counters; and checkpoint space counters. A system wide total space is calculated, as well as in use space, free space and checkpoint space by aggregating worst case space usage from all data modules. A checkpoint free space ratio and an overall system free space ratio are determined and a checkpoint notification is triggered when the checkpoint free space ratio is lower than a first threshold or when the overall system free space ratio is lower than a second threshold. Upon a checkpoint notification being triggered, a checkpoint notification handling routine is executed to free up disk space.
1. A method for use in a storage system including a plurality of routing modules, a plurality of control modules, and a plurality of data modules, the method comprising:
for each of the plurality of data modules,
identifying a respective in-use space counter, a respective free space counter, and a respective checkpoint space counter that are maintained by the data module;
calculating a checkpoint free space ratio and an overall system free space ratio for the plurality of data modules by aggregating the respective in-use, free-space, and total-checkpoint space counters of the plurality of data modules;
triggering a checkpoint alert when the checkpoint free space ratio is lower than a first threshold or when the overall system free space ratio is lower than a second threshold, and performing checkpoint alert handling to free up space,
wherein each of the plurality of routing modules is configured to terminate storage operations and distribute at least parts of the storage operations to selected ones of the control modules,
wherein each of the plurality of control modules is configured to provide data associated with respective storage operations, or parts thereof, that are received at the control module to selected ones of the plurality of data modules, and
wherein each of the plurality of data modules is configured to determine a physical location for storing data received from any of the plurality of control modules and store the data at the determined physical location.
2. The method of claim 1 wherein calculating a checkpoint free space ratio and an overall system free space ratio includes calculating an amount of free space that can be used for host writes.
3. The method of claim 2 wherein calculating a checkpoint free space ratio and an overall system free space ratio includes calculating a remaining free storage in all types of normal stripes in the storage system.
4. The method of claim 2 wherein calculating the amount of free space includes calculating a remaining free storage in each of a plurality of checkpoint stripes in the storage system.
5. The method of claim 1 wherein calculating the checkpoint free space ratio or the overall system free space ratio includes calculating an in use space comprises subtracting a free space amount from a total space amount.
6. The method of claim 1 wherein calculating the checkpoint free space ratio or the overall system free space ratio includes calculating a total available storage in a RAID array.
7. The method of claim 1 wherein calculating the checkpoint free space ratio or the overall system free space ratio includes calculating a total available storage in a plurality of checkpoint stripes in the storage system.
8. A system comprising:
a processor; and
memory storing computer program code that when executed on the processor causes the processor to operate a storage system, the storage system operable to perform the operations of:
for each of a plurality of data modules in a storage system, identifying a respective in-use counter, a respective free space counter and a respective checkpoint space that are maintained by the data module;
calculating a checkpoint free space ratio and an overall system free space ratio for the plurality of data modules by aggregating the respective in-use, free-space, and total-checkpoint space counters of the plurality of data modules, wherein each of the plurality of data modules is configured to determine a physical location for storing data received from any of a plurality of control modules and store the data at the determined physical location, wherein each of the plurality of routing modules is conligured to terminate storage operations and distribute at least parts of the storage operations to selected ones of a plurality of control modules;
triggering a checkpoint alert when the checkpoint free space ratio is lower than a first threshold or when the overall system free space ratio is lower than a second threshold and performing checkpoint alert handling to free up space,
wherein each of the plurality of control modules is configured to provide data associated with respective storage operations, or parts thereof, that are received at the control module to selected ones of the plurality of data modules.
9. The system of claim 8 wherein calculating a checkpoint free space ratio and an overall system free space ratio includes calculating an amount of free space that can be used for host writes.
10. The system of claim 9 wherein calculating a checkpoint free space ratio and an overall system free space ratio calculating the amount of free space includes calculating a remaining free storage in all types of normal stripes in the storage system.
11. The system of claim 9 wherein calculating the amount of free space includes calculating a remaining free storage in each of a plurality of checkpoint stripes in the storage system.
12. The system of claim 8 wherein calculating the checkpoint free space ratio or the overall system free space ratio includes calculating the in-use space comprises subtracting a free space amount from a total space amount.
13. The system of claim 8 wherein calculating the checkpoint free space ratio or the overall system free space ratio includes calculating a total available storage in a RAID array.
14. The system of claim 8 wherein calculating the checkpoint free space ratio or the overall system free space ratio includes calculating a total available storage in a plurality of checkpoint stripes in the storage system.
15. A non-transitory computer-readable medium storing one or more processor-executable instructions, which when executed by at least one processor, causes the at least one processor to perform the operations of:
for each of a plurality of data modules, identifying a respective in-use space counter, a respective free space counter, and a respective checkpoint space counter that are maintained by the data module;
calculating a checkpoint free space ratio and an overall system free space ratio for the plurality of data modules by aggregating the respective in-use, free-space, and total-checkpoint space counters of the plurality of data modules;
triggering a checkpoint alert when the checkpoint free space ratio is lower than a first threshold or when the overall system free space ratio is lower than a second threshold, and performing checkpoint alert handling to free up space,
wherein each of the plurality of routing modules is configured to terminate storage operations and distribute at least parts of the storage operations to selected ones of a plurality of control modules,
wherein each of the plurality of control modules is configured to provide data associated with respective storage operations, or parts thereof, that are received at the control module to selected ones of the plurality of data modules, and
wherein each of the plurality of data modules is configured to determine a physical location for storing data received from any of the plurality of control modules and store the data at the determined physical location.