Techniques for storage management
Techniques for managing storage may comprise: receiving a request for a first amount of free capacity, wherein the request includes a first priority denoting a purpose for which the first amount of free capacity is requested; determining whether a current utilization of storage exceeds a first threshold associated with the first priority; responsive to determining the current utilization of storage is less than the first threshold associated with the first priority, performing first processing including: determining whether there is a sufficient amount of existing free capacity to grant the first amount; and responsive to determining there is a sufficient amount of existing free capacity to grant the first amount, granting the first amount of free capacity; and responsive to determining the current utilization of storage is not less than the first threshold associated with the first priority, rejecting the request and not granting the first amount of free capacity.
1. A method of managing storage comprising:
receiving a request for a first amount of free capacity, wherein the request includes a first priority denoting a purpose for which the first amount of free capacity is requested;
determining whether a current utilization of storage exceeds a first threshold associated with the first priority;
responsive to determining the current utilization of storage is less than the first threshold associated with the first priority, performing first processing including:
determining whether there is a sufficient amount of existing free capacity to grant the first amount; and
responsive to determining there is a sufficient amount of existing free capacity to grant the first amount, granting the first amount of free capacity; and
responsive to determining the current utilization of storage is not less than the first threshold associated with the first priority, rejecting the request and not granting the first amount of free capacity, wherein the request is a request for the first amount of free capacity from non-volatile physical storage devices providing backend storage in a data storage system, wherein the non-volatile physical storage devices providing backend storage in the data storage system includes a first portion configured as a user data pool for storing user data and a second portion configured as a metadata pool for storing metadata, and wherein the method further comprises:
determining that the data storage system is in a read only mode;
determining that the user data pool has a first current amount of free capacity below a specified threshold;
responsive to determining that the user data pool has the first current amount of free capacity below the specified threshold, shifting free capacity from the metadata pool to the user data pool to increase free capacity of the user data pool; and
in response to increasing free capacity of the user data pool, transitioning the data storage system out of read only mode so that the data storage system is able to service write requests.
2. The method of claim 1 , wherein the current utilization denotes a percentage regarding an amount of the physical storage of the non-volatile physical storage devices of the data storage system that is used or allocated.
3. The method of claim 2 , wherein the first threshold is one of a plurality of predetermined thresholds associated with a plurality of predetermined purposes or reasons for requesting free capacity, and wherein each of the plurality of predetermined thresholds is associated with a different one of a plurality of priorities, and wherein the plurality of priorities includes the first priority of the request.
4. The method of claim 3 , wherein the first threshold denotes a utilization threshold that is threshold percentage regarding an amount of the physical storage of the non-volatile physical storage devices of the data storage system that is used or allocated.
5. The method of claim 1 , wherein the metadata includes mapping information used to map logical addresses to physical locations on the non-volatile physical storage devices of the data storage system.
6. The method of claim 1 , wherein determining whether there is a sufficient amount of existing free capacity to grant the first amount includes determining that the user data pool includes a sufficient amount of existing free capacity to grant the first amount, and wherein the method includes granting the first amount using free capacity from the user data pool.
7. The method of claim 6 , wherein the user data pool is configured in accordance with a first RAID level and configuration and the metadata pool is configured in accordance with a second RAID level and configuration different from the first RAID level and configuration.
8. The method of claim 1 , wherein determining whether there is a sufficient amount of existing free capacity to grant the first amount includes determining that the metadata pool includes a sufficient amount of existing free capacity to grant the first amount, and wherein the method includes granting the first amount using free capacity from the metadata pool.
9. The method of claim 8 , wherein the user data pool and the metadata pool are configured in accordance with a same RAID level and configuration.
10. The method of claim 1 , wherein when in the read only mode, the data storage system only services read requests and does not service other requests that result in consumption of physical storage of the non-volatile physical storage devices providing backend storage in the data storage system.
11. The method of claim 1 , wherein when in the read only mode, the data storage system does not service write requests.
12. The method of claim 3 , wherein each of the plurality of predetermined thresholds denotes a different utilization threshold.
13. The method of claim 3 , the plurality of priorities is ranked from a highest priority to a lowest priority and wherein the highest priority is associated with a highest one of the plurality of predetermined thresholds and the lowest priority is associated with a lowest one of the plurality of predetermined thresholds.
14. A system comprising:
one or more processors; and
one or more memories comprising code stored thereon that, when executed, perform a method of managing storage comprising:
receiving a request for a first amount of free capacity, wherein the request includes a first priority denoting a purpose for which the first amount of free capacity is requested;
determining whether a current utilization of storage exceeds a first threshold associated with the first priority;
responsive to determining the current utilization of storage is less than the first threshold associated with the first priority, performing first processing including:
determining whether there is a sufficient amount of existing free capacity to grant the first amount; and
responsive to determining there is a sufficient amount of existing free capacity to grant the first amount, granting the first amount of free capacity; and
responsive to determining the current utilization of storage is not less than the first threshold associated with the first priority, rejecting the request and not granting the first amount of free capacity, wherein the request is a request for the first amount of free capacity from non-volatile physical storage devices providing backend storage in a data storage system, wherein the non-volatile physical storage devices providing backend storage in the data storage system includes a first portion configured as a user data pool for storing user data and a second portion configured as a metadata pool for storing metadata, and wherein the method further comprises:
determining that the data storage system is in a read only mode;
determining that the user data pool has a first current amount of free capacity below a specified threshold;
responsive to determining that the user data pool has the first current amount of free capacity below the specified threshold, shifting free capacity from the metadata pool to the user data pool to increase free capacity of the user data pool; and
in response to increasing free capacity of the user data pool, transitioning the data storage system out of read only mode so that the data storage system is able to service write requests.
15. A non-transitory computer readable medium comprising code stored thereon that, when executed, performs a method of managing storage comprising:
receiving a request for a first amount of free capacity, wherein the request includes a first priority denoting a purpose for which the first amount of free capacity is requested;
determining whether a current utilization of storage exceeds a first threshold associated with the first priority;
responsive to determining the current utilization of storage is less than the first threshold associated with the first priority, performing first processing including:
determining whether there is a sufficient amount of existing free capacity to grant the first amount; and
responsive to determining there is a sufficient amount of existing free capacity to grant the first amount, granting the first amount of free capacity; and
responsive to determining the current utilization of storage is not less than the first threshold associated with the first priority, rejecting the request and not granting the first amount of free capacity, wherein the request is a request for the first amount of free capacity from non-volatile physical storage devices providing backend storage in a data storage system, wherein the non-volatile physical storage devices providing backend storage in the data storage system includes a first portion configured as a user data pool for storing user data and a second portion configured as a metadata pool for storing metadata, and wherein the method further comprises:
determining that the data storage system is in a read only mode;
determining that the user data pool has a first current amount of free capacity below a specified threshold;
responsive to determining that the user data pool has the first current amount of free capacity below the specified threshold, shifting free capacity from the metadata pool to the user data pool to increase free capacity of the user data pool; and
in response to increasing free capacity of the user data pool, transitioning the data storage system out of read only mode so that the data storage system is able to service write requests.
16. The non-transitory computer readable medium of claim 15 , wherein the request is a request for the first amount of free capacity from non-volatile physical storage devices providing backend storage in a data storage system.
17. The non-transitory computer readable medium of claim 16 , wherein the current utilization denotes a percentage regarding an amount of the physical storage of the non-volatile physical storage devices of the data storage system that is used or allocated.