Method and apparatus for determining and depicting effective storage capacity of a storage system
A method of determining and depicting an effective storage capacity of a storage system includes determining a storage-based limit of effective storage capacity and a metadata-based limit of effective storage capacity. The storage-based limit is based on an amount of unused capacity of a set of managed drives and a data reduction ratio achieved when host data is reduced prior to storage on the set of managed drives. Data reduction may include compression, deduplication, and pattern detection operations. The metadata-based limit is based on a volume of metadata that has been generated by the data, and the data reduction operations, in connection with writing the data to the set of managed drives, and based on an amount of memory allocated to storing the metadata. The effective storage capacity, actual storage usage, and data reduction ratio are graphically depicted over time to enable changes to these parameters to be visualized.
1. A non-transitory tangible computer readable storage medium having stored thereon a computer program for implementing a method of determining and depicting effective storage capacity of a storage system, the computer program including a set of instructions which, when executed by a computer, cause the computer to perform a method comprising the steps of:
writing host data, by hosts, on a set of host devices;
providing the host data, by the host devices, to a storage system for storage on a set of managed drives;
implementing data reduction operations on the host data, by the storage system, to create a reduced volume of data from the host data;
writing the reduced volume of data to the set of managed drives;
generating metadata, by the storage system, associated with the reduced volume of data;
determining a storage-based limit of effective storage capacity of the host devices based on an amount of capacity of the set of managed drives and a data reduction ratio, the data reduction ratio being a ratio between a size of the host data written by the hosts to the host devices and a size of the reduced volume of data written by the storage system to the set of managed drives;
determining a metadata-based limit of effective storage capacity of the host device based on an amount of the metadata generated by the storage system and an amount of memory allocated to storing the metadata on the storage system; and
setting an effective storage capacity of the storage system as a lesser of the storage-based limit of effective storage capacity or metadata-based limit of effective storage capacity.
2. The non-transitory tangible computer readable storage medium of claim 1 , wherein the data reduction operations include compression, deduplication, and pattern detection.
3. The non-transitory tangible computer readable storage medium of claim 1 , wherein the host data includes a first portion of host data that is reducible and a second portion of host data that is unreducible or on which data reduction has been disabled, and wherein the step of implementing data reduction operations on the host data is implemented, by the storage system, only on the first portion of host data.
4. The non-transitory tangible computer readable storage medium of claim 1 , wherein the metadata contains information mapping volumes of host data to locations on the sets of managed drives and contains information about data reduction operations implemented on the host data.
5. The non-transitory tangible computer readable storage medium of claim 1 , further comprising displaying, via a graphical user interface of a storage system management application, a graph of the output effective storage capacity over time and a graph of the data reduction rate over time.
6. The non-transitory tangible computer readable storage medium of claim 5 , further comprising determining an amount of host data provided by the hosts to the storage system, and displaying the amount of host data provided by the hosts to the storage system over time in the graphical user interface.
7. The non-transitory tangible computer readable storage medium of claim 6 , wherein the amount of host data provided by the hosts to the storage system is displayed in the graph of the output effective storage capacity over time.
8. The non-transitory tangible computer readable storage medium of claim 5 , wherein the graph of the output effective storage capacity over time and the graph of the data reduction rate over time have the same time scale.
9. The non-transitory tangible computer readable storage medium of claim 8 , further comprising generating and displaying a slide bar spanning between the graph of the output effective storage capacity over time and the graph of the data reduction rate over time, the slide bar being a movable element in the graphical user interface.
10. A storage system, comprising:
a front-end adapter to receive host data written by hosts on a set of host devices for storage in the storage system;
a data reduction engine to implement data reduction operations on the host data to create a reduced volume of data from the host data;
a set of managed drives to store the reduced volume of data;
a memory configured to store metadata associated with the reduced volume of data; and
a storage system management application having a projected effective capacity analysis engine containing control logic configured to determine and depict an effective storage capacity of the set of managed drives, the control logic being configured to:
determine a storage-based limit of effective storage capacity of the host devices based on an amount of capacity of the set of managed drives and a data reduction ratio, the data reduction ratio being a ratio between a size of the host data written by the hosts to the host devices and a size of the reduced volume of data written by the storage system to the set of managed drives;
determine a metadata-based limit of effective storage capacity of the host device based on an amount of the metadata generated by the storage system and an amount of the memory allocated on the storage system to storing the metadata; and
set an effective storage capacity of the storage system as a lesser of the storage-based limit of effective storage capacity or metadata-based limit of effective storage capacity.
11. The storage system of claim 10 , wherein the data reduction operations include compression, deduplication, and pattern detection.
12. The storage system of claim 10 , wherein the host data includes a first portion of host data that is reducible and a second portion of host data that is unreducible or on which data reduction has been disabled, and wherein the data reduction engine implements data reduction operations only on the first portion of host data.
13. The storage system of claim 10 , wherein the metadata contains information mapping volumes of host data to locations on the sets of managed drives and contains information about data reduction operations implemented on the host data.
14. The storage system of claim 10 , wherein the storage system management application further comprises a graphical user interface configured to depict a graph of the output effective storage capacity over time and a graph of the data reduction rate over time.
15. The storage system of claim 14 , wherein the storage system management application contains control logic to determine an amount of host data provided by the hosts to the storage system, and the graphical user interface is configured to depict the amount of host data provided by the hosts to the storage system over time.
16. The storage system of claim 15 , wherein the graphical user interface is configured to display the amount of host data provided by the hosts to the storage system in the graph of the output effective storage capacity over time.
17. The storage system of claim 14 , wherein the graph of the output effective storage capacity over time and the graph of the data reduction rate over time have the same time scale.
18. The storage system of claim 17 , wherein the graphical user interface is configured to display a slide bar spanning between the graph of the output effective storage capacity over time and the graph of the data reduction rate over time, the slide bar being a movable element in the graphical user interface.