Method and system for monitoring and analyzing quality of service in a metro-cluster
Methods and systems for inter-cluster storage system monitoring and analysis are provided. The method includes monitoring a non-volatile memory delay center for a first storage cluster having a first node and a second node configured to operate as a first high availability pair, where data for a write request to write data to the first node is also written to the second node as well as to a second cluster having a third node and a fourth node, where the third node and the fourth node are also configured to operate as a second high availability pair to store the data for the write request at one or both of the third and fourth node. The non-volatile memory delay center is used to monitor and detect latency due to any delay caused by a non-volatile memory of the first node used as a write cache.
1. A machine implemented method, comprising:
monitoring a non-volatile memory delay center for a first cluster having a first node and a second node configured to operate as a first high availability pair, where data for a write request to write data to the first node is also written to the second node as well as to a second cluster having a third node and a fourth node, where the third node and the fourth node are also configured to operate as a second high availability pair to store the data for the write request at one or both of the third and fourth node; wherein the non-volatile memory delay center is used to monitor and detect latency due to any delay caused by a non-volatile memory of the first node used as a write cache;
determining if a sum of write traffic for storage volumes associated with the first node and write traffic from either the third node or the fourth node has reached a threshold value, when the latency in processing write requests is unacceptable; and
notifying a user to check the non-volatile memory when the threshold value is reached;
wherein a management application collects response time for the non-volatile memory delay center and predicts an expected response time for the future and when the predicted response time reaches a certain value, then the sum of write traffic for the storage volumes associated with the first node and the write traffic from either the third node or the fourth node is compared with an overall storage capacity of the non-volatile memory to determine if the overall storage capacity has been reached.
2. The method of claim 1 , wherein the threshold value indicates a maximum storage capacity for the non-volatile memory of the first node.
3. The method of claim 1 , executing the monitoring, determining and notifying steps for non-volatile memory used by each of the second node, the third node and the fourth node.
4. The method of claim 1 , wherein when the threshold value is not reached, notifying the user to check a link between the first cluster and the second cluster.
5. The method of claim 1 , wherein the management application monitors non-volatile memory delay centers for both the first cluster and the second cluster to predict expected response times for each delay center.
6. The method of claim 1 , further comprising:
identifying the non-volatile memory as a resource causing unacceptable latency in processing write requests by the first node, when the threshold value has been reached.
7. The method of claim 1 , further comprising:
identifying a workload as a bully workload for reaching the threshold value based on an amount of data that is written by the first node for the workload using the non-volatile memory as the write cache.
8. A non-transitory, machine readable storage medium having stored thereon instructions for performing a method, comprising machine executable code which when executed by at least one machine, causes the machine to:
monitor a non-volatile memory delay center for a first cluster having a first node and a second node configured to operate as a first high availability pair, where data for a write request to write data to the first node is also written to the second node as well as to a second cluster having a third node and a fourth node, where the third node and the fourth node are also configured to operate as a second high availability pair to store the data for the write request at one or both of the third and fourth node; wherein the non-volatile memory delay center is used to monitor and detect latency due to any delay caused by a non-volatile memory of the first node used as a write cache;
determine if a sum of write traffic for storage volumes associated with the first node and write traffic from either the third node or the fourth node has reached a threshold value, when the latency in processing write requests is unacceptable; and
notify a user to check the non-volatile memory when the threshold value is reached; wherein a management application collects response time for the non-volatile memory delay center and predicts an expected response time for the future and when the predicted response time reaches a certain value, then the sum of write traffic for the storage volumes associated with the first node and the write traffic from either the third node or the fourth node is compared with an overall storage capacity of the non-volatile memory to determine if the overall storage capacity has been reached.
9. The storage medium of claim 8 , wherein the threshold value indicates a maximum storage capacity for the non-volatile memory of the first node.
10. The storage medium of claim 8 , executing the monitoring, determining and notifying steps for non-volatile memory used by each of the second node, the third node and the fourth node.
11. The storage medium of claim 8 , wherein when the threshold value is not reached, notifying the user to check a link between the first cluster and the second cluster.
12. The storage medium of claim 8 , wherein the management application monitors non-volatile memory delay centers for both the first cluster and the second cluster to predict expected response times for each delay center.
13. The storage medium of claim 8 , wherein the machine executable code further causes the machine to: identify the non-volatile memory as a resource causing unacceptable latency in processing write requests by the first node, when the threshold value has been reached.
14. The storage medium of claim 8 , wherein the machine executable code further causes the machine to: identify a workload as a bully workload for reaching the threshold value based on an amount of data that is written by the first node for the workload using the non-volatile memory as the write cache.
15. A system comprising:
a memory containing machine readable medium comprising machine executable code having stored thereon instructions; and a processor module coupled to the memory, the processor module configured to execute the machine executable code to:
monitor a non-volatile memory delay center for a first cluster having a first node and a second node configured to operate as a first high availability pair, where data for a write request to write data to the first node is also written to the second node as well as to a second cluster having a third node and a fourth node, where the third node and the fourth node are also configured to operate as a second high availability pair to store the data for the write request at one or both of the third and fourth node; wherein the pg, 73 non-volatile memory delay center is used to monitor and detect latency due to any delay caused by a non-volatile memory of the first node used as a write cache;
determine if a sum of write traffic for storage volumes associated with the first node and write traffic from either the third node or the fourth node has reached a threshold value, when the latency in processing write requests is unacceptable; and
notify a user to check the non-volatile memory when the threshold value is reached; wherein a management application collects response time for the non-volatile memory delay center and predicts an expected response time for the future and when the predicted response time reaches a certain value, then the sum of write traffic for the storage volumes associated with the first node and the write traffic from either the third node or the fourth node is compared with an overall storage capacity of the non-volatile memory to determine if the overall storage capacity has been reached.
16. The system of claim 15 , wherein the threshold value indicates a maximum storage capacity for the non-volatile memory of the first node.
17. The system of claim 15 , executing the monitoring, determining and notifying steps for non-volatile memory used by each of the second node, the third node and the fourth node.
18. The system of claim 15 , wherein when the threshold value is not reached, notifying the user to check a link between the first cluster and the second cluster.
19. The system of claim 15 , wherein the management application monitors non-volatile memory delay centers for both the first cluster and the second cluster to predict expected response times for each delay center.
20. The system of claim 15 , wherein the machine executable code further causes the machine to: identify a workload as a bully workload for reaching the threshold value based on an amount of data that is written by the first node for the workload using the non-volatile memory as the write cache.