Storage-usage-based host/storage mapping management system
A storage usage management system includes a storage usage management subsystem coupled to first and second storage devices. The storage usage management subsystem collects first write usage data from use of the first storage device by a host mapped to the first storage device, determines that second write usage data from use of the first storage device by the host exceeds first metric(s) associated with the first write usage data by a first threshold, and collects the second write usage data and third write usage data from immediately subsequent use of the first storage device by the host. If the storage usage management subsystem determines that the second and third write usage data exceed second metric(s) associated with the first write usage data by a second threshold, it uses the second and third write usage data to determine whether to remap the host to the second storage device.
1. A method for managing storage usage, comprising:
collecting, by a storage usage management subsystem, a first write usage data for a first storage device having a first write usage configuration, wherein the first write usage data was generated in response to first write operations performed by a host that is mapped to the first storage device;
collecting, by the storage usage management subsystem, second write usage data for the first storage device that was generated in response to second write operations performed by the host;
determining, by the storage usage management subsystem, that the second write usage data exceeds at least one first metric associated with the first write usage data by a first threshold;
collecting, by the storage usage management subsystem in response to determining that the second write usage data exceeds the at least one first metric associated with the first write usage data by the first threshold, third write usage data for the first storage device that was generated in response to third write operations performed by the host immediately subsequent to the second write operations;
determining, by the storage usage management subsystem, whether the second write usage data and the third write usage data exceeds at least one second metric associated with the first write usage data by a second threshold; and
determining, by the storage usage management subsystem in response to determining that the second write usage data and the third write usage data do not exceed the at least one second metric associated with the first write usage data by the second threshold, whether the first write usage data, the second write usage data, and the third write usage data indicate that a first write usage threshold for the first write usage configuration has been exceeded; and
remapping, by the storage usage management subsystem in response to determining that the first write usage data, the second write usage data, and the third write usage data indicate that the first write usage threshold for the first write usage configuration has been exceeded, the host from the first storage device to a second storage device.
2. The method of claim 1 , further comprising:
discarding, by the storage usage management subsystem in response to determining that the second write usage data and the third write usage data exceeds the at least one second metric associated with the first write usage data by the second threshold, the second write usage data and the third write usage data.
3. The method of claim 1 , further comprising:
calculating, by the storage usage management subsystem, a write amplification factor for the first storage device; and
generating, by the storage usage management subsystem, the first write usage data, the second write usage data, and the third write usage data for the first storage device using the write amplification factor.
4. The method of claim 3 , wherein the write amplification factor for the first storage device includes a ratio of host initiated write operations and storage device initiated write operations.
5. The method of claim 1 , wherein the determining that second write usage data exceeds the at least one first metric associated with the first write usage data by the first threshold includes:
determining, by the storage usage management subsystem, that the second write usage data exceeds an average of the first write usage data by a threshold multiple of standard deviations of the first write usage data.
6. The method of claim 1 , wherein the determining whether the second write usage data and the third write usage data exceeds the at least one second metric associated with the first write usage data by the second threshold includes:
determining, by the storage usage management subsystem, whether a difference between a first average of the first write usage data and a second average of a combination of the second write usage data and the third write usage data exceeds a threshold multiple of standard deviations of the first write usage data.
7. The method of claim 1 , wherein the determining whether the second write usage data and the third write usage data exceeds the at least one second metric associated with the first write usage data by the second threshold includes:
determining, by the storage usage management subsystem, whether a difference between a first average of the first write usage data and a second average of a combination of the second write usage data and the third write usage data exceeds a threshold multiple of standard deviations of a combination of the second write usage data and the third write usage data.
8. An Information Handling System (IHS), comprising:
a processing system; and
a memory system that is coupled to the processing system and that includes instructions that, when executed by the processing system, cause the processing system to provide a storage usage management engine that is configured to:
collect first write usage data for a first storage device having a first write usage configuration, wherein the first write usage data was generated in response to first write operations performed by a host that is mapped to the first storage device;
collect second write usage data for the first storage device that was generated in response to second write operations performed by the host;
determine that the second write usage data exceeds at least one first metric associated with the first write usage data by a first threshold;
collect, in response to determining that the second write usage data exceeds the at least one first metric associated with the first write usage data by the first threshold, third write usage data for the first storage device that was generated in response to third write operations performed by the host immediately subsequent to the second write operations;
determine whether the second write usage data and the third write usage data exceeds at least one second metric associated with the first write usage data by a second threshold;
determine, in response to determining that the second write usage data and the third write usage data do not exceed the at least one second metric associated with the first write usage data by the second threshold, whether the first write usage data, the second write usage data, and the third write usage data indicate that a first write usage threshold for the first write usage configuration has been exceeded;
remap, in response to determining that the first write usage data, the second write usage data, and the third write usage data indicate that the first write usage threshold for the first write usage configuration has been exceeded, the host from the first storage device to a second storage device.
9. The IHS of claim 8 , wherein the storage usage management engine is configured to:
discard, in response to determining that the second write usage data and the third write usage data exceed the at least one second metric associated with the first write usage data by the second threshold, the second write usage data and the third write usage data.
10. The IHS of claim 8 , wherein the storage usage management engine is configured to:
calculate a write amplification factor for the first storage device; and
generate the first write usage data, the second write usage data, and the third write usage data for the first storage device using the write amplification factor.
11. The IHS of claim 10 , wherein the write amplification factor for the first storage device includes a ratio of host initiated write operations and storage device initiated write operations.
12. The IHS of claim 8 , wherein the determining that second write usage data exceeds the at least one first metric associated with the first write usage data by the first threshold includes:
determining that the second write usage data exceeds an average of the first write usage data by a threshold multiple of standard deviations of the first write usage data.
13. The IHS of claim 8 , wherein the determining whether the second write usage data and the third write usage data exceeds the at least one second metric associated with the first write usage data by the second threshold includes:
determining whether a difference between a first average of the first write usage data and a second average of a combination of the second write usage data and the third write usage data exceeds a threshold multiple of standard deviations of the first write usage data.
14. The IHS of claim 8 , wherein the determining whether the second write usage data and the third write usage data exceeds the at least one second metric associated with the first write usage data by the second threshold includes:
determining whether a difference between a first average of the first write usage data and a second average of a combination of the second write usage data and the third write usage data exceeds a threshold multiple of standard deviations of a combination of the second write usage data and the third write usage data.
15. A storage usage management system, comprising:
a first storage device having a first write usage configuration;
a second storage device having a second write usage configuration that is different than the first write-usage configuration; and
a storage usage management subsystem that is coupled to the first storage device and the second storage device, wherein the storage usage management subsystem is configured to:
collect first write usage data for the first storage device that was generating in response to first write operations performed by a host that is mapped to the first storage device;
collect second write usage data for the first storage device that was generated in response to second write operations performed by the host;
determine that the second write usage data exceeds at least one first metric associated with the first write usage data by a first threshold;
collect, in response to determining that the second write usage data exceeds the at least one first metric associated with the first write usage data by the first threshold, third write usage data for the first storage device that was generated in response to third write operations performed by the host immediately subsequent to the second write operations;
determine whether the second write usage data and the third write usage data exceeds at least one second metric associated with the first write usage data by a second threshold;
determine, in response to determining that the second write usage data and the third write usage data do not exceed the at least one second metric associated with the first write usage data by the second threshold, whether the first write usage data, the second write usage data, and the third write usage data indicate that a first write usage threshold for the first write usage configuration has been exceeded;
remap, in response to determining that the first write usage data, the second write usage data, and the third write usage data indicate that the first write usage threshold for the first write usage configuration has been exceeded, the host from the first storage device to the second storage device.
16. The system of claim 15 , wherein the storage usage management subsystem is configured to:
discard, in response to determining that the second write usage data and the third write usage data exceed the at least one second metric associated with the first write usage data by the second threshold, the second write usage data and the third write usage data.
17. The system of claim 15 , wherein the storage usage management subsystem is configured to:
calculate a write amplification factor for the first storage device; and
generate the first write usage data, the second write usage data, and the third write usage data for the first storage device using the write amplification factor.
18. The system of claim 15 , wherein the determining that second write usage data exceeds the at least one first metric associated with the first write usage data by the first threshold includes:
determining that the second write usage data exceeds an average of the first write usage data by a threshold multiple of standard deviations of the first write usage data.
19. The system of claim 15 , wherein the determining whether the second write usage data and the third write usage data exceeds the at least one second metric associated with the first write usage data by the second threshold includes:
determining whether a difference between a first average of the first write usage data and a second average of a combination of the second write usage data and the third write usage data exceeds a threshold multiple of standard deviations of the first write usage data.
20. The system of claim 15 , wherein the determining whether the second write usage data and the third write usage data exceeds at least one second metric associated with the first write usage data by the second threshold includes:
determining whether a difference between a first average of the first write usage data and a second average of a combination of the second write usage data and the third write usage data exceeds a threshold multiple of standard deviations of a combination of the second write usage data and the third write usage data.