Automated usage based copy data tiering system
Techniques are disclosed herein for improved copy data management functionality in storage systems. For example, a method receives copy usage data for one or more data copies associated with a storage array, wherein the copy usage data is indicative of a usage associated with each of the one or more data copies, and updates the one or more data copies with one or more usage tags based on the received copy usage data. Further, the method may then scan the one or more usage tags associated with each of the one or more data copies, select one or more storage tiers for at least a portion of the one or more data copies based on the scanning of the one or more usage tags, and cause at least a portion of the one or more data copies to be stored in the selected one or more storage tiers.
1. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory, the at least one processing device, when executing program code, implements a control module associated with a storage array configured to:
identify one or more service level objectives for one or more workloads accessing one or more data copies associated with the storage array, the one or more service level objectives characterizing expected copy usage data of the one or more data copies by the one or more workloads;
determine actual copy usage data for the one or more data copies associated with the storage array based at least in part on identifying input-output patterns of the data of the one or more data copies, the identified input-output patterns characterizing at least one of relative amounts of sequential and non-sequential input-output operations for the data of the one or more data copies and relative amounts of read and write input-output operations for the data of the one or more data copies, wherein the actual copy usage data is indicative of actual usage associated with each of the one or more data copies, and wherein at least a given one of the one or more data copies comprises a snapshot of a storage volume in a first storage tier of the storage array, the snapshot being marked for protection of the storage volume in the first storage tier of the storage array, and at least a subset of blocks of the given one of the one or more data copies being further marked for production in the first storage tier of the storage array;
update the one or more data copies with one or more usage tags based on the expected copy usage data and the determined actual copy usage data, wherein updating the given one of the one or more data copies with one or more usage tags based on the expected copy usage data and the determined actual usage data comprises associating at least a given one of the one or more usage tags with a volume header of the snapshot of the storage volume stored in the first storage tier; and
responsive to detecting that at least a given block of the given one of the one or more data copies is no longer marked for production in the first storage tier of the storage array and remains marked for protection of the storage volume in the first storage tier of the storage array, migrate the given block of the given one of the one or more data copies from the first storage tier to a second storage tier specified by the given usage tag.
2. The apparatus of claim 1 , wherein the control module is further configured to scan the one or more usage tags associated with each of the one or more data copies.
3. The apparatus of claim 2 , wherein the control module is further configured to select one or more storage tiers for at least a portion of the one or more data copies based on the scan of the one or more usage tags.
4. The apparatus of claim 3 , wherein the control module is further configured to cause at least a portion of the one or more data copies to be stored in the selected one or more storage tiers.
5. The apparatus of claim 3 , wherein at least a portion of the one or more storage tiers are part of the storage array.
6. The apparatus of claim 3 , wherein at least a portion of the one or more storage tiers are external to the storage array.
7. The apparatus of claim 1 , wherein determining the actual copy usage data is based at least in part on information received from a host device operatively coupled to the storage array.
8. The apparatus of claim 1 , wherein determining the actual copy usage data is based at least in part on information received from an end user of the storage array.
9. A method comprising:
identifying one or more service level objectives for one or more workloads accessing one or more data copies associated with the storage array, the one or more service level objectives characterizing expected copy usage data of the one or more data copies by the one or more workloads;
determining actual copy usage data for the one or more data copies associated with a storage array based at least in part on identifying input-output patterns of the data of the one or more data copies, the identified input-output patterns characterizing at least one of relative amounts of sequential and non-sequential input-output operations for the data of the one or more data copies and relative amounts of read and write input-output operations for the data of the one or more data copies, wherein the actual copy usage data is indicative of actual usage associated with each of the one or more data copies, and wherein at least a given one of the one or more data copies comprises a snapshot of a storage volume in a first storage tier of the storage array, the snapshot being marked for protection of the storage volume in the first storage tier of the storage array, and at least a subset of blocks of the given one of the one or more data copies being further marked for production in the first storage tier of the storage array;
updating the one or more data copies with one or more usage tags based on the expected copy usage data and the determined actual copy usage data, wherein updating the given one of the one or more data copies with one or more usage tags based on the expected copy usage data and the determined actual usage data comprises associating at least a given one of the one or more usage tags with a volume header of the snapshot of the storage volume stored in the first storage tier; and
responsive to detecting that at least a given block of the given one of the one or more data copies is no longer marked for production in the first storage tier of the storage array and remains marked for protection of the storage volume in the first storage tier of the storage array, migrating the given block of the given one of the one or more data copies from the first storage tier to a second storage tier specified by the given usage tag;
wherein the steps are performed by at least one processing device comprising a processor coupled to a memory executing program code.
10. The method of claim 9 , further comprising scanning the one or more usage tags associated with each of the one or more data copies.
11. The method of claim 10 , further comprising selecting one or more storage tiers for at least a portion of the one or more data copies based on the scanning of the one or more usage tags.
12. The method of claim 11 , further comprising causing at least a portion of the one or more data copies to be stored in the selected one or more storage tiers.
13. The method of claim 11 , wherein at least a portion of the one or more storage tiers are part of the storage array.
14. The method of claim 11 , wherein at least a portion of the one or more storage tiers are external to the storage array.
15. The method of claim 9 , wherein determining the actual copy usage data is based at least in part on information received from a host device operatively coupled to the storage array.
16. The method of claim 9 , wherein determining the actual copy usage data is based at least in part on information received from an end user of the storage array.
17. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by the at least one processing device causes the at least one processing device to:
identify one or more service level objectives for one or more workloads accessing one or more data copies associated with the storage array, the one or more service level objectives characterizing expected copy usage data of the one or more data copies by the one or more workloads;
determine actual copy usage data for the one or more data copies associated with a storage array based at least in part on identifying input-output patterns of the data of the one or more data copies, the identified input-output patterns characterizing at least one of relative amounts of sequential and non-sequential input-output operations for the data of the one or more data copies and relative amounts of read and write input-output operations for the data of the one or more data copies, wherein the actual copy usage data is indicative of actual usage associated with each of the one or more data copies, and wherein at least a given one of the one or more data copies comprises a snapshot of a storage volume in a first storage tier of the storage array, the snapshot being marked for protection of the storage volume in the first storage tier of the storage array, and at least a subset of blocks of the given one of the one or more data copies being further marked for production in the first storage tier of the storage array;
update the one or more data copies with one or more usage tags based on the expected copy usage data and the determined actual copy usage data, wherein updating the given one of the one or more data copies with one or more usage tags based on the expected copy usage data and the determined actual usage data comprises associating at least a given one of the one or more usage tags with a volume header of the snapshot of the storage volume stored in the first storage tier; and
responsive to detecting that at least a given block of the given one of the one or more data copies is no longer marked for production in the first storage tier of the storage array and remains marked for protection of the storage volume in the first storage tier of the storage array, migrate the given block of the given one of the one or more data copies from the first storage tier to a second storage tier specified by the given usage tag.
18. The computer program product of claim 17 , wherein the program code when executed by the at least one processing device further causes the at least one processing device to scan the one or more usage tags associated with each of the one or more data copies.
19. The computer program product of claim 18 , wherein the program code when executed by the at least one processing device further causes the at least one processing device to select one or more storage tiers for at least a portion of the one or more data copies based on the scan of the one or more usage tags.
20. The computer program product of claim 19 , wherein the program code when executed by the at least one processing device further causes the at least one processing device to cause at least a portion of the one or more data copies to be stored in the selected one or more storage tiers.