Data migration between multiple tiers in a storage system using policy based ILM for QOS
View Patent ↗Technologies are described for implementing a default migration mechanism in a storage system containing multiple tiers of storage with each tier having different cost and performance parameters. Data that is accessed more frequently can be migrated toward higher performance storage tiers while data that is accessed less frequently can be migrated towards lower performance storage tiers. Default migration behavior can be overridden by user-specified values for tier age residency policy, demotion policy, tier occupancy of volumes, and tier assignment. Data migration can be paused by the user and resumed by the user.
1. A method for managing a tiered storage system, the method comprising:
providing a default policy for associating logical drives with tiers based on a set of predetermined factors, wherein each tier has different cost and performance parameters;
assigning at least two of the logical drives to a same tier based on the default policy;
receiving a user-specified tier for one of the at least two of the logical drives assigned to the same tier;
assigning the one of the at least two of the logical drives to the user-specified tier, wherein the user-specified tier is different than the same tier with which the at least two of the logical drives are associated based on the default policy;
imposing a hierarchy on the tiers;
providing a default policy for data migration based on an age or frequency of access of data, the default policy comprising respective default migration ages or respective default migration frequencies of access for each of the tiers; and
moving data from a current tier to a destination tier in the hierarchy in response to the data being stored in the current tier for a period of time greater than the respective default migration age or greater than the respective default migration frequency of access.
2. The method of claim 1 , wherein the set of predetermined factors includes at least one of a RAID level, disk type, disk RPM, disk size, a number of disks and a number of spares.
3. The method of claim 1 , further comprising:
receiving a user-specified percentage of occupancy for each of the tiers; and
moving the data from the current tier to the destination tier in the hierarchy in response to the data being stored in the current tier for a period of time greater than the respective default migration age and an available capacity of the current tier exceeding the user-specified percentage of occupancy.
4. The method of claim 1 , wherein the current tier is associated with greater performance characteristics than the destination tier.
5. A non-transitory computer-readable recording medium having computer-executable instructions stored thereon that, when executed by a computer, cause the computer to:
provide a default policy for associating logical drives with tiers based on a set of predetermined factors, wherein each tier has different cost and performance parameters;
assign at least two of the logical drives to a same tier based on the default policy;
receive a user-specified tier for one of the at least two of the logical drives assigned to the same tier;
assign the one of the at least two of the logical drives to the user-specified tier, wherein the user-specified tier is different than the same tier with which the at least two of the logical drives are associated based on the default policy;
impose a hierarchy on the tiers;
provide a default policy for data migration based on an age or frequency of access of data, the default policy comprising respective default migration ages or respective default migration frequencies of access for each of the tiers; and
move data from a current tier to a destination tier in the hierarchy in response to the data being stored in the current tier for a period of time greater than the respective default migration age or greater than the respective default migration frequency of access.
6. The non-transitory computer-readable recording medium of claim 5 , wherein the set of predetermined factors includes at least one of a RAID level, disk type, disk RPM, disk size, a number of disks and a number of spares.
7. The non-transitory computer-readable recording medium of claim 5 , having further computer-executable instructions stored thereon that, when executed by the computer, cause the computer to:
receive a user-specified percentage of occupancy for each of the tiers; and
move the data from the current tier to the destination tier in the hierarchy in response to the data being stored in the current tier for a period of time greater than the respective default migration age and an available capacity of the current tier exceeding the user-specified percentage of occupancy.
8. The non-transitory computer-readable recording medium of claim 5 ,
wherein the current tier is associated with greater performance characteristics than the destination tier.
9. A data storage system, comprising:
a storage node computer;
a plurality of physical storage devices; and
a management module configured to cause the storage node computer to:
provide a default policy for associating logical drives with tiers based on a set of predetermined factors, wherein each tier has different cost and performance parameters;
assign at least two of the logical drives to a same tier based on the default policy;
receive a user-specified tier for one of the at least two of the logical drives assigned to the same tier based on the default policy; and
assign the one of the at least two of the logical drives to the user-specified tier, wherein the user-specified tier is different than the same tier with which the at least two of the logical drives are associated based on the default policy;
impose a hierarchy on the tiers;
provide a default policy for data migration based on an age or frequency of access of data, the default policy comprising respective default migration ages or respective default migration frequencies of access for each of the tiers; and
move data from a current tier to a destination tier in the hierarchy in response to the data being stored in the current tier for a period of time greater than the respective default migration age or greater than the respective default migration frequency of access.
10. The data storage system of claim 9 , wherein the set of predetermined factors includes at least one of a RAID level, disk type, disk RPM, disk size, a number of disks and a number of spares.
11. The data storage system of claim 9 , wherein the management module is further configured to cause the storage node computer to:
receive a user-specified percentage of occupancy for each of the tiers; and
move the data from the current tier to the destination tier in the hierarchy in response to the data being stored in the current tier for a period of time greater than the respective default migration age and an available capacity of the current tier exceeding the user-specified percentage of occupancy.