Mapping service level agreements for backup systems to multiple storage tiers in a clustered network
Embodiments are described for providing backup resources in a multi-tier network, by providing a plurality of different storage devices, each with different operating characteristics and costs for storage of data assets, and organizing the storage devices into a plurality of tiers based on respective operating characteristics, such as based on performance versus cost parameters. Certain Service Level Agreements (SLAs) dictating storage requirements for each of the data assets to a backup program are provided to the backup system, and a mapper maps each SLA to one or more tiers of the plurality of tiers based on the storage requirements of a respective SLA to the operating characteristics of each tier.
1. A method for providing backup resources in a multi-tier network, comprising:
providing a plurality of different storage devices, each with different operating characteristics and costs for storage of data assets;
organizing the storage devices into a plurality of tiers based on respective operating characteristics;
exposing Service Level Agreements (SLAs) dictating storage requirements comprising backup and restore latencies, media availability, and cost for each of the data assets comprising at least one of files, directories, Mtrees, and namespaces, to a backup program; and
mapping each SLA to one or more tiers of the plurality of tiers based on the storage requirements of a respective SLA to the operating characteristics comprising throughput (input/output rate), latency, security, and availability of each tier, wherein the tiers comprise one or more types of storage media selected from: hard disk drives (HDDs), solid state drives (SSDs), flash memory, and cloud storage, and wherein the performance, availability and cost characteristics are different for each type of storage media, and further wherein the backup software comprises part of a deduplication backup system performing backup and restore operations for nodes of the multi-tier network, and wherein the network comprises a Santorini clustered network.
2. The method of claim 1 further comprising characterizing the tiers along a performance scale ranging from high performance to low performance for throughput versus cost of storage.
3. The method of claim 1 further comprising distributing the nodes into different domains, with each domain containing unique Mtree data and metadata, wherein a domain contains resources including processors, memory, storage devices, as well as data deduplication and compression services.
4. The method of claim 3 further comprises performing a second mapping comprising:
maintaining similarity groups in each domain;
distributing the similarity groups among the deduplication and compression services that pack unique data segments; and
writing the data segments as an object in an objects store of the domain.
5. The method of claim 4 wherein an SLA attribute is used with the similarity group to send the file to the appropriate domain and tier in the network to meet the SLA.
6. A system for providing backup resources in a multi-tier network, comprising:
a plurality of different storage devices, each provided with different operating characteristics and costs for storage of data assets;
a plurality of storage tiers organizing the storage devices based on respective operating characteristics;
a backup policy component exposing Service Level Agreements (SLAs) dictating storage requirements for each of the data assets to a backup program comprising part of a deduplication backup system performing backup and restore operations for nodes of the multi-tier network;
a mapper component mapping each SLA to one or more tiers of the plurality of tiers based on the storage requirements comprising backup and restore latencies, media availability, and cost, and further wherein the operating characteristics comprise throughput (input/output rate), latency, security, and availability of a respective SLA to the operating characteristics of each tier, wherein the tiers are characterized and ranked along a performance scale ranging from high performance to low performance for throughput versus cost of storage, and further wherein the tiers comprise one or more types of storage media selected from: hard disk drives (HDDs), solid state drives (SSDs), flash memory, and cloud storage, and wherein the performance, availability and cost characteristics are different for each type of storage media; and
a component distributing the nodes into different domains, with each domain containing unique Mtree data and metadata, wherein a domain contains resources including processors, memory, storage devices, as well as data deduplication and compression services.
7. The system of claim 6 wherein the data assets comprise at least one of files, directories, Mtrees, and namespaces, and further wherein the backup software comprises part of a deduplication backup system performing backup and restore operations for nodes of the multi-tier network.
8. A computer program product, comprising a non-transitory computer-readable medium having a computer-readable program code embodied therein, the computer-readable program code adapted to be executed by one or more processors to implement a method for providing backup resources in a multi-tier network, comprising:
providing a plurality of different storage devices, each with different operating characteristics and costs for storage of data assets;
organizing the storage devices into a plurality of tiers based on respective operating characteristics;
exposing Service Level Agreements (SLAs) dictating storage requirements for each of the data assets to a backup program comprising part of a deduplication backup system performing backup and restore operations for nodes of the multi-tier network; and
mapping each SLA to one or more tiers of the plurality of tiers based on the storage requirements comprising backup and restore latencies, media availability, and cost, and further wherein the operating characteristics comprise throughput (input/output rate), latency, security, and availability of a respective SLA to the operating characteristics of each tier, wherein the tiers are characterized and ranked along a performance scale ranging from high performance to low performance for throughput versus cost of storage, and further wherein the tiers comprise one or more types of storage media selected from: hard disk drives (HDDs), solid state drives (SSDs), flash memory, and cloud storage, and wherein the performance, availability and cost characteristics are different for each type of storage media; and
distributing the nodes into different domains, with each domain containing unique Mtree data and metadata, wherein a domain contains resources including processors, memory, storage devices, as well as data deduplication and compression services.
9. The product of claim 8 wherein the operating characteristics comprise throughput (input/output rate), latency, security, and availability.
10. The product of claim 8 wherein the data assets comprise at least one of files, directories, Mtrees, and namespaces.