Virtual storage domain for a content addressable system
A method, system and program is described for providing virtual storage domains for content addressable system. At least one tenant data storage policy is configured for at least one tenant in a storage system. A virtual storage domain is created based on the tenant data storage policy, each virtual storage domain having a unique identifier (ID). The corresponding virtual storage domain ID is tagged to a data request based on a data set policy when data belonging to a data set gets written to the storage system. A hash signature is calculated for the data taking the data content and the storage domain ID as inputs to calculate the hash signature.
1. A computer-implemented method comprising:
configuring at least one tenant data storage policy for at least one tenant in a content addressable storage system;
creating virtual storage domains based on the tenant data storage policy, each virtual storage domain having a unique identifier (ID);
tagging corresponding virtual storage domain IDs to a data request based on a data set policy when data belonging to a data set gets written to the content addressable storage system;
calculating a hash signature from the data content and the virtual storage domain ID, the data content and the virtual storage domain ID provided as inputs to a hash function that calculates the hash signature such that, when two tenant data storage policies allow data sets to be shared together, same data allowed in a same storage domain are assigned a same hash signature and stored once in a single physical location with pointers to the single physical location being stored for other occurrences of the same data in the same storage domain, and such that the same data in different domains are assigned different hash signatures and stored in different physical locations; and
responsive to a data read request,
looking up a domain ID based on the policy;
tagging the data read request with the domain ID; and
sending the data read request tagged with the domain ID for processing of the data read request, wherein the data and the domain ID is used to calculate a hash signature for use in retrieving the requested data.
2. The method of claim 1 , wherein the tenant data storage policy is for one or more of shared storage, exclusive storage, a data protection level, an encryption policy and/or storage tiers.
3. The method of claim 1 , wherein domains may be split or merged with policy configuration changes.
4. The method of claim 1 , wherein data can move in between domains by choosing hash functions and rehashing data that needs to be moved or duplicated.
5. A system, comprising;
a processor; and
a non-volatile memory in operable communication with the processor and storing computer program code that when executed on the processor causes the processor to execute a process operable to perform the operations of:
configuring at least one tenant data storage policy for at least one tenant in a content addressable storage system;
creating virtual storage domains based on the tenant data storage policy, each virtual storage domain having a unique identifier (ID);
tagging corresponding virtual storage domain IDs to a data request based on a data set policy when data belonging to a data set gets written to the content addressable storage system;
calculating a hash signature from the data content and the virtual storage domain ID, the data content and the virtual storage domain ID provided as inputs to a hash function that calculates the hash signature such that, when two tenant data storage policies allow data sets to be shared together, same data allowed in a same storage domain are assigned a same hash signature and stored once in a single physical location with pointers to the single physical location being stored for other occurrences of the same data in the same storage domain, and such that the same data in different domains are assigned different hash signatures and stored in different physical locations; and
responsive to a data read request,
looking up a domain ID based on the policy;
tagging the data read request with the domain ID; and
sending the data read request tagged with the domain ID for processing of the data read request, wherein the data and the domain ID is used to calculate a hash signature for use in retrieving the requested data.
6. The system of claim 5 , wherein the tenant data storage policy is for one or more of shared storage, exclusive storage, a data protection level, an encryption policy and/or storage tiers.
7. The system of claim 5 , wherein domains may be split or merged with policy configuration changes.
8. The system of claim 5 , wherein data can move in between domains by choosing hash functions and rehashing data that needs to be moved or duplicated.
9. A computer program product including a non-transitory computer readable storage medium having computer program code encoded thereon that when executed on a processor of a computer causes the computer to operate a storage system, the computer program product comprising:
computer program code for configuring at least one tenant data storage policy for at least one tenant in a content addressable storage system;
computer program code for creating virtual storage domains based on the tenant data storage policy, each virtual storage domain having a unique identifier (ID);
computer program code for tagging corresponding virtual storage domain IDs to a data request based on a data set policy when data belonging to a data set gets written to the content addressable storage system;
computer program code for calculating a hash signature from the data content and the virtual storage domain ID, the data content and the virtual storage domain ID provided as inputs to a hash function that calculates the hash signature such that, when two tenant data storage policies allow data sets to be shared together, same data allowed in a same storage domain are assigned a same hash signature and stored once in a single physical location with pointers to the single physical location being stored for other occurrences of the same data in the same storage domain, and such that the same data in different domains are assigned different hash signatures and stored in different physical locations; and
computer program code for, responsive to a data read request,
looking up a domain ID based on the policy;
tagging the data read request with the domain ID; and
sending the data read request tagged with the domain ID for processing of the data read request, wherein the data and the domain ID is used to calculate a hash signature for use in retrieving the requested data.
10. The computer program product of claim 9 , wherein the tenant data storage policy is for one or more of shared storage, exclusive storage, a data protection level, an encryption policy and/or storage tiers.
11. The computer program product of claim 9 , wherein domains may be split or merged with policy configuration changes.