Smart data movement among virtual storage domains
Virtual storage domains (VSD) are each associated with unique VSD domain ID associated with a first policy and tagged to a request to a storage system when an entity writes a data set to it. A first hash digest, based on data set content, is calculated and combined with first unique VSD domain ID into a second hash digest associated with data set. When first policy is changed to second policy associated with second VSD, a third hash digest of first data set is calculated, the third hash digest based on content of first data set and on second unique VSD domain ID. If third hash digest does not exist in second VSD, data set is copied to the second VSD; else, reference count of the third hash digest, associated with second VSD domain, is incremented, and reference count of second hash digest, associated with first VSD domain, is decremented.
1. A computer-implemented method comprising:
configuring a storage system comprising a processor in operable communication with a storage device, the storage device responsive to input/output (I/O) requests to the storage device from one or more entities in operable communication with the storage system;
configuring a plurality of virtual storage domains (VSD) in operable communication with the storage system, the plurality of VSDs each associated with respective one or more policies, wherein each respective VSD comprises a respective unique VSD domain identifier (ID);
tagging a first unique VSD domain ID to a request to the storage system when a first entity writes a first data set to the storage system, wherein the tagging is based at least in part on a first policy applicable to the first data set, wherein the first unique VSD domain ID is associated with the first policy;
calculating a first hash digest of the first data set based at least in part on content of the first data set;
combining the first hash digest and the first unique VSD domain ID into a second hash digest that is associated with the first data set;
storing the first data set in a first VSD associated with the first unique VSD domain ID;
associating the first data set with a second unique VSD domain when the first policy is changed to a second policy, wherein the second policy is associated with a second unique VSD domain ID;
calculating a third hash digest of the first data set, the third hash digest based at least in part on the content of the first data set and on the second unique VSD domain ID;
determining, whether the third hash digest exists in the second VSD;
based on a positive determination, incrementing a first reference count of the third hash digest associated with the second VSD domain and decrementing a second reference count of the second hash digest associated with the first VSD domain; and
based on a negative determination, copying the first data set to the second VSD.
2. The method of claim 1 , wherein the combining of the first hash digest and the first unique VSD domain ID is configured to preserve a randomness of the first hash digest.
3. The method of claim 1 , wherein the first unique domain ID comprises an input to the calculation of the second hash digest.
4. The method of claim 1 , wherein combining the first hash digest and the first unique VSD domain ID into the second hash digest is accomplished using a hash_combine( ) function.
5. The method of claim 4 , wherein the hash_combine( ) function is configured to combine using the first unique VSD domain ID as a seed and the first hash digest as a value.
6. The method of claim 1 , wherein calculating the third hash digest further comprises swapping the out first unique VSD domain ID from the second hash digest and replacing the second hash digest with the second unique VSD domain ID.
7. The method of claim 6 , further comprising using a hash_uncombine( ) function to swap out the first unique VSD domain ID and to place the second hash digest with the second unique VSD domain ID.
8. A system, comprising;
a processor; and
a non-volatile memory in operable communication with the processor and storing computer program code that when executed on the processor causes the processor to execute a process operable to perform the operations of:
configuring a storage system comprising a processor in operable communication with a storage device, the storage device responsive to input/output (I/O) requests to the storage device from one or more entities in operable communication with the storage system;
configuring a plurality of virtual storage domains (VSD) in operable communication with the storage system, the plurality of VSDs each associated with respective one or more policies, wherein each respective VSD comprises a respective unique VSD domain identifier (ID);
tagging a first unique VSD domain ID to a request to the storage system when a first entity writes a first data set to the storage system, wherein the tagging is based at least in part on a first policy applicable to the first data set, wherein the first unique VSD domain ID is associated with the first policy;
calculating a first hash digest of the first data set based at least in part on content of the first data set;
combining the first hash digest and the first unique VSD domain ID into a second hash that is associated with the first data set;
storing the first data set in a first VSD associated with the first unique VSD domain_ID;
associating the first data set with a second unique VSD domain when the first policy is changed to a second policy, wherein the second policy is associated with a second unique VSD domain ID;
calculating a third hash digest of the first data set, the third hash digest based at least in part on the content of the first data set and on the second unique VSD domain ID;
determining, whether the third hash digest exists in the second VSD;
based on a positive determination, incrementing a first reference count of the third hash digest associated with the second VSD domain and decrementing a second reference count of the second hash digest associated with the first VSD domain; and
based on a negative determination, copying the first data set to the second VSD.
9. The system of claim 8 , wherein the combining of the first hash digest and the first unique VSD domain ID is configured to preserve a randomness of the first hash digest.
10. The system of claim 8 , wherein the first unique domain ID comprises an input to the calculation of the second hash digest.
11. The system of claim 8 , wherein combining the first hash digest and the first unique VSD domain ID into the second hash digest is accomplished using a hash_combine( ) function.
12. The system of claim 11 , wherein the hash_combine( ) function is configured to combine using the first unique VSD domain ID as a seed and the first hash digest as a value.
13. The system of claim 8 , wherein calculating the third hash digest further comprises swapping the out first unique VSD domain ID from the second hash digest and replacing the second hash digest with the second unique VSD domain ID.
14. The system of claim 8 , further comprising computer program code that when executed on the processor causes the processor to execute a process operable to perform the operations of using a hash_uncombine( ) function to swap out the first unique VSD domain ID and to place the second hash digest with the second unique VSD domain ID.
15. A computer program product including a non-transitory computer readable storage medium having computer program code encoded thereon that when executed on a processor of a computer causes the computer to operate a storage system, the computer program product comprising:
computer program code for configuring a storage system comprising a processor in operable communication with a storage device, the storage device responsive to input/output (I/O) requests to the storage device from one or more entities in operable communication with the storage system;
computer program code for configuring a plurality of virtual storage domains (VSD) in operable communication with the storage system, the plurality of VSDs each associated with respective one or more policies, wherein each respective VSD comprises a respective unique VSD domain identifier (ID);
computer program code for tagging a first unique VSD domain ID to a request to the storage system when a first entity writes a first data set to the storage system, wherein the tagging is based at least in part on a first policy applicable to the first data set, wherein the first unique VSD domain ID is associated with the first policy;
computer program code for calculating a first hash digest of the first data set based at least in part on content of the first data set;
computer program code for combining the first hash digest and the first unique VSD domain ID into a second hash digest that is associated with the first data set;
computer program code for storing the first data set in a first VSD associated with the first unique VSD domain ID;
computer program code for associating the first data set with a second unique VSD domain, when the first policy is changed to a second policy, wherein the second policy is associated with a second unique VSD domain ID;
computer program code for calculating a third hash digest of the first data set, the third hash digest based at least in part on the content of the first data set and on the second unique VSD domain ID;
computer program code for determining, whether the third hash digest exists in the second VSD;
computer program code for incrementing a first reference count of the third hash digest associated with the second VSD domain and decrementing a second reference count of the second hash digest associated with the first VSD domain, based on a positive determination; and
computer program code for copying the first data set to the second VSD, based on a negative determination.
16. The computer program product of claim 15 , further comprising computer program code configured for preserving a randomness of the first hash digest when the first hash digest is combined with the first unique VSD domain ID.
17. The computer program product of claim 15 , wherein the first unique domain ID comprises an input to the calculation of the second hash digest.
18. The computer program product of claim 15 , further comprising computer program code for combining the first hash digest and the first unique VSD domain ID into the second hash digest, using a hash_combine( ) function.
19. The computer program product of claim 18 further comprising computer program code configured to enable the hash_combine( ) function to combine using the first unique VSD domain ID as a seed and the first hash digest as a value.
20. The computer program product of claim 15 , further comprising computer program code for calculating the third has digest that comprises swapping the out first unique VSD domain ID from the second hash digest and replacing the second hash digest with the second unique VSD domain ID.