Compression and encryption aware optimized data moving across a network
In a method of tiering data in a computing environment, data service status information is obtained at a first storage environment regarding a data service operation performed on one or more data sets that qualify for storage at a second storage environment based on a given policy, and, based on the obtained data service status information, a determination is made to store the one or more data sets at the second storage environment without performing a reverse operation of the data service operation on the one or more data sets.
1. A method, comprising:
obtaining data service status information at a first storage environment regarding a data service operation performed on one or more data sets that qualify for storage at a second storage environment based on a given policy; and
determining, based on the obtained data service status information, to store the one or more data sets at the second storage environment without performing a reverse operation of the data service operation on the one or more data sets;
wherein determining to store includes evaluating metadata of the one or more data sets to detect at least one of an encrypted status and a compressed status of the one or more data sets, the metadata comprising a specification of the at least one of the encrypted status and the compressed status; and
wherein the obtaining and determining steps are performed via one or more processing devices.
2. The method of claim 1 , wherein the first storage environment comprises a local storage tier comprising storage of a local host device, and the second storage environment comprises a remote storage tier comprising cloud storage of a cloud storage device remote from the local host device.
3. The method of claim 1 , wherein the one or more data sets comprise one or more data files.
4. The method of claim 1 , wherein the step of determining further comprises detecting each of the encryption status and the compression status for the one or more data sets.
5. The method of claim 1 , wherein the reverse operation of the data service operation comprises at least one of decryption and decompression.
6. The method of claim 1 , wherein the one or more data sets includes raw data, and further comprising adding to metadata for the one or more data sets, based on the obtained data service status information, a parameter specifying that the raw data of the one or more data sets be read from the first storage environment.
7. The method of claim 1 , further comprising adding to metadata for the one or more data sets, based on the obtained data service status information, a parameter specifying non-performance of the reverse operation.
8. The method of claim 1 , further comprising reclaiming the storage capacity at the first storage environment for the one or more data sets stored at the second storage environment.
9. The method of claim 1 , wherein metadata for the one or more data sets comprises a specification of at least one of a tiering state wherein the one or more data sets are being migrated to the second storage environment and a recalling state where the one or more data sets are being recalled from the second storage environment for return to the first storage environment.
10. The method of claim 1 , wherein metadata for the one or more data sets comprises a specification of data encryption key for the one or more datasets.
11. The method of claim 1 , wherein the given policy comprises at least one criterion for determining whether or not the one or more data sets qualify for remote storage.
12. The method of claim 11 , wherein the at least one criterion is a determination that a data set is cold or inactive.
13. A system, comprising:
at least one processor, coupled to a memory, and configured to:
obtain data service status information at a first storage environment regarding a data service operation performed on one or more data sets that qualify for storage at a second storage environment based on a given policy; and
determine, based on the obtained data service status information, to store the one or more data sets at the second storage environment without performing a reverse operation of the data service operation on the one or more data sets;
wherein determining to store includes evaluating metadata of the one or more data sets to detect at least one of an encrypted status and a compressed status of the one or more data sets, the metadata comprising a specification of the at least one of the encrypted status and the compressed status.
14. The system of claim 13 , wherein the reverse operation of the data service operation comprises at least one of decryption and decompression.
15. The system of claim 13 , wherein the at least one processor is further configured to:
add to metadata for the one or more data sets, based on the obtained data service status information, a parameter specifying non-performance of the reverse operation.
16. The system of claim 15 , wherein the reverse operation of the data service operation comprises at least one of decryption and decompression.
17. The system of claim 13 , wherein metadata for the one or more data sets comprises a specification of data encryption key for the one or more datasets.
18. An article of manufacture comprising a processor-readable storage medium having encoded therein executable code of one or more software programs, wherein the one or more software programs when executed by at least one processing device implement the steps of:
obtaining data service status information at a first storage environment regarding a data service operation performed on one or more data sets that qualify for storage at a second storage environment based on a given policy; and
determining, based on the obtained data service status information, to store the one or more data sets at the second storage environment without performing a reverse operation of the data service operation on the one or more data sets;
wherein determining to store includes evaluating metadata of the one or more data sets to detect at least one of an encrypted status and a compressed status of the one or more data sets, the metadata comprising a specification of the at least one of the encrypted status and the compressed status.
19. The article of manufacture of claim 18 , wherein the at least one processing device is further configured implement the step of:
adding to metadata for the one or more data sets, based on the obtained data service status information, a parameter specifying non-performance of the reverse operation.
20. The article of manufacture of claim 19 , wherein the reverse operation of the data service operation comprises at least one of decryption and decompression.