Location based replication
A method, a computer program product, and a system for replicating different projections of data, comprising: examining metadata associated with data on a storage system to determine whether to replicate the data to at least one other storage system; and based on a positive determination, replicating the data to the at least one other storage system.
1. A method for replicating data stored on a storage system, comprising:
replicating, using a computer processor on a storage system, different projections of data to a public cloud and a private cloud, the replicating including at least one of file-based replication, block-based replication, and object-based replication, the data being associated with one or more security levels, such that only data having up to a predetermined security level is replicated to the public cloud, the replicating comprising:
examining, using the computer processor, metadata associated with data on the storage system to determine whether to replicate the data to at least one of the public cloud and the private cloud, the data including a table of original data, and the metadata including: (i) permissions that define user access to specific rows or columns of the table and (ii) computer host information associated with the data; and
based on a positive determination to replicate the data, replicating, using the computer processor, at least some of the data to at least one of the public cloud and the private cloud, the replicating comprising replicating no more than a portion of the table to one of the public cloud and the private cloud, the portion of the table being selected for replication based on the permissions that define user access to specific rows or columns of the table,
wherein the data comprises general data, sensitive data and common data, at least one of the general data, the sensitive data, and the common data being encrypted using a different strength encryption than another one of the general data, the sensitive data, and the common data,
wherein the sensitive data is replicated to the private cloud based on the metadata, and
wherein the common data and the general data are replicated to the public cloud based on the metadata,
wherein examining metadata associated with the data includes examining the permissions that define user access to specific rows or columns of the table, the permissions being specified in an Access Control List (ACL) and
wherein changing the ACL automatically changes data that is stored in at least one of the private cloud and the public cloud.
2. The method of claim 1 , wherein at least one of the private cloud and the public cloud is part of a big data storage cloud.
3. The method of claim 1 , wherein the metadata associated with the data on the storage system indicates an age of the data.
4. The method of claim 1 , wherein each of the public cloud and the private cloud is associated with a respective security level, and the replication of the data to the public cloud and the private cloud is performed based on the respective security levels of the public cloud and the private cloud.
5. The method of claim 1 , wherein at least one of the public cloud and the private cloud is selected to receive the portion of the table based on the metadata.
6. A non-transitory computer-readable storage medium encoded with computer-executable program code which when executed by one or more processors, causes the one or more processors to:
replicate different projections of data stored on a storage system to a public cloud and a private cloud, the replication including at least one of file-based replication, block-based replication, and object-based replication, the data being associated with one or more security levels, such that only data having up to a predetermined security level is replicated to the public cloud, the replicating comprising:
examining metadata associated with data on the storage system to determine whether to replicate the data to at least one of the public cloud and the private cloud, the data including a table of original data, and the metadata including: (i) permissions that define user access to specific rows or columns of the table and (ii) computer host information associated with the data; and
based on a positive determination to replicate the data, replicating at least some of the data to the at least one of the public cloud and the private cloud, the replicating comprising replicating no more than a portion of the table to one of the public cloud and the private cloud, the portion of the table being selected for replication based on the permissions that define user access to specific rows or columns of the table,
wherein the data comprises general data, sensitive data and common data, at least one of the general data, the sensitive data, and the common data being encrypted using a different strength encryption than another one of the general data, the sensitive data, and the common data,
wherein the sensitive data is replicated to the private cloud based on the metadata, and
wherein the common data and the general data are replicated to the public cloud based on the metadata,
wherein examining metadata associated with the data includes examining the permissions that define user access to specific rows or columns of the table, the permissions being specified in an Access Control List (ACL) and
wherein changing the ACL automatically changes data that is stored in at least one of the private cloud and the public cloud.
7. The non-transitory computer-readable storage medium of claim 6 , wherein at least one of the private cloud and the public cloud is part of a big data storage cloud.
8. The non-transitory computer-readable storage medium of claim 7 , wherein the metadata associated with the data on the storage system indicates an age of the data.
9. The non-transitory computer-readable storage medium of claim 6 , each of the public cloud and the private cloud is associated with a respective security level, and the replication of the data to the public cloud and the private cloud is performed based on the respective security levels of the public cloud and the private cloud.
10. The non-transitory computer-readable storage medium of claim 6 , wherein at least one of the public cloud and the private cloud is associated with a respective security level, and the replication of the data to the public cloud and the private cloud is performed based on the respective security levels of the public cloud and the private cloud.
11. A system for replicating different projections of data, the system comprising:
an analytics platform;
a storage system;
a computer having a memory and one or more processors configured to replicate different projections of data to a public cloud and a private cloud, the replicating including at least one of file-based replication, block-based replication, and object-based replication, the data being associated with one or more security levels, such that only data having up to a predetermined security level is replicated to the public cloud, the replicating comprising:
examining metadata associated with data on the storage system to determine whether to replicate the data to at least one of the public cloud and the private cloud, the data including a table of original data, and the metadata including: (i) permissions that define user access to specific rows or columns of the table and (ii) computer host information associated with the data; and
based on a positive determination to replicate the data, replicating at least some of the data to the at least one of the public cloud and the private cloud, the replicating comprising replicating no more than a portion of the table to one of the public cloud and the private cloud, the portion of the table being selected for replication based on the permissions that define user access to specific rows or columns of the table,
wherein the data comprises general data, sensitive data and common data, at least one of the general data, the sensitive data, and the common data being encrypted using a different strength encryption than another one of the general data, the sensitive data, and the common data,
wherein the sensitive data is replicated to the private cloud based on the metadata, and
wherein the common data and the general data are replicated to the public cloud based on the metadata,
wherein examining metadata associated with the data includes examining the permissions that define user access to specific rows or columns of the table, the permissions being specified in an Access Control List (ACL) and
wherein changing the ACL automatically changes data that is stored in at least one of the private cloud and the public cloud.
12. The system of claim 11 , wherein at least one of the private cloud and the public cloud is part of a big data storage cloud.
13. The system of claim 11 , wherein the metadata associated with the data on the storage system indicates an age of the data.
14. The system of claim 11 , wherein each of the public cloud and the private cloud is associated with a respective security level, and the replication of the data to the public cloud and the private cloud is performed based on the respective security levels of the public cloud and the private cloud.
15. The system of claim 11 , wherein at least one of the public cloud and the private cloud is selected to receive the portion of the table based on the metadata.