Data processing systems and methods for using a data model to select a target data asset in a data migration
Data stored on a data asset may be migrated to another data asset while maintaining compliance to applicable regulations. A data asset may experience a failure. Based on the type of data stored by that data asset and the applicable regulations, requirements, and/or restrictions that relate to a transfer of that type data from that data asset, a target data asset may be determined. The data stored on the data asset may then be transferred to the target data asset. The disclosed systems may use data models and/or data maps in determining the requirements for a data transfer and selecting target data assets.
1. A system comprising:
a non-transitory computer-readable medium storing instructions; and
a processing device communicatively coupled to the non-transitory computer-readable medium, wherein, the processing device is configured to execute the instructions and thereby perform operations comprising:
detecting a need to transfer data stored at a first data asset to a target data asset;
determining, based on a data element in a first data map associated with the first data asset, a type of data stored at the first data asset;
determining, based on the type of data, a data transfer rule for the first data asset and associated with the type of data;
identifying, based on the first data map, the target data asset, the target data asset being communicatively connected to the first data asset;
determining, based on a second data map associated with the target data asset, that the target data asset satisfies the data transfer rule; and
in response to detecting the need to transfer the data stored at the first data asset to the target data asset, transferring the data stored at the first data asset to the target data asset.
2. The system of claim 1 , wherein:
the operations further comprise, responsive to determining that the target data asset satisfies the data transfer rule, assigning the target data asset as a failover asset for the first data asset; and
detecting the need to transfer the data stored at the first data asset to the target data asset comprises detecting at least one of a failure or an anticipated failure at a data center associated with the first data asset.
3. The system of claim 1 , wherein the data transfer rule comprises at least one of an encryption level requirement for the data stored at the first data asset, a storage time limitation for the data stored at the first data asset, and an access restriction for the data stored at the first data asset.
4. The system of claim 3 , wherein determining, based on the second data map associated with the target data asset, that the target data asset satisfies the data transfer rule comprises determining that the target data asset is configured to implement the data transfer rule for the data at the target data asset.
5. The system of claim 1 , wherein the need to transfer data stored at a first data asset to a target data asset comprises at least one of a request to migrate the data from the first data asset to the target data asset or a detection of an outage at a data center housing the first data asset.
6. The system of claim 1 , wherein the data transfer rule comprises a regulation that is applicable to a transfer of the data stored at the first data asset to the target data asset.
7. The system of claim 6 , wherein:
the regulation that is applicable to the transfer of the data stored at the first data asset to the target data asset comprises a regulation to prevent cross-jurisdictional transfers; and
identifying the target data asset comprises identifying the target data asset that shares a jurisdiction of the first data asset.
8. The system of claim 1 , wherein the data transfer rule comprises at least one of a storage rule related to storage of the data at the target data asset, and an access rule related to access of the data at the target data asset.