System and method for test data management
The method for test data management may comprise receiving a test data characteristic; retrieving a master copy data from a master copy database; generating a secondary copy data, wherein the secondary copy data comprises a subset of the master copy data corresponding to the test data characteristic; generating a test copy data, wherein the test copy data is a copy of the secondary copy data; and transmitting the test copy data to a test environment. In this manner, the efficiency and resiliency of the system may be enhanced, and the test copy data may be improved so that the network may function according to approved parameters.
1. A method, comprising:
receiving, by a processor of a computer based system, a test data characteristic;
retrieving, by the processor, master copy data from a master copy database, wherein the master copy data provides an isolated copy of production data from a production data system to reduce use of computing resources in the production data system;
generating, by the processor, secondary copy data, wherein the secondary copy data comprises a subset of data from the master copy data, and wherein the subset of data is determined based on the test data characteristic;
generating, by the processor, test copy data, wherein the test copy data comprises a copy of data from the secondary copy data;
transmitting, by the processor, the test copy data to a test environment;
generating, by the processor, iterative secondary copy data, wherein the iterative secondary copy data is a copy of the test copy data; and
transmitting, by the processor, the iterative secondary copy data to a secondary copy database, wherein the secondary copy database stores the iterative secondary copy data as a version of the secondary copy data, and wherein the iterative secondary copy data provides an iterative backup of the test data copy for use in response to the test copy data being deleted or changed in the test environment.
2. The method of claim 1 , further comprising:
receiving, by the processor, a master copy data attribute from a metadata library;
retrieving, by the processor, the production data from the production data system;
generating, by the processor, the master copy data, wherein the master copy data comprises a subset of data from the production data, wherein subset of data is determined based on the master copy data attribute; and
transmitting, by the processor, the master copy data to the master copy database.
3. The method of claim 2 , further comprising updating, by the processor, the master copy data at a first master copy polling interval.
4. The method of claim 2 , further comprising updating, by the processor, the master copy data with a synthetic data in response to the production data system not comprising the production data corresponding to the master copy data attribute.
5. The method of claim 1 , further comprising:
retrieving, by the processor, the secondary copy data in response to the test copy data being deleted;
generating, by the processor, second test copy data, wherein the second test copy data is a copy of the secondary copy data; and
transmitting, by the processor, the second test copy data to the test environment.
6. The method of claim 1 , further comprising transmitting, by the processor, the secondary copy data to the secondary copy database.
7. A system comprising:
a processor; and
a tangible, non-transitory memory configured to communicate with the processor,
the tangible, non-transitory memory having instructions stored thereon that, in response to execution by the processor, cause the processor to perform operations comprising:
receiving, by the processor, a test data characteristic;
retrieving, by the processor, master copy data from a master copy database, wherein the master copy data provides an isolated copy of production data from a production data system to reduce use of computing resources in the production data system;
generating, by the processor, secondary copy data, wherein the secondary copy data comprises a subset of data from the master copy data, and wherein the subset of data is determined based on the test data characteristic;
generating, by the processor, test copy data, test copy data, wherein the test copy data comprises a copy of data from the secondary copy data; and
transmitting, by the processor, the test copy data to a test environment;
generating, by the processor, iterative secondary copy data, wherein the iterative secondary copy data is a copy of the test copy data; and
transmitting, by the processor, the iterative secondary copy data to a secondary copy database, wherein the secondary copy database stores the iterative secondary copy data as a version of the secondary copy data, and wherein the iterative secondary copy data provides an iterative backup of the test data copy for use in response to the test copy data being deleted or changed in the test environment.
8. The system of claim 7 , wherein the master copy data is generated by operations comprising:
receiving, by the processor, a master copy data attribute from a metadata library;
retrieving, by the processor, the production data from the production data system;
generating, by the processor, the master copy data, wherein the master copy data comprises a subset of data from the production data, wherein subset of data is determined based on the master copy data attribute; and
transmitting, by the processor, the master copy data to the master copy database.
9. The system of claim 8 , further comprising updating, by the processor, the master copy data at a first master copy polling interval.
10. The system of claim 8 , further comprising updating, by the processor, the master copy data with a synthetic data in response to the production data system not comprising the production data corresponding to the master copy data attribute.
11. The system of claim 7 , further comprising:
retrieving, by the processor, the secondary copy data in response to the test copy data being deleted;
generating, by the processor, second test copy data, wherein the second test copy data is a copy of the secondary copy data; and
transmitting, by the processor, the second test copy data to the test environment.
12. The system of claim 7 , further comprising transmitting, by the processor, the secondary copy data to the secondary copy database.
13. An article of manufacture including a non-transitory, tangible computer readable storage medium having instructions stored thereon that, in response to execution by a computer based system, cause the computer based system to perform operations comprising:
receiving, by the computer based system, a test data characteristic;
retrieving, by the computer based system, master copy data from a master copy database, wherein the master copy data provides an isolated copy of production data from a production data system to reduce use of computing resources in the production data system;
generating, by the computer based system, secondary copy data, wherein the secondary copy data comprises a subset of data from the master copy data, and wherein the subset of data is determined based on the test data characteristic;
generating, by the computer based system, test copy data, wherein the test copy data comprises a copy of data from the secondary copy data; and
transmitting, by the computer based system, the test copy data to a test environment;
generating, by the computer based system, iterative secondary copy data, wherein the iterative secondary copy data is a copy of the test copy data; and
transmitting, by the computer based system, the iterative secondary copy data to a secondary copy database, wherein the secondary copy database stores the iterative secondary copy data as a version of the secondary copy data, and wherein the iterative secondary copy data provides an iterative backup of the test data copy for use in response to the test copy data being deleted or changed in the test environment.
14. The article of manufacture of claim 13 , wherein the master copy data is generated by operations comprising:
receiving, by the computer based system, a master copy data attribute from a metadata library;
retrieving, by the computer based system, the production data from the production data system;
generating, by the computer based system, the master copy data, wherein the master copy data comprises a subset of data from the production data, and wherein subset of data is determined based on the master copy data attribute; and
transmitting, by the computer based system, the master copy data to the master copy database.
15. The article of manufacture of claim 14 , further comprising updating, by the computer based system, the master copy data at a first master copy polling interval.
16. The article of manufacture of claim 14 , further comprising updating, by the computer based system, the master copy data with a synthetic data in response to the production data system not comprising the production data corresponding to the master copy data attribute.
17. The article of manufacture of claim 13 , further comprising:
retrieving, by the computer based system, the secondary copy data in response to the test copy data being deleted;
generating, by the computer based system, second test copy data, wherein the second test copy data is a copy of the secondary copy data; and
transmitting, by the computer based system, the second test copy data to the test environment.
18. The article of manufacture of claim 13 , further comprising:
transmitting, by the computer based system, the secondary copy data to the secondary copy database.